# ahmedibu777/gpu-selective-offload-pipeline architecture

> Architecture diagram of the GitHub repository ahmedibu777/gpu-selective-offload-pipeline, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-22). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/ahmedibu777/gpu-selective-offload-pipeline
- Repository: https://github.com/ahmedibu777/gpu-selective-offload-pipeline

## Overview

The repository is titled GPU Selective Offload Pipeline, but its README gives no behavioral detail and the sampled entry point only prints startup messages. The tree suggests capture, selection, compression, scheduling, offload, Python recording/client, and reporting capabilities. Those are represented as distinct components; source excerpts do not establish calls between them, so no runtime relationships are asserted. Several listed modules were not sampled, and their internal behavior remains uncertain.

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_capture["Capture and selection"]
  node_sensor_simulation["Sensor simulation"]
  node_recorder["Recorder<br/>[recorder.cpp]"]
  node_data_selection["Data selector<br/>[data_selector.cpp]"]
  node_event_trigger["Event triggers<br/>[event_trigger.cpp]"]
  node_sensor_priority["Sensor priorities"]
end

subgraph group_compute["Processing"]
  node_compression["Compression<br/>[compressor.cpp]"]
  node_cpu_compression["CPU compression"]
  node_gpu_compression["GPU compression"]
  node_inference["TensorRT inference<br/>[inference.cpp]"]
  node_engine_builder["Engine builder<br/>[engine_builder.cpp]"]
end

subgraph group_offload["Offload"]
  node_scheduler["Task scheduler<br/>[scheduler.cpp]"]
  node_priority_queue["Priority queue<br/>[priority_queue.cpp]"]
  node_bandwidth_allocator["Bandwidth allocator"]
  node_offload_manager["Offload manager"]
  node_uploader["Uploader<br/>[uploader.cpp]"]
  node_local_storage[("Local storage<br/>[local_storage.cpp]")]
  node_minio_client["MinIO client<br/>[minio_client.cpp]"]
end

subgraph group_python["Python tooling"]
  node_python_selector["Python selector<br/>[selector.py]"]
  node_event_detector["Event detector<br/>[event_detector.py]"]
  node_sensor_stream["Sensor stream<br/>[sensor_stream.py]"]
  node_dataset_loader["Dataset loader<br/>[dataset_loader.py]"]
  node_mcap_writer["MCAP writer<br/>[mcap_writer.py]"]
  node_replay["Replay<br/>[replay.py]"]
  node_upload_manager["Upload manager<br/>[upload_manager.py]"]
  node_offload_client["Offload client<br/>[client.py]"]
  node_minio_python["Python MinIO client<br/>[minio_client.py]"]
end

subgraph group_reporting["Reporting"]
  node_report_generator["Report generator<br/>[generate_report.py]"]
  node_bandwidth_plot["Bandwidth plot<br/>[plot_bandwidth.py]"]
  node_latency_plot["Latency plot<br/>[plot_latency.py]"]
  node_throughput_plot["Throughput plot<br/>[plot_throughput.py]"]
end

click node_sensor_simulation "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/recorder/sensor_simulator.cpp"
click node_recorder "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/recorder/recorder.cpp"
click node_data_selection "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/selection/data_selector.cpp"
click node_event_trigger "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/selection/event_trigger.cpp"
click node_sensor_priority "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/selection/sensor_priority.cpp"
click node_compression "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/compression/compressor.cpp"
click node_cpu_compression "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/compression/cpu_compression.cpp"
click node_gpu_compression "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/compression/gpu_compression.cpp"
click node_inference "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/tensorrt/inference.cpp"
click node_engine_builder "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/tensorrt/engine_builder.cpp"
click node_scheduler "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/queue/scheduler.cpp"
click node_priority_queue "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/queue/priority_queue.cpp"
click node_bandwidth_allocator "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/queue/bandwidth_allocator.cpp"
click node_offload_manager "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/offload_manager.cpp"
click node_uploader "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/uploader.cpp"
click node_local_storage "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/local_storage.cpp"
click node_minio_client "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/minio_client.cpp"
click node_python_selector "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/selection/selector.py"
click node_event_detector "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/selection/event_detector.py"
click node_sensor_stream "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/sensor_stream.py"
click node_dataset_loader "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/dataset_loader.py"
click node_mcap_writer "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/mcap_writer.py"
click node_replay "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/replay.py"
click node_upload_manager "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/offload/upload_manager.py"
click node_offload_client "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/offload/client.py"
click node_minio_python "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/offload/minio_client.py"
click node_report_generator "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/generate_report.py"
click node_bandwidth_plot "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/plot_bandwidth.py"
click node_latency_plot "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/plot_latency.py"
click node_throughput_plot "https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/plot_throughput.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_sensor_simulation,node_recorder,node_data_selection,node_event_trigger,node_sensor_priority toneBlue
class node_compression,node_cpu_compression,node_gpu_compression,node_inference,node_engine_builder toneAmber
class node_scheduler,node_priority_queue,node_bandwidth_allocator,node_offload_manager,node_uploader,node_local_storage,node_minio_client toneMint
class node_python_selector,node_event_detector,node_sensor_stream,node_dataset_loader,node_mcap_writer,node_replay,node_upload_manager,node_offload_client,node_minio_python toneRose
class node_report_generator,node_bandwidth_plot,node_latency_plot,node_throughput_plot toneIndigo
```

## Components

### Capture and selection

- [Sensor simulation](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/recorder/sensor_simulator.cpp): `src/recorder/sensor_simulator.cpp`
- [Recorder](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/recorder/recorder.cpp): `src/recorder/recorder.cpp`
- [Data selector](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/selection/data_selector.cpp): `src/selection/data_selector.cpp`
- [Event triggers](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/selection/event_trigger.cpp): `src/selection/event_trigger.cpp`
- [Sensor priorities](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/selection/sensor_priority.cpp): `src/selection/sensor_priority.cpp`

### Processing

- [Compression](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/compression/compressor.cpp): `src/compression/compressor.cpp`
- [CPU compression](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/compression/cpu_compression.cpp): `src/compression/cpu_compression.cpp`
- [GPU compression](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/compression/gpu_compression.cpp): `src/compression/gpu_compression.cpp`
- [TensorRT inference](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/tensorrt/inference.cpp): `src/tensorrt/inference.cpp`
- [Engine builder](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/tensorrt/engine_builder.cpp): `src/tensorrt/engine_builder.cpp`

### Offload

- [Task scheduler](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/queue/scheduler.cpp): `src/queue/scheduler.cpp`
- [Priority queue](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/queue/priority_queue.cpp): `src/queue/priority_queue.cpp`
- [Bandwidth allocator](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/queue/bandwidth_allocator.cpp): `src/queue/bandwidth_allocator.cpp`
- [Offload manager](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/offload_manager.cpp): `src/offload/offload_manager.cpp`
- [Uploader](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/uploader.cpp): `src/offload/uploader.cpp`
- [Local storage](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/local_storage.cpp): `src/offload/local_storage.cpp`
- [MinIO client](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/src/offload/minio_client.cpp): `src/offload/minio_client.cpp`

### Python tooling

- [Python selector](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/selection/selector.py): `python/selection/selector.py`
- [Event detector](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/selection/event_detector.py): `python/selection/event_detector.py`
- [Sensor stream](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/sensor_stream.py): `python/recorder/sensor_stream.py`
- [Dataset loader](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/dataset_loader.py): `python/recorder/dataset_loader.py`
- [MCAP writer](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/mcap_writer.py): `python/recorder/mcap_writer.py`
- [Replay](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/recorder/replay.py): `python/recorder/replay.py`
- [Upload manager](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/offload/upload_manager.py): `python/offload/upload_manager.py`
- [Offload client](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/offload/client.py): `python/offload/client.py`
- [Python MinIO client](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/offload/minio_client.py): `python/offload/minio_client.py`

### Reporting

- [Report generator](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/generate_report.py): `python/visualization/generate_report.py`
- [Bandwidth plot](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/plot_bandwidth.py): `python/visualization/plot_bandwidth.py`
- [Latency plot](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/plot_latency.py): `python/visualization/plot_latency.py`
- [Throughput plot](https://github.com/ahmedibu777/gpu-selective-offload-pipeline/blob/main/python/visualization/plot_throughput.py): `python/visualization/plot_throughput.py`
