How ds-lab/metrion works
METRION monitors Linux hardware and process activity, records measurements in a session database, then reconstructs per-process CPU, DRAM, and GPU energy through its attribution CLI. The graph preserves discovery, monitoring sources, the entity/measurement model, persistence, and analysis. Some subsystem links rely on the README or SOURCE INDEX references; internals of unsampled collector and monitoring modules are not inferred.
Main entry points: data_record.py Measurements and records · orchestrator.py Monitor orchestrator · data_source_factory.py Data source factory · cpu CPU counters and events
Components 21
Runtime control
- Monitor orchestrator
metrion/orchestrator.py - Configuration reader
metrion/config_reader/config_reader.py
Host discovery
- Hardware detection
metrion/discovery/hardware_detection.py - Linux system scanner
metrion/discovery/system_scanner/bare_metal/linux - System tree builder
metrion/discovery/tree_builder.py
Monitoring
- Entity monitor
metrion/monitoring/entity_monitor.py - Data collector
metrion/data_collector.py - Data source factory
metrion/monitoring/data_source/data_source_factory.py - CPU counters and events
metrion/monitoring/data_source/cpu - NVIDIA NVML source
metrion/monitoring/data_source/gpu/nvml.py - NUMA memory source
metrion/monitoring/data_source/memory/proc_numa.py - TCP network source
metrion/monitoring/data_source/network/tcp_monitor.py
Data model
- Process entity registry
metrion/entity/logical_entity_registry.py - Hardware entity model
metrion/entity - Metric definitions
metrion/metric.py - Measurements and records
metrion/data_record.py
Storage and analysis
- SQLite database storage
metrion/data_storage/db_data_storage.py - Session database
- Energy attribution
metrion/energy_attribution/energy_attribution.py - Analysis CLI
metrion/energy_attribution/energy_attribution_cli.py
Other components
- Operator
Connections 26
- Operator → Monitor orchestrator: starts monitoring
- Operator → Analysis CLI: runs analysis
- Monitor orchestrator → Configuration reader: loads settings
metrion/orchestrator.py - Monitor orchestrator → Hardware detection: detects hardware
metrion/orchestrator.py - Hardware detection → System tree builder: builds topology
metrion/discovery/hardware_detection.py - System tree builder → Linux system scanner: uses system info
metrion/discovery/tree_builder.py - Monitor orchestrator → Entity monitor: starts monitoring
metrion/orchestrator.py - Monitor orchestrator → Data collector: uses collector
metrion/orchestrator.py - Entity monitor → Data source factory: selects sources
- Data source factory → CPU counters and events: dispatches to
- Data source factory → NVIDIA NVML source: dispatches to
- Data source factory → NUMA memory source: dispatches to
- Data source factory → TCP network source: dispatches to
- CPU counters and events → Process entity registry: updates processes
metrion/monitoring/data_source/cpu/sched_switch.py - NVIDIA NVML source → Process entity registry: resolves processes
metrion/monitoring/data_source/gpu/nvml.py - TCP network source → Process entity registry: resolves processes
metrion/monitoring/data_source/network/tcp_monitor.py - CPU counters and events → Measurements and records: emits records
metrion/monitoring/data_source/cpu/sched_switch.py - NVIDIA NVML source → Measurements and records: emits records
metrion/monitoring/data_source/gpu/nvml.py - TCP network source → Measurements and records: emits records
metrion/monitoring/data_source/network/tcp_monitor.py - Measurements and records → Hardware entity model: references entities
metrion/data_record.py - Measurements and records → Metric definitions: references metrics
metrion/monitoring/data_source/data_source_base.py - Data collector → SQLite database storage: persists records
- SQLite database storage → Session database: writes session data
- Analysis CLI → Session database: reads session data
- Analysis CLI → Energy attribution: runs attribution
metrion/energy_attribution/energy_attribution_cli.py - Energy attribution → Measurements and records: uses measurement model
metrion/energy_attribution/energy_attribution.py