How ternaustralia/vm_data_acquisition works
VM_data_acquisition coordinates site-level logger-data acquisition, evaluation, and production of secondary data and metadata. Its principal workflow is task selection by site, followed by data processing or status evaluation and writing derived products; separate branches handle 10 Hz data, metadata, and RTMC configuration. The excerpts show several calls, while the source index supplies additional module references; links without direct call evidence are omitted. The README is brief, so some capability details and integration wiring remain uncertain.
Main entry points: tasks_manager.py Task manager · data_parser.py Site data parser · sparql_site_details.py Site details · file_constructors.py Data constructors
Components 26
Task orchestration
- Task manager
tasks_manager.py
Logger data processing
- Logger file I/O
file_io.py - File conditioning
file_handler.py - File concatenation
file_concatenators.py - EddyPro concatenation
eddy_pro_concatenator.py - Site data parser
data_parser.py - Meteorological calculations
met_functions.py - Logger utilities
logger_functions.py
Site configuration
- Path manager
paths_manager.py - Site details
sparql_site_details.py - Config generation
config_generators.py - File and variable maps
data_mapper.py - Metadata manager
metadata_handler.py
Derived products
- Data constructors
file_constructors.py - 10 Hz processing
process_10hz_data.py - Data status reporting
network_status_parser.py - Metadata products
metadata_handlers.py - RTMC XML parser
rtmc_xml_parser.py - RTMC XML writer
rtmc_xml_writer.py
External integrations
- Remote transfer
rclone_transfer.py - BOM FTP access
bom_ftp.py
Other components
- Operator
- RTMC XML files
- Cloudstor task sheet
- TERN SPARQL service
- Remote storage
Connections 40
- Operator → Task manager: runs tasks
tasks_manager.py - Task manager → Cloudstor task sheet: reads task list
tasks_manager.py - Task manager → EddyPro concatenation: runs
tasks_manager.py - Task manager → Data constructors: runs
tasks_manager.py - Task manager → Data status reporting: runs
tasks_manager.py - Task manager → 10 Hz processing: runs
tasks_manager.py - Task manager → Remote transfer: runs
tasks_manager.py - Task manager → Path manager: uses paths
tasks_manager.py - Site data parser → File and variable maps: uses file map
data_parser.py - Site data parser → File conditioning: uses handler
data_parser.py - Site data parser → Logger file I/O: uses I/O
data_parser.py - Site data parser → Meteorological calculations: uses calculations
data_parser.py - Site data parser → Site details: uses site details
data_parser.py - File conditioning → Logger file I/O: uses I/O
file_handler.py - File conditioning → File concatenation: uses concatenation
file_handler.py - Data constructors → Site data parser: parses data
file_constructors.py - Data constructors → File conditioning: handles files
file_constructors.py - Data constructors → File and variable maps: uses mappings
file_constructors.py - Data constructors → Path manager: uses paths
file_constructors.py - Data constructors → Site details: gets site details
file_constructors.py - Data status reporting → Site data parser: gets status data
network_status_parser.py - Data status reporting → File and variable maps: uses mappings
network_status_parser.py - Data status reporting → Path manager: uses paths
network_status_parser.py - Data status reporting → Site details: uses site details
network_status_parser.py - Metadata manager → Path manager: creates paths
metadata_handler.py - Metadata manager → File and variable maps: creates managers
metadata_handler.py - Metadata manager → Site details: gets site details
metadata_handler.py - Metadata products → Logger file I/O: uses I/O
metadata_handlers.py - Metadata products → Site details: uses site details
metadata_handlers.py - RTMC XML writer → Metadata manager: uses metadata
rtmc_xml_writer.py - RTMC XML writer → File and variable maps: uses mappings
rtmc_xml_writer.py - RTMC XML writer → RTMC XML parser: uses XML parser
rtmc_xml_writer.py - RTMC XML writer → Path manager: uses paths
rtmc_xml_writer.py - RTMC XML parser → RTMC XML files: reads and edits
- Site details → TERN SPARQL service: queries
sparql_site_details.py - Remote transfer → Path manager: gets paths
rclone_transfer.py - Config generation → Path manager: uses paths
config_generators.py - Config generation → Site details: uses site details
config_generators.py - Config generation → Logger file I/O: uses I/O
config_generators.py - Remote transfer → Remote storage: transfers files