How swisstopo/topo-satromo-v2 works
SATROMO v2 is a satellite-imagery ETL pipeline that checks input availability, processes Sentinel-2 into analysis-ready products and vegetation indices, then publishes outputs to STAC. The main documented workflow is daily orchestration through step0 readiness checks and step1 product generation; S2-SR processing includes coregistration, mosaicing, cloud masking, terrain correction, and publication, while VHI is a separate index product. Groups also preserve the pipeline’s configuration, processing components, and catalog/publishing capabilities. Some internal calls are not visible in the excerpts, so those relationships are omitted or marked unverified.
Main entry points: step1_processor_s2_sr.py S2-SR generator · satromo_processor.py Daily runner · step0_functions.py Availability checks · main_utils.py Processing utilities
Components 24
Pipeline orchestration
- Daily runner
satromo_processor.py - Availability checks
step0_functions.py - Step0 helpers
step0_processors/step0_utils.py - Environment and products
configuration/dev_config.py
Product generation
- S2-SR generator
step1_processors/step1_processor_s2_sr.py - VHI generator
step1_processors/step1_processor_vhi.py
Imagery processing
- Coregistration
main_functions/main_coregistration.py - Reprojection
main_functions/main_reprojection.py - Mosaicing
main_functions/main_mosaicing.py - Cloud masking
main_functions/main_omnicloudmask.py - Cloud percentage
main_functions/main_cloudpercentage.py - Terrain correction
main_functions/main_terrain_module.py - Parallel terrain
main_functions/main_terrain_parallel.py - Terrain worker
main_functions/_terrain_worker.py - RGB rendering
main_functions/main_create_rgb.py - Thumbnail generation
main_functions/main_thumbnails.py - Warning regions
main_functions/main_extract_warnregions.py - Processing utilities
main_functions/main_utils.py
Catalog and publishing
- STAC publisher
main_functions/main_publish_stac_fsdi.py - Asset upload
main_functions/main_multipart_upload_via_api.py - CS+ publishing
main_functions/csplus_publish.py
Other components
- Scheduler
- STAC catalog
- S3 storage
Connections 26
- Scheduler → Daily runner: triggers
- Daily runner → Availability checks: runs checks
satromo_processor.py - Daily runner → S2-SR generator: runs products
satromo_processor.py - Daily runner → VHI generator: runs products
satromo_processor.py - Availability checks → Step0 helpers: uses helper
- Availability checks → Processing utilities: uses
step0_functions.py - Availability checks → S2-SR generator: dispatches generation
- S2-SR generator → Environment and products: reads settings
- S2-SR generator → Coregistration: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → Reprojection: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → Mosaicing: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → Cloud masking: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → Cloud percentage: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → Terrain correction: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → Parallel terrain: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → RGB rendering: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → Thumbnail generation: uses
step1_processors/step1_processor_s2_sr.py - S2-SR generator → STAC publisher: uses
step1_processors/step1_processor_s2_sr.py - VHI generator → STAC publisher: publishes with
step1_processors/step1_processor_vhi.py - STAC publisher → Asset upload: uploads assets
main_functions/main_publish_stac_fsdi.py - STAC publisher → STAC catalog: writes items
main_functions/main_publish_stac_fsdi.py - Terrain worker → Parallel terrain: invokes
main_functions/_terrain_worker.py - Parallel terrain → Terrain correction: uses
main_functions/main_terrain_parallel.py - CS+ publishing → Processing utilities: uses
main_functions/csplus_publish.py - Processing utilities → S3 storage: reads or writes
- Processing utilities → STAC catalog: queries