How franco7scala/disasterchain works
DisasterChain builds a global disaster-event dataset from EM-DAT and GDIS, enriching events with resolved locations, weather, news-derived narratives and satellite observations before exporting a portable JSON/image package. The principal workflow is launched through src/main.py and planned or executed by src/run_release_pipeline.py. The graph preserves the documented stages and major product branches; some stage links are documented at pipeline level because the corresponding implementation was not sampled. src/main.py also contains weather-fetching behavior, while reusable engines and record-building layers are shown separately.
Main entry points: run_release_pipeline.py Release pipeline · fetch_multimodal_satellite_batch.py Satellite batch retrieval · export_final_event_dataset.py Final dataset export · main.py CLI entry point
Components 24
Release orchestration
- CLI entry point
src/main.py - Release pipeline
src/run_release_pipeline.py
Event data and geocoding
- Base event merge
src/build_base_dataset.py - LLM location cleaning
src/clean_emdat_locations_with_llm.py - Geocoding query prep
src/prepare_llm_location_nominatim_queries.py - Geocoding resolution
src/resolve_final_geocoding.py - Text query geocoding
src/geocode_text_queries.py
Weather and narratives
- Weather enrichment
src/fetch_weather_batch.py - Weather normalization
src/support/weather_data.py - News collection
src/build_news_dataset_from_geocoded_events.py - News retrieval engine
src/support/news_engine.py - Event news summaries
src/generate_event_news_summaries.py - Causal chain generation
src/generate_event_causal_chains.py - Local LLM reasoner
src/support/reasoner.py
Satellite observations
- Satellite batch retrieval
src/fetch_multimodal_satellite_batch.py - Satellite processing engine
src/support/multimodal_satellite_engine.py - Satellite event selection
src/support/satellite_selection.py
Dataset assembly
- Final event assembly
src/assemble_final_event_dataset.py - Public record builder
src/support/final_dataset_records.py - Final dataset export
src/export_final_event_dataset.py
Other components
- Dataset operator
- EM-DAT and GDIS
- Copernicus Sentinel Hub
- JSON and image package
Connections 25
- Dataset operator → CLI entry point: runs
- CLI entry point → Release pipeline: launches
src/main.py - EM-DAT and GDIS → Base event merge: supplies inputs
- Release pipeline → Base event merge: runs merge
src/run_release_pipeline.py - Release pipeline → LLM location cleaning: runs cleaning
- Release pipeline → Geocoding query prep: runs query prep
- Release pipeline → Geocoding resolution: runs resolution
- Release pipeline → Text query geocoding: runs geocoding
- Release pipeline → Weather enrichment: runs enrichment
- Release pipeline → News collection: runs collection
- Release pipeline → Event news summaries: runs summaries
- Release pipeline → Causal chain generation: runs reasoning
- Release pipeline → Satellite batch retrieval: runs retrieval
- Release pipeline → Final dataset export: runs export
src/export_final_event_dataset.py - LLM location cleaning → Geocoding query prep: prepares queries
src/prepare_llm_location_nominatim_queries.py - Weather enrichment → Weather normalization: normalizes data
src/support/weather_data.py - News collection → News retrieval engine: retrieves articles
src/build_news_dataset_from_geocoded_events.py - Event news summaries → Local LLM reasoner: generates summaries
src/generate_event_news_summaries.py - Causal chain generation → Local LLM reasoner: generates chains
src/generate_event_causal_chains.py - Satellite batch retrieval → Satellite processing engine: processes scenes
src/fetch_multimodal_satellite_batch.py - Satellite processing engine → Copernicus Sentinel Hub: requests imagery
- Satellite batch retrieval → Satellite event selection: selects events
src/fetch_multimodal_satellite_batch.py - Final event assembly → Public record builder: builds records
src/assemble_final_event_dataset.py - Final dataset export → Public record builder: formats records
src/export_final_event_dataset.py - Final dataset export → JSON and image package: writes package