How iandreafc/gdeltnews works
gdeltnews turns GDELT Web News NGrams into filtered article datasets: users can download minute files, reconstruct article text from overlapping fragments, then Boolean-filter and deduplicate CSV output. The Tkinter GUI exposes download, reconstruction, filtering, and recap workflows over the same package capabilities. Arrows reflect documented or excerpted calls; unsampled internals are represented only where the README documents a capability.
Main entry points: main.py Desktop GUI · download.py Minute downloader · reconstruct.py Batch orchestrator · filtermerge.py Query and deduplicate
Components 10
User interface
- Desktop GUI
GUI/main.py
Data acquisition
- Minute downloader
src/gdeltnews/download.py - GDELT files
- Compressed inputs
Article reconstruction
- Batch orchestrator
src/gdeltnews/reconstruct.py - Fragment matcher
src/gdeltnews/wordmatch.py - Article CSVs
Filtering and export
- Query and deduplicate
src/gdeltnews/filtermerge.py - Filtered CSV
Other components
- Research user
Connections 14
- Research user → Desktop GUI: operates
GUI/main.py - Research user → Minute downloader: requests range
README.md - Minute downloader → GDELT files: fetches files
README.md - Minute downloader → Compressed inputs: writes files
src/gdeltnews/download.py - Research user → Batch orchestrator: runs reconstruction
README.md - Compressed inputs → Batch orchestrator: reads inputs
src/gdeltnews/reconstruct.py - Batch orchestrator → Fragment matcher: dispatches files
src/gdeltnews/reconstruct.py - Fragment matcher → Article CSVs: writes articles
src/gdeltnews/wordmatch.py - Research user → Query and deduplicate: sets query
README.md - Article CSVs → Query and deduplicate: reads CSVs
README.md - Query and deduplicate → Filtered CSV: filters and deduplicates
src/gdeltnews/filtermerge.py - Desktop GUI → Minute downloader: invokes
GUI/main.py - Desktop GUI → Batch orchestrator: invokes
GUI/main.py - Desktop GUI → Query and deduplicate: invokes
GUI/main.py