How thefpiasta/study-csh-olympics works
This repository documents a research workflow for collecting Olympic venue data, extracting structured records from reports, combining venue datasets, and presenting the results in an interactive web application. The main user path is through maps and analytics backed by processed GeoJSON. The graph also preserves the documented PDF-extraction and venue-matching branches. Several workflow links come from the README rather than inspected calls; unsampled application internals are represented by their existing directories.
Main entry points: app Interactive web app · logger.js Application logger · 00_final_geojsons Processed GeoJSON · 01_scraper.py Venue scraper
Components 22
Data collection
- Venue scraper
geojson_scraper/01_scraper.py - PDF extraction
pdfToJson
Data processing
- GeoJSON templating
geojson_scraper/02_geojson_templater.py - Duplicate removal
geojson_scraper/03_duplicate_finder.py - Venue renaming
geojson_scraper/04_renamer.py - Venue combining
geojson_scraper/05_venue_combiner.py - Harvard data combine
geojson_scraper/06_harvard_combiner.py - Venue matching
archive/matching-poc/main.py - Fuzzy matcher
archive/matching-poc/venues_matcher.py - Processed GeoJSON
geojson_scraper/00_final_geojsons
Web application
- Interactive web app
webapp/src/app - Venue maps
webapp/src/app/map - Charts and analytics
webapp/src/app/graphs - Olympic data API
webapp/src/app/api/olympics - City lookup API
webapp/src/app/api/cities/route.js
Operations
- Application logger
webapp/src/components/logger.js - Log collection API
webapp/src/app/api/logs/route.js - Backend monitor API
webapp/src/app/api/backend/monitor/route.js
Other components
- Researcher
- Olympedia
- Olympic reports
- Web visitor
Connections 20
- Researcher → Venue scraper: initiates scraping
README.md - Olympedia → Venue scraper: provides venue data
README.md - Olympic reports → PDF extraction: provides PDFs
README.md - Researcher → PDF extraction: runs extraction
README.md - Venue scraper → GeoJSON templating: supplies scraped data
README.md - GeoJSON templating → Duplicate removal: creates GeoJSON
README.md - Duplicate removal → Venue renaming: removes duplicates
README.md - Venue renaming → Venue combining: adds descriptive names
README.md - Venue combining → Processed GeoJSON: writes final data
README.md - Harvard data combine → Processed GeoJSON: combines external data
README.md - Venue matching → Fuzzy matcher: calls matcher
archive/matching-poc/main.py - Web visitor → Interactive web app: views
README.md - Interactive web app → Venue maps: offers maps
README.md - Interactive web app → Charts and analytics: offers analytics
README.md - Interactive web app → Processed GeoJSON: loads GeoJSON
README.md - Olympic data API → Processed GeoJSON: reads GeoJSON
webapp/src/app/api/olympics/all/route.js - City lookup API → Application logger: logs activity
webapp/src/app/api/cities/route.js - Olympic data API → Application logger: logs errors
webapp/src/app/api/olympics/[slug]/route.js - Application logger → Log collection API: sends client logs
webapp/src/components/logger.js - Backend monitor API → Application logger: logs warnings
webapp/src/app/api/backend/monitor/route.js