How faezlatiff/midas works
Atlas is a collection of four independently invoked Elixir/Hound web scrapers. The user selects a scraper, which drives a browser to a configured site, extracts source-specific venue, post, or review data, and appends JSON-lines output. Burpple handles neighborhood reviews and load-more pagination; Explorest gathers place details and coordinates; Lemon8 gathers article and postal-code details; Google Maps gathers places and their reviews. Each scraper owns its browser interactions and file writes. The README documents Selenium or ChromeDriver as external browser infrastructure; sampled source confirms the Hound calls, but not the internal browser-driver wiring.
Main entry points: burpple_hound.ex Burpple scraper · explorest_hound.ex Explorest scraper · lemon8_hound.ex Lemon8 scraper · gmaps_hound.ex Maps scraper
Components 15
Source Scrapers
- Burpple scraper
lib/burpple_hound.ex - Explorest scraper
lib/explorest_hound.ex - Lemon8 scraper
lib/lemon8_hound.ex - Maps scraper
lib/gmaps_hound.ex
Browser Access
- Hound browser control
- WebDriver
JSON Outputs
- Burpple JSONL
- Explorest JSONL
- Lemon8 JSONL
- Maps JSONL
Other components
- Operator
- Burpple
- Explorest
- Lemon8
- Google Maps
Connections 17
- Operator → Burpple scraper: invokes
- Operator → Explorest scraper: invokes
- Operator → Lemon8 scraper: invokes
- Operator → Maps scraper: invokes
- Burpple scraper → Hound browser control: controls browser
- Explorest scraper → Hound browser control: controls browser
- Lemon8 scraper → Hound browser control: controls browser
- Maps scraper → Hound browser control: controls browser
- Hound browser control → WebDriver: browser commands
- Burpple scraper → Burpple: navigates and reads
- Explorest scraper → Explorest: navigates and reads
- Lemon8 scraper → Lemon8: navigates and reads
- Maps scraper → Google Maps: navigates and reads
- Burpple scraper → Burpple JSONL: appends records
- Explorest scraper → Explorest JSONL: appends records
- Lemon8 scraper → Lemon8 JSONL: appends records
- Maps scraper → Maps JSONL: appends records