How gosom/google-maps-scraper works
Google Maps Scraper extracts business leads, reviews, contact details, and related place data through CLI, web, REST, and SaaS interfaces. The principal workflow is job intake, runner selection, queued or direct scraping, Google Maps extraction, enrichment, and persistence for CSV, database, or API access. The SaaS edition adds authenticated administration, job monitoring, and cloud-worker provisioning. This map emphasizes sampled runtime code; several documented web/API routes remain intentionally lightly connected where their callers were not included.
Main entry points: databaserunner.go Database Runner · cmd_worker.go Worker Command · routes.go Admin Routes · handlers_workers.go Worker Handlers
Components 29
Job Intake
- Scraper CLI
main.go - SaaS CLI
cmd/gmapssaas/main.go - Web REST API
api/api.go - Web UI
web/web.go - Job Service
web/service.go
Scraping Execution
- Runner Factory
main.go - Database Runner
runner/databaserunner/databaserunner.go - Worker Command
cmd/gmapssaas/cmdworker/cmd_worker.go - Scraper Manager
scraper/scraper.go - Job Queue
rqueue/rqueue.go - Maps Extractor
gmaps/entry.go - Review Extractor
gmaps/reviews.go
Results Storage
- Postgres Provider
postgres/provider.go - Result Writer
postgres/resultwriter.go - Job Repository
web/sqlite/sqlite.go
SaaS Operations
- Admin Routes
admin/routes.go - Auth Handlers
admin/handlers_auth.go - Admin Store
admin/postgres/postgres.go - Worker Handlers
admin/handlers_workers.go
Worker Infrastructure
- Provision Jobs
rqueue/worker_jobs.go - Worker Provisioner
infra/worker.go - Cloud Provider
infra/digitalocean/digitalocean.go
Other components
- CLI User
- Web User
- API Client
- Admin User
- Google Maps
- Postgres Database
- Cloud API
Connections 24
- CLI User → Scraper CLI: invokes
- Scraper CLI → Runner Factory: selects runner
- Runner Factory → Database Runner: constructs
- Worker Command → Scraper Manager: starts
- Worker Command → Job Queue: starts
- Database Runner → Postgres Provider: creates provider
- Database Runner → Result Writer: creates writer
- Database Runner → Postgres Database: opens connection
- Worker Command → Postgres Database: connects
- Maps Extractor → Google Maps: fetches places
- Review Extractor → Google Maps: fetches reviews
- Worker Handlers → Worker Provisioner: creates provisioner
- Worker Handlers → Admin Store: stores worker state
- Provision Jobs → Worker Provisioner: provisions worker
- Provision Jobs → Postgres Database: updates state
- Worker Provisioner → Cloud API: calls provider
- Cloud Provider → Cloud API: implements provider
- Admin Routes → Auth Handlers: dispatches auth
- Admin Routes → Worker Handlers: dispatches workers
- Auth Handlers → Admin Store: reads sessions
- Admin Store → Postgres Database: persists records
- Web User → Web UI: uses
- API Client → Web REST API: calls
- Admin User → Admin Routes: uses