How artemsteshenko/parser_maps works
This is a command-line scraper for Yandex Maps. Its main workflow searches a city, district and organization category to save organization URLs, then reads those URL files, visits each organization page, extracts fields, shapes the records and writes CSV output. Category mappings and JSON link files support repeated runs; additional extracted fields include ratings, contact details, hours and goods, while review scraping exists as a helper but is not wired into the main parse flow. The sampled source establishes the two-stage flow; other category folders are visible in the tree, but their contents were not inspected.
Main entry points: info_parser.py Parser · link_parser.py Link command · soup_parser.py Field extraction · links Organization URLs
Components 12
Link collection
- Link command
link_parser.py - Category mapping
utils/constants.py - LinksCollector
link_parser.py - Organization URLs
links
Page enrichment
- Info command
info_parser.py - Parser
info_parser.py - Field extraction
soup_parser.py - Review helper
soup_parser.py
Scraped data
- Record formatter
utils/json_pattern.py - CSV output
result_output
Other components
- Operator
- Yandex Maps
Connections 13
- Operator → Link command: runs
- Link command → Category mapping: looks up category
- Link command → LinksCollector: invokes
- LinksCollector → Yandex Maps: searches listings
- LinksCollector → Organization URLs: writes URLs
- Operator → Info command: runs
- Info command → Organization URLs: reads URLs
- Info command → Parser: passes URLs
- Parser → Yandex Maps: visits organizations
- Parser → Field extraction: extracts fields
- Field extraction → Record formatter: provides values
- Parser → Record formatter: formats organization
- Parser → CSV output: writes batches