How jmldigital/parseplaywrightoriginall works
This is an asynchronous auto-parts price and name parser. The main workflow reads an Excel inventory, dispatches product lookups through workers to retailer scrapers, handles authentication and CAPTCHA when needed, then adjusts prices and saves results. The README also documents name parsing, four retailer sources, and optional Telegram and proxy support. The sampled main.py excerpt confirms worker and CAPTCHA orchestration; unsampled modules are included where the README and source index establish their product role, with uncertain connections omitted.
Main entry points: main.py Worker pool · config.py Parser configuration · scraper_stparts.py STParts scraper · scraper_avtoformula.py AvtoFormula scraper
Components 20
Parsing workflow
- Excel inventory
- Async runner
main.py - Worker pool
main.py
Retailer sources
- STParts scraper
scraper_stparts.py - AvtoFormula scraper
scraper_avtoformula.py - Adeo scraper
scraper_adeo.py - Emex scraper
scrape_emex.py - Armtek scraper
scraper_armtek.py
Access and resilience
- Cookie login
auth.py - CAPTCHA queue
captcha_manager.py - CAPTCHA solver
utils.py - Parser configuration
config.py - Lookup cache
cache_manager.py
Results and delivery
- Price adjustment
price_adjuster.py - Excel results
- Telegram controls
bot.py - Telegram delivery
telegram_sender.py
Other components
- Operator
- Telegram service
- 2Captcha service
Connections 26
- Operator → Excel inventory: provides
Readme.md - Excel inventory → Async runner: loaded by
- Async runner → Worker pool: starts
main.py - Worker pool → CAPTCHA queue: requests
main.py - CAPTCHA queue → CAPTCHA solver: delegates to
captcha_manager.py - CAPTCHA solver → 2Captcha service: submits challenge
- Worker pool → STParts scraper: dispatches
main.py - Worker pool → AvtoFormula scraper: dispatches
- Worker pool → Adeo scraper: dispatches
- Worker pool → Emex scraper: dispatches
- Worker pool → Armtek scraper: dispatches
- Async runner → Cookie login: uses login
main.py - AvtoFormula scraper → Cookie login: uses login
scraper_avtoformula.py - Async runner → Parser configuration: reads settings
main.py - Cookie login → Parser configuration: reads selectors
auth.py - STParts scraper → Parser configuration: reads selectors
scraper_stparts.py - AvtoFormula scraper → Parser configuration: reads selectors
scraper_avtoformula.py - Armtek scraper → Parser configuration: reads selectors
scraper_armtek.py - Async runner → Price adjustment: applies adjustments
main.py - Price adjustment → Excel results: saves workbook
price_adjuster.py - Async runner → Excel results: writes interim data
- Telegram controls → Async runner: starts parser
- Telegram controls → Telegram delivery: sends result
bot.py - Telegram delivery → Telegram service: uploads file
telegram_sender.py - Operator → Telegram controls: controls
- STParts scraper → Lookup cache: uses cache