How developer-dreamer/dorker works
Dorker collects public job listings from ATS platforms, normalizes and stores them, then analyzes listings for candidate fit and supports application-material generation and review through Telegram. The principal documented run path starts with the scraper orchestration and proceeds through configuration, concurrent ATS execution, and persistence. Matching and application generation form a separate workflow. The graph preserves the listed scraper integrations and analytics capabilities, while the available excerpts do not establish every runtime connection or the normalizer’s role in the scraper path.
Main entry points: engine.py Matching engine · scraper.py Scraper orchestration · scraper_runner.py ATS runner · base.py Scraper base
Components 21
Job collection
- Scraper orchestration
orchestration/scraper.py - ATS configuration
src/scraping/configuration_manager.py - Scrape run engine
src/scraping/pipeline_engine/engine.py - ATS runner
src/scraping/pipeline_engine/scraper_runner.py - ATS scrapers
src/scraping/scrapers - Scraper base
src/scraping/scrapers/base.py - Fetch utilities
src/scraping/fetch.py - Scrape job schema
src/scraping/models.py - Job normalizer
orchestration/normalizer.py
Matching and applications
- Analytics orchestration
orchestration/analyst.py - Matching engine
src/analytics/engine.py - Job classifiers
src/analytics/classification - SLM extraction
src/analytics/classification/classify_job_tier_slm.py - Description filter
src/analytics/ml/filter_description.py - Application generators
src/analytics/generation - Telegram client
src/client/telegram.py
Data persistence
- Scrape storage
src/scraping/database - Analytics repositories
src/database/postgres
Shared domain
- Job and company models
src/shared/models/job.py - Match and application models
src/shared/models/match.py
Other components
- Operator
Connections 27
- Operator → Scraper orchestration: starts scraping
- Scraper orchestration → ATS configuration: loads configuration
orchestration/scraper.py - Scraper orchestration → Scrape run engine: starts run
orchestration/scraper.py - Scraper orchestration → Scrape storage: configures storage
orchestration/scraper.py - Scraper orchestration → Job and company models: loads companies
orchestration/scraper.py - ATS configuration → Scraper base: resolves scraper
src/scraping/configuration_manager.py - Scrape run engine → ATS runner: runs ATS
src/scraping/pipeline_engine/engine.py - Scrape run engine → ATS configuration: uses configuration
src/scraping/pipeline_engine/engine.py - Scrape run engine → Scrape storage: writes jobs
src/scraping/pipeline_engine/engine.py - ATS runner → Scraper base: uses scraper base
src/scraping/pipeline_engine/scraper_runner.py - ATS runner → ATS configuration: uses configuration
src/scraping/pipeline_engine/scraper_runner.py - ATS runner → Scrape storage: uses repository
src/scraping/pipeline_engine/scraper_runner.py - ATS runner → Scrape job schema: processes jobs
src/scraping/pipeline_engine/scraper_runner.py - ATS scrapers → Scraper base: extend base
src/scraping/scrapers/avature.py - Scraper base → Fetch utilities: uses fetch
src/scraping/scrapers/base.py - Scraper base → Scrape job schema: uses models
src/scraping/scrapers/base.py - Analytics orchestration → Matching engine: runs analytics
orchestration/analyst.py - Analytics orchestration → Analytics repositories: uses repositories
orchestration/analyst.py - Analytics orchestration → Telegram client: starts client
orchestration/analyst.py - Matching engine → Analytics repositories: reads and writes
src/analytics/engine.py - Matching engine → Job classifiers: uses classifiers
src/analytics/engine.py - Matching engine → Description filter: uses filter
src/analytics/engine.py - Matching engine → SLM extraction: generates entities
src/analytics/engine.py - Matching engine → Application generators: generates materials
- Matching engine → Match and application models: saves matches
src/analytics/engine.py - Telegram client → Matching engine: requests matching
- Job normalizer → Job and company models: normalizes jobs