How dhruvgodambe/upwork-scraper works
This is a one-shot Upwork job-discovery bot. Its main workflow authenticates in a persistent Chrome profile, builds Best Matches and keyword-search feeds, scrapes and parses job cards, stores relevant recent jobs in SQLite, then applies user-defined filters and prints matches. The graph separates orchestration, browser access, job processing, and persistence/filtering. Some feed-planning and filtering calls fall in unsampled portions of app.py; those links are supported by the README’s documented workflow.
Main entry points: app.py Run orchestration · filter.py Job filtering · browser.py Chrome startup · auth.py Upwork login
Components 15
Runtime setup
- Run orchestration
upwork_scraper/app.py - Runtime settings
upwork_scraper/config.py
Upwork collection
- Chrome startup
upwork_scraper/browser.py - Upwork login
upwork_scraper/auth.py - Feed planning
upwork_scraper/app.py - Feed scraping
upwork_scraper/app.py
Job processing
- Job parsing
upwork_scraper/job_helpers.py - Relevance checks
upwork_scraper/job_helpers.py
Persistence and results
- SQLite jobs
upwork_scraper/database.py - Filter rules
filter_config.json - Job filtering
upwork_scraper/filter.py - Results display
upwork_scraper/filter.py
Other components
- User
- Chrome browser
- Upwork
Connections 16
- User → Run orchestration: runs
README.md - Run orchestration → Runtime settings: loads settings
upwork_scraper/app.py - Run orchestration → Chrome startup: launches
upwork_scraper/app.py - Chrome startup → Chrome browser: starts
upwork_scraper/browser.py - Run orchestration → Upwork login: authenticates
upwork_scraper/app.py - Upwork login → Upwork: logs in
upwork_scraper/auth.py - Run orchestration → Feed planning: builds feeds
README.md - Feed planning → Feed scraping: supplies URLs
README.md - Feed scraping → Upwork: loads job feeds
README.md - Feed scraping → Job parsing: parses cards
upwork_scraper/app.py - Feed scraping → Relevance checks: checks relevance
upwork_scraper/app.py - Run orchestration → SQLite jobs: creates and writes
upwork_scraper/app.py - Run orchestration → Job filtering: filters after scraping
README.md - Filter rules → Job filtering: configures
README.md - Job filtering → SQLite jobs: reads jobs
upwork_scraper/filter.py - Job filtering → Results display: prints matches
upwork_scraper/filter.py