How pranayb16/jobly works
Jobly turns employer career-site listings into a historical, enriched hiring-intelligence dataset, then serves company, role, skill, and trend views alongside a legacy job board. The principal daily workflow is explicitly documented and orchestrated by the pipeline command: reconcile sources, crawl and retain job history, enrich a bounded queue, then snapshot companies. API and frontend details are represented at the documented capability level; several implementations were not sampled, so those links cite the README rather than implying source inspection.
Main entry points: pipeline.py Daily Pipeline · enrichment/worker.py Enrichment Queue Worker · manager.py Source Reconciliation · crawling/worker.py Crawl Worker
Components 24
Source Ingestion
- Daily Pipeline
backend/jobly/commands/pipeline.py - Source Candidates
- Source Reconciliation
backend/jobly/sources/manager.py - ATS Crawling
backend/jobly/crawling/runner.py - Crawl Worker
backend/jobly/crawling/worker.py - Jobs and History
backend/jobly/jobs/repository.py - Company Identity
backend/jobly/companies/repository.py
Job Enrichment
- Enrichment Queue Worker
backend/jobly/enrichment/worker.py - Classification and Inputs
backend/jobly/enrichment/input_builder.py - Job Enrichments
Market Intelligence
- Daily Snapshots
backend/jobly/intelligence/snapshots.py - Company Snapshots
- Intelligence Queries
backend/jobly/intelligence/repository.py - Trend Queries
backend/jobly/intelligence/trends.py
API Serving
- FastAPI Application
backend/jobly/api/main.py - Intelligence Routes
backend/jobly/api/routes/companies.py - Legacy Jobs API
backend/jobly/products/jobs/routes.py
Web Experience
- Intelligence Pages
frontend/app/companies/page.tsx - Job Board
frontend/components/JobsPage.tsx - Jobs API Routes
frontend/app/api/jobs/route.ts
Other components
- Daily Scheduler
- Employer ATS Sites
- Gemini
- Job Seeker
Connections 25
- Daily Scheduler → Daily Pipeline: triggers
README.md - Daily Pipeline → Source Reconciliation: reconciles
backend/jobly/commands/pipeline.py - Source Reconciliation → Source Candidates: reads candidates
README.md - Source Reconciliation → Company Identity: links identity
backend/jobly/sources/manager.py - Daily Pipeline → Crawl Worker: runs crawl
backend/jobly/commands/pipeline.py - Crawl Worker → ATS Crawling: crawls sources
backend/jobly/crawling/worker.py - ATS Crawling → Employer ATS Sites: fetches listings
README.md - Crawl Worker → Jobs and History: saves job state
backend/jobly/crawling/worker.py - Jobs and History → Company Identity: resolves company
backend/jobly/jobs/repository.py - Jobs and History → Job Enrichments: queues changes
backend/jobly/jobs/repository.py - Daily Pipeline → Enrichment Queue Worker: runs enrichment
backend/jobly/commands/pipeline.py - Enrichment Queue Worker → Classification and Inputs: builds inputs
backend/jobly/enrichment/worker.py - Enrichment Queue Worker → Gemini: classifies jobs
README.md - Enrichment Queue Worker → Job Enrichments: writes results
README.md - Daily Pipeline → Daily Snapshots: builds snapshots
backend/jobly/commands/pipeline.py - Daily Snapshots → Company Snapshots: writes snapshots
README.md - Intelligence Routes → Intelligence Queries: queries intelligence
backend/jobly/api/routes/companies.py - Intelligence Routes → Trend Queries: queries trends
backend/jobly/api/routes/companies.py - FastAPI Application → Intelligence Routes: registers routes
backend/jobly/api/main.py - FastAPI Application → Legacy Jobs API: registers routes
backend/jobly/api/main.py - Job Seeker → Intelligence Pages: browses intelligence
README.md - Job Seeker → Job Board: searches jobs
README.md - Intelligence Pages → FastAPI Application: requests data
README.md - Job Board → Jobs API Routes: loads listings
frontend/components/JobsPage.tsx - Jobs API Routes → Legacy Jobs API: forwards requests
README.md