How munibashami07-oss/jobstack-through-python works
JobStack is an early-stage job-market decision-support project. Its implemented data workflow acquires postings, adapts and validates records, then supports transformation, database loading, and exploratory analysis. The React interface is a separate seeded-data experience, not a demonstrated consumer of the Python pipeline. README-described salary/fit prediction, skill-gap guidance, experiment tracking, and API capabilities are planned, not represented as implemented runtime components here; source evidence is limited to the supplied excerpts and index.
Main entry points: transformation Data transformation · run_eda.py EDA runner · App.jsx Current React application · load_database.py Normalized job database
Components 26
Data foundation
- Source ingestion
src/ingestion - Source adapters
src/ingestion - Record validation
src/validation/models.py - Validation runner
src/validation/run_all.py - Data transformation
src/transformation - Cleaning and normalization
src/transformation/clean_data.py - Duplicate detection
src/transformation/detect_duplicates.py - Skill extraction
src/transformation/extract_skills.py - Final data export
src/transformation/export_final.py - Database loading
src/database/load_database.py - Normalized job database
src/database/load_database.py
Market analysis
- EDA runner
src/eda/run_eda.py - Analysis data loading
src/eda/load_data.py - Skill demand and networks
src/eda/skills.py - Salary analysis
src/eda/salary.py
React experience
- Dashboard application
frontend/App.jsx - Current React application
frontend/src/App.jsx - Dashboard views
frontend/src/components/OtherViews.jsx - Skills intelligence view
frontend/src/components/SkillsIntelligence.jsx - Job exploration views
frontend/src/components/JobExplorer.jsx - Seeded job dataset
frontend/src/data/jobstackData.js
Planned capabilities
- Fit and skill-gap insights
- Modeling and experiment tracking
- REST API
Other components
- Job data sources
- Dashboard user
Connections 25
- Job data sources → Source ingestion: supplies postings
README.md - Source ingestion → Source adapters: uses source adapters
src/validation/run_all.py - Validation runner → Source adapters: adapts raw records
src/validation/run_all.py - Validation runner → Record validation: validates records
src/validation/run_all.py - Record validation → Data transformation: validated data
README.md - Data transformation → Cleaning and normalization: cleans and normalizes
README.md - Data transformation → Duplicate detection: deduplicates
README.md - Data transformation → Skill extraction: extracts skills
- Data transformation → Final data export: exports final data
src/transformation/export_final.py - Data transformation → Database loading: provides final data
README.md - Database loading → Normalized job database: writes records
src/database/load_database.py - Normalized job database → EDA runner: supports analysis
README.md - EDA runner → Analysis data loading: loads analysis data
src/eda/run_eda.py - EDA runner → Skill demand and networks: runs skill analysis
src/eda/run_eda.py - EDA runner → Salary analysis: runs salary analysis
src/eda/run_eda.py - Dashboard user → Dashboard application: opens dashboard
- Dashboard application → Current React application: separate app entry
- Current React application → Dashboard views: renders views
frontend/src/App.jsx - Current React application → Skills intelligence view: renders skills view
frontend/src/App.jsx - Current React application → Job exploration views: renders explorer
frontend/src/App.jsx - Skills intelligence view → Seeded job dataset: derives skill metrics
frontend/src/components/SkillsIntelligence.jsx - Job exploration views → Seeded job dataset: reads job data
frontend/src/components/JobExplorer.jsx - Seeded job dataset → Fit and skill-gap insights: could inform
- Normalized job database → Modeling and experiment tracking: planned modeling input
README.md - Modeling and experiment tracking → REST API: planned serving
README.md