# munibashami07-oss/jobstack-through-python architecture

> Architecture diagram of the GitHub repository munibashami07-oss/jobstack-through-python, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-19). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/munibashami07-oss/jobstack-through-python
- Repository: https://github.com/munibashami07-oss/jobstack-through-python

## Overview

JobStack is an early-stage job-market decision-support project. Its implemented data workflow acquires postings, adapts and validates records, then supports transformation, database loading, and exploratory analysis. The React interface is a separate seeded-data experience, not a demonstrated consumer of the Python pipeline. README-described salary/fit prediction, skill-gap guidance, experiment tracking, and API capabilities are planned, not represented as implemented runtime components here; source evidence is limited to the supplied excerpts and index.

Main entry points: [`src/transformation`](https://github.com/munibashami07-oss/jobstack-through-python/tree/main/src/transformation) (Data transformation), [`src/eda/run_eda.py`](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/run_eda.py) (EDA runner), [`frontend/src/App.jsx`](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/App.jsx) (Current React application), [`src/database/load_database.py`](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/database/load_database.py) (Normalized job database)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_pipeline["Data foundation"]
  node_ingestion["Source ingestion"]
  node_adapters["Source adapters"]
  node_validation["Record validation<br/>[models.py]"]
  node_validation_runner["Validation runner<br/>[run_all.py]"]
  node_transforms["Data transformation"]
  node_clean["Cleaning and normalization<br/>[clean_data.py]"]
  node_dedupe["Duplicate detection"]
  node_skill_extract["Skill extraction<br/>[extract_skills.py]"]
  node_final_export["Final data export<br/>[export_final.py]"]
  node_database_loader["Database loading<br/>[load_database.py]"]
  node_job_db[("Normalized job database<br/>[load_database.py]")]
end

subgraph group_analysis["Market analysis"]
  node_eda_runner["EDA runner<br/>[run_eda.py]"]
  node_eda_data["Analysis data loading<br/>[load_data.py]"]
  node_skill_analysis["Skill demand and networks<br/>[skills.py]"]
  node_salary_analysis["Salary analysis<br/>[salary.py]"]
end

subgraph group_frontend["React experience"]
  node_root_app["Dashboard application<br/>[App.jsx]"]
  node_ui_app["Current React application<br/>[App.jsx]"]
  node_ui_views["Dashboard views<br/>[OtherViews.jsx]"]
  node_ui_skills["Skills intelligence view"]
  node_ui_jobs["Job exploration views<br/>[JobExplorer.jsx]"]
  node_ui_data["Seeded job dataset<br/>[jobstackData.js]"]
end

subgraph group_planned["Planned capabilities"]
  node_planned_insights["Fit and skill-gap insights"]
  node_planned_models["Modeling and experiment tracking"]
  node_planned_api["REST API"]
end

node_sources(("Job data sources"))
node_frontend_user(("Dashboard user"))

node_sources -->|"supplies postings"| node_ingestion
node_ingestion -->|"uses source adapters"| node_adapters
node_validation_runner -->|"adapts raw records"| node_adapters
node_validation_runner -->|"validates records"| node_validation
node_validation -->|"validated data"| node_transforms
node_transforms -->|"cleans and normalizes"| node_clean
node_transforms -->|"deduplicates"| node_dedupe
node_transforms -.->|"extracts skills"| node_skill_extract
node_transforms -.->|"exports final data"| node_final_export
node_transforms -->|"provides final data"| node_database_loader
node_database_loader -->|"writes records"| node_job_db
node_job_db -->|"supports analysis"| node_eda_runner
node_eda_runner -->|"loads analysis data"| node_eda_data
node_eda_runner -->|"runs skill analysis"| node_skill_analysis
node_eda_runner -->|"runs salary analysis"| node_salary_analysis
node_frontend_user -.->|"opens dashboard"| node_root_app
node_root_app -.->|"separate app entry"| node_ui_app
node_ui_app -->|"renders views"| node_ui_views
node_ui_app -->|"renders skills view"| node_ui_skills
node_ui_app -->|"renders explorer"| node_ui_jobs
node_ui_skills -->|"derives skill metrics"| node_ui_data
node_ui_jobs -->|"reads job data"| node_ui_data
node_ui_data -.->|"could inform"| node_planned_insights
node_job_db -.->|"planned modeling input"| node_planned_models
node_planned_models -.->|"planned serving"| node_planned_api

click node_ingestion "https://github.com/munibashami07-oss/jobstack-through-python/tree/main/src/ingestion"
click node_adapters "https://github.com/munibashami07-oss/jobstack-through-python/tree/main/src/ingestion"
click node_validation "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/validation/models.py"
click node_validation_runner "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/validation/run_all.py"
click node_transforms "https://github.com/munibashami07-oss/jobstack-through-python/tree/main/src/transformation"
click node_clean "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/clean_data.py"
click node_dedupe "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/detect_duplicates.py"
click node_skill_extract "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/extract_skills.py"
click node_final_export "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/export_final.py"
click node_database_loader "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/database/load_database.py"
click node_job_db "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/database/load_database.py"
click node_eda_runner "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/run_eda.py"
click node_eda_data "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/load_data.py"
click node_skill_analysis "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/skills.py"
click node_salary_analysis "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/salary.py"
click node_root_app "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/App.jsx"
click node_ui_app "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/App.jsx"
click node_ui_views "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/components/OtherViews.jsx"
click node_ui_skills "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/components/SkillsIntelligence.jsx"
click node_ui_jobs "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/components/JobExplorer.jsx"
click node_ui_data "https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/data/jobstackData.js"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_ingestion,node_adapters,node_validation,node_validation_runner,node_transforms,node_clean,node_dedupe,node_skill_extract,node_final_export,node_database_loader,node_job_db,node_frontend_user toneBlue
class node_eda_runner,node_eda_data,node_skill_analysis,node_salary_analysis toneAmber
class node_root_app,node_ui_app,node_ui_views,node_ui_skills,node_ui_jobs,node_ui_data toneMint
class node_planned_insights,node_planned_models,node_planned_api toneRose
class node_sources toneIndigo
```

## Components

### Data foundation

- [Source ingestion](https://github.com/munibashami07-oss/jobstack-through-python/tree/main/src/ingestion): `src/ingestion`
- [Source adapters](https://github.com/munibashami07-oss/jobstack-through-python/tree/main/src/ingestion): `src/ingestion`
- [Record validation](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/validation/models.py): `src/validation/models.py`
- [Validation runner](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/validation/run_all.py): `src/validation/run_all.py`
- [Data transformation](https://github.com/munibashami07-oss/jobstack-through-python/tree/main/src/transformation): `src/transformation`
- [Cleaning and normalization](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/clean_data.py): `src/transformation/clean_data.py`
- [Duplicate detection](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/detect_duplicates.py): `src/transformation/detect_duplicates.py`
- [Skill extraction](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/extract_skills.py): `src/transformation/extract_skills.py`
- [Final data export](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/transformation/export_final.py): `src/transformation/export_final.py`
- [Database loading](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/database/load_database.py): `src/database/load_database.py`
- [Normalized job database](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/database/load_database.py): `src/database/load_database.py`

### Market analysis

- [EDA runner](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/run_eda.py): `src/eda/run_eda.py`
- [Analysis data loading](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/load_data.py): `src/eda/load_data.py`
- [Skill demand and networks](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/skills.py): `src/eda/skills.py`
- [Salary analysis](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/src/eda/salary.py): `src/eda/salary.py`

### React experience

- [Dashboard application](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/App.jsx): `frontend/App.jsx`
- [Current React application](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/App.jsx): `frontend/src/App.jsx`
- [Dashboard views](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/components/OtherViews.jsx): `frontend/src/components/OtherViews.jsx`
- [Skills intelligence view](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/components/SkillsIntelligence.jsx): `frontend/src/components/SkillsIntelligence.jsx`
- [Job exploration views](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/components/JobExplorer.jsx): `frontend/src/components/JobExplorer.jsx`
- [Seeded job dataset](https://github.com/munibashami07-oss/jobstack-through-python/blob/main/frontend/src/data/jobstackData.js): `frontend/src/data/jobstackData.js`

### Planned capabilities

- **Fit and skill-gap insights**
- **Modeling and experiment tracking**
- **REST API**

### Other components

- **Job data sources**
- **Dashboard user**

## Connections

- Job data sources → Source ingestion: supplies postings (evidence: `README.md`)
- Source ingestion → Source adapters: uses source adapters (evidence: `src/validation/run_all.py`)
- Validation runner → Source adapters: adapts raw records (evidence: `src/validation/run_all.py`)
- Validation runner → Record validation: validates records (evidence: `src/validation/run_all.py`)
- Record validation → Data transformation: validated data (evidence: `README.md`)
- Data transformation → Cleaning and normalization: cleans and normalizes (evidence: `README.md`)
- Data transformation → Duplicate detection: deduplicates (evidence: `README.md`)
- Data transformation → Skill extraction: extracts skills
- Data transformation → Final data export: exports final data (evidence: `src/transformation/export_final.py`)
- Data transformation → Database loading: provides final data (evidence: `README.md`)
- Database loading → Normalized job database: writes records (evidence: `src/database/load_database.py`)
- Normalized job database → EDA runner: supports analysis (evidence: `README.md`)
- EDA runner → Analysis data loading: loads analysis data (evidence: `src/eda/run_eda.py`)
- EDA runner → Skill demand and networks: runs skill analysis (evidence: `src/eda/run_eda.py`)
- EDA runner → Salary analysis: runs salary analysis (evidence: `src/eda/run_eda.py`)
- Dashboard user → Dashboard application: opens dashboard
- Dashboard application → Current React application: separate app entry
- Current React application → Dashboard views: renders views (evidence: `frontend/src/App.jsx`)
- Current React application → Skills intelligence view: renders skills view (evidence: `frontend/src/App.jsx`)
- Current React application → Job exploration views: renders explorer (evidence: `frontend/src/App.jsx`)
- Skills intelligence view → Seeded job dataset: derives skill metrics (evidence: `frontend/src/components/SkillsIntelligence.jsx`)
- Job exploration views → Seeded job dataset: reads job data (evidence: `frontend/src/components/JobExplorer.jsx`)
- Seeded job dataset → Fit and skill-gap insights: could inform
- Normalized job database → Modeling and experiment tracking: planned modeling input (evidence: `README.md`)
- Modeling and experiment tracking → REST API: planned serving (evidence: `README.md`)
