# rose-ember-forge/swedish-data-skill-trends architecture

> Architecture diagram of the GitHub repository rose-ember-forge/swedish-data-skill-trends, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-05). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/rose-ember-forge/swedish-data-skill-trends
- Repository: https://github.com/rose-ember-forge/swedish-data-skill-trends

## Overview

SkillTrends analyzes Swedish Arbetsförmedlingen job ads and presents role and skill trends through a Streamlit dashboard, static charts, and a Power BI report. The main workflow downloads and filters ads, classifies roles, extracts skills, removes reposts, aggregates results, then prepares outputs for analysis and visualization. The README documents the SQL and Power BI stages; sampled source confirms key runtime calls and data reads. The notebook and report internals are represented from documented capabilities and tree paths, not inspected source.

Main entry points: [`src/skilltrends/build.py`](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/build.py) (Build ads), [`src/skilltrends/powerbi_export.py`](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/powerbi_export.py) (Power BI export), [`src/skilltrends/ingest.py`](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/ingest.py) (Ingest and filter), [`app/streamlit_app.py`](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/app/streamlit_app.py) (Streamlit dashboard)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_collection["Ad collection"]
  node_ingest["Ingest and filter<br/>[ingest.py]"]
end

subgraph group_processing["Analysis pipeline"]
  node_build["Build ads<br/>[build.py]"]
  node_roles["Role classifier<br/>[roles.py]"]
  node_skills["Skill matcher<br/>[skills.py]"]
  node_sql["SQL aggregates"]
  node_powerbiexport["Power BI export<br/>[powerbi_export.py]"]
end

subgraph group_outputs["Data outputs"]
  node_adsdata[("Processed ads<br/>[ads.parquet]")]
  node_aggregates[("Aggregate tables")]
  node_marketdata[("Market counts")]
  node_pbidata[("Power BI tables")]
end

subgraph group_exploration["Interactive analysis"]
  node_dashboard["Streamlit dashboard<br/>[streamlit_app.py]"]
  node_notebook["Notebook analysis<br/>[analysis.ipynb]"]
end

subgraph group_reporting["Reports"]
  node_figures["Static charts<br/>[figures.py]"]
  node_powerbimodel["Power BI model"]
  node_powerbireport["Power BI report<br/>[SkillTrends.Report]"]
end

node_jobseeker(("Analyst"))
node_jobtech["JobTech ads"]

node_jobtech -->|"provides ads"| node_ingest
node_ingest -->|"filtered candidates"| node_build
node_build -->|"classifies headlines"| node_roles
node_build -->|"extracts skills"| node_skills
node_build -->|"writes ads"| node_adsdata
node_ingest -->|"counts market ads"| node_marketdata
node_build -->|"runs queries"| node_sql
node_sql -->|"writes aggregates"| node_aggregates
node_build -->|"runs export"| node_powerbiexport
node_powerbiexport -->|"reads ads"| node_adsdata
node_powerbiexport -->|"reads taxonomy"| node_skills
node_powerbiexport -->|"writes tables"| node_pbidata
node_jobseeker -->|"filters trends"| node_dashboard
node_dashboard -->|"queries ads"| node_adsdata
node_dashboard -->|"reads denominator"| node_marketdata
node_notebook -->|"analyzes tables"| node_aggregates
node_figures -->|"reads aggregates"| node_aggregates
node_powerbimodel -->|"loads tables"| node_pbidata
node_powerbireport -->|"uses model"| node_powerbimodel

click node_ingest "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/ingest.py"
click node_build "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/build.py"
click node_roles "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/roles.py"
click node_skills "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/skills.py"
click node_sql "https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/sql"
click node_adsdata "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/data/processed/ads.parquet"
click node_aggregates "https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/data/processed"
click node_marketdata "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/data/processed/all_ads_monthly.csv"
click node_powerbiexport "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/powerbi_export.py"
click node_pbidata "https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/data/powerbi"
click node_dashboard "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/app/streamlit_app.py"
click node_notebook "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/notebooks/analysis.ipynb"
click node_figures "https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/figures.py"
click node_powerbimodel "https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/powerbi/SkillTrends.SemanticModel"
click node_powerbireport "https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/powerbi/SkillTrends.Report"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_ingest toneBlue
class node_build,node_roles,node_skills,node_sql,node_powerbiexport toneAmber
class node_adsdata,node_aggregates,node_marketdata,node_pbidata toneMint
class node_dashboard,node_notebook toneRose
class node_figures,node_powerbimodel,node_powerbireport,node_jobseeker,node_jobtech toneIndigo
```

## Components

### Ad collection

- [Ingest and filter](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/ingest.py): `src/skilltrends/ingest.py`

### Analysis pipeline

- [Build ads](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/build.py): `src/skilltrends/build.py`
- [Role classifier](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/roles.py): `src/skilltrends/roles.py`
- [Skill matcher](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/skills.py): `src/skilltrends/skills.py`
- [SQL aggregates](https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/sql): `sql`
- [Power BI export](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/powerbi_export.py): `src/skilltrends/powerbi_export.py`

### Data outputs

- [Processed ads](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/data/processed/ads.parquet): `data/processed/ads.parquet`
- [Aggregate tables](https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/data/processed): `data/processed`
- [Market counts](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/data/processed/all_ads_monthly.csv): `data/processed/all_ads_monthly.csv`
- [Power BI tables](https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/data/powerbi): `data/powerbi`

### Interactive analysis

- [Streamlit dashboard](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/app/streamlit_app.py): `app/streamlit_app.py`
- [Notebook analysis](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/notebooks/analysis.ipynb): `notebooks/analysis.ipynb`

### Reports

- [Static charts](https://github.com/rose-ember-forge/swedish-data-skill-trends/blob/main/src/skilltrends/figures.py): `src/skilltrends/figures.py`
- [Power BI model](https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/powerbi/SkillTrends.SemanticModel): `powerbi/SkillTrends.SemanticModel`
- [Power BI report](https://github.com/rose-ember-forge/swedish-data-skill-trends/tree/main/powerbi/SkillTrends.Report): `powerbi/SkillTrends.Report`

### Other components

- **Analyst**
- **JobTech ads**

## Connections

- JobTech ads → Ingest and filter: provides ads (evidence: `src/skilltrends/ingest.py`)
- Ingest and filter → Build ads: filtered candidates (evidence: `README.md`)
- Build ads → Role classifier: classifies headlines (evidence: `src/skilltrends/build.py`)
- Build ads → Skill matcher: extracts skills (evidence: `src/skilltrends/build.py`)
- Build ads → Processed ads: writes ads (evidence: `src/skilltrends/build.py`)
- Ingest and filter → Market counts: counts market ads (evidence: `src/skilltrends/ingest.py`)
- Build ads → SQL aggregates: runs queries (evidence: `src/skilltrends/build.py`)
- SQL aggregates → Aggregate tables: writes aggregates (evidence: `README.md`)
- Build ads → Power BI export: runs export (evidence: `src/skilltrends/build.py`)
- Power BI export → Processed ads: reads ads (evidence: `src/skilltrends/powerbi_export.py`)
- Power BI export → Skill matcher: reads taxonomy (evidence: `src/skilltrends/powerbi_export.py`)
- Power BI export → Power BI tables: writes tables (evidence: `src/skilltrends/powerbi_export.py`)
- Analyst → Streamlit dashboard: filters trends (evidence: `README.md`)
- Streamlit dashboard → Processed ads: queries ads (evidence: `app/streamlit_app.py`)
- Streamlit dashboard → Market counts: reads denominator (evidence: `app/streamlit_app.py`)
- Notebook analysis → Aggregate tables: analyzes tables (evidence: `README.md`)
- Static charts → Aggregate tables: reads aggregates (evidence: `src/skilltrends/figures.py`)
- Power BI model → Power BI tables: loads tables (evidence: `README.md`)
- Power BI report → Power BI model: uses model (evidence: `README.md`)
