How rose-ember-forge/swedish-data-skill-trends works
SkillTrends analyzes Swedish Arbetsförmedlingen job ads and presents role and skill trends through a Streamlit dashboard, static charts, and a Power BI report. The main workflow downloads and filters ads, classifies roles, extracts skills, removes reposts, aggregates results, then prepares outputs for analysis and visualization. The README documents the SQL and Power BI stages; sampled source confirms key runtime calls and data reads. The notebook and report internals are represented from documented capabilities and tree paths, not inspected source.
Main entry points: build.py Build ads · powerbi_export.py Power BI export · ingest.py Ingest and filter · streamlit_app.py Streamlit dashboard
Components 17
Ad collection
- Ingest and filter
src/skilltrends/ingest.py
Analysis pipeline
- Build ads
src/skilltrends/build.py - Role classifier
src/skilltrends/roles.py - Skill matcher
src/skilltrends/skills.py - SQL aggregates
sql - Power BI export
src/skilltrends/powerbi_export.py
Data outputs
- Processed ads
data/processed/ads.parquet - Aggregate tables
data/processed - Market counts
data/processed/all_ads_monthly.csv - Power BI tables
data/powerbi
Interactive analysis
- Streamlit dashboard
app/streamlit_app.py - Notebook analysis
notebooks/analysis.ipynb
Reports
- Static charts
src/skilltrends/figures.py - Power BI model
powerbi/SkillTrends.SemanticModel - Power BI report
powerbi/SkillTrends.Report
Other components
- Analyst
- JobTech ads
Connections 19
- JobTech ads → Ingest and filter: provides ads
src/skilltrends/ingest.py - Ingest and filter → Build ads: filtered candidates
README.md - Build ads → Role classifier: classifies headlines
src/skilltrends/build.py - Build ads → Skill matcher: extracts skills
src/skilltrends/build.py - Build ads → Processed ads: writes ads
src/skilltrends/build.py - Ingest and filter → Market counts: counts market ads
src/skilltrends/ingest.py - Build ads → SQL aggregates: runs queries
src/skilltrends/build.py - SQL aggregates → Aggregate tables: writes aggregates
README.md - Build ads → Power BI export: runs export
src/skilltrends/build.py - Power BI export → Processed ads: reads ads
src/skilltrends/powerbi_export.py - Power BI export → Skill matcher: reads taxonomy
src/skilltrends/powerbi_export.py - Power BI export → Power BI tables: writes tables
src/skilltrends/powerbi_export.py - Analyst → Streamlit dashboard: filters trends
README.md - Streamlit dashboard → Processed ads: queries ads
app/streamlit_app.py - Streamlit dashboard → Market counts: reads denominator
app/streamlit_app.py - Notebook analysis → Aggregate tables: analyzes tables
README.md - Static charts → Aggregate tables: reads aggregates
src/skilltrends/figures.py - Power BI model → Power BI tables: loads tables
README.md - Power BI report → Power BI model: uses model
README.md