# diego-uzc-j/analisis-de-datos-de-repositorio-universitario architecture

> Architecture diagram of the GitHub repository diego-uzc-j/analisis-de-datos-de-repositorio-universitario, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-19). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario
- Repository: https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario

## Overview

This repository provides a university-repository analytics dashboard backed by a CSV-to-Parquet ETL pipeline. The principal workflow is to prepare article records, load the processed data into Streamlit, apply interactive filters, and explore publication trends, collaboration, communities, keywords, authors, and filtered records. The README documents SQL-based DSpace extraction and scheduled automation; those deployment details are not mapped as runtime components. Some app-to-ETL wiring is not visible in the excerpts, so only documented or excerpt-supported relationships are shown.

Main entry points: [`app.py`](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py) (Streamlit dashboard), [`src/plot.py`](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/plot.py) (Plotly generators), [`src/etl.py`](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py) (ETL orchestrator), [`sql/consultas_articulos_dspace.sql`](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/sql/consultas_articulos_dspace.sql) (Article query)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_ingest["Data Preparation"]
  node_sqlquery["Article query"]
  node_rawcsv["Article CSV"]
  node_pipeline["ETL orchestrator<br/>[etl.py]"]
  node_extract["CSV extraction<br/>[etl.py]"]
  node_transform["Date cleaning<br/>[etl.py]"]
  node_load["Parquet loading<br/>[etl.py]"]
  node_parquet["Processed articles"]
end

subgraph group_dashboard["Dashboard"]
  node_dashboardapp["Streamlit dashboard<br/>[app.py]"]
  node_filters["Interactive filters<br/>[app.py]"]
  node_filteredtable["Filtered records<br/>[app.py]"]
end

subgraph group_analytics["Analytics"]
  node_temporal["Publication trends<br/>[app.py]"]
  node_coauthors["Coauthor analysis<br/>[app.py]"]
  node_communities["Community analysis<br/>[app.py]"]
  node_heatmap["Production heatmap<br/>[app.py]"]
  node_keywords["Top keywords<br/>[app.py]"]
  node_authors["Top authors<br/>[app.py]"]
  node_plots["Plotly generators<br/>[plot.py]"]
end

node_analyst(("Dashboard user"))
node_dspace[("DSpace repository")]

node_dspace -->|"queried by"| node_sqlquery
node_sqlquery -->|"produces source"| node_rawcsv
node_pipeline -->|"calls"| node_extract
node_extract -->|"reads"| node_rawcsv
node_pipeline -->|"calls"| node_transform
node_pipeline -->|"calls"| node_load
node_load -->|"writes"| node_parquet
node_analyst -->|"uses"| node_dashboardapp
node_parquet -->|"feeds"| node_dashboardapp
node_dashboardapp -->|"offers"| node_filters
node_dashboardapp -->|"renders"| node_filteredtable
node_dashboardapp -->|"shows"| node_temporal
node_dashboardapp -->|"shows"| node_coauthors
node_dashboardapp -->|"shows"| node_communities
node_dashboardapp -->|"shows"| node_heatmap
node_dashboardapp -->|"shows"| node_keywords
node_dashboardapp -->|"shows"| node_authors
node_dashboardapp -->|"calls"| node_plots
node_temporal -->|"renders with"| node_plots
node_coauthors -->|"renders with"| node_plots
node_communities -->|"renders with"| node_plots
node_heatmap -->|"renders with"| node_plots
node_keywords -->|"renders with"| node_plots
node_authors -->|"renders with"| node_plots

click node_sqlquery "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/sql/consultas_articulos_dspace.sql"
click node_rawcsv "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/data/articulos_comms_fac_y_rev.csv"
click node_pipeline "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py"
click node_extract "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py"
click node_transform "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py"
click node_load "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py"
click node_parquet "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/data/articulos_procesados.parquet"
click node_dashboardapp "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_filters "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_filteredtable "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_temporal "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_coauthors "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_communities "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_heatmap "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_keywords "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_authors "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py"
click node_plots "https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/plot.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_sqlquery,node_rawcsv,node_pipeline,node_extract,node_transform,node_load,node_parquet,node_analyst toneBlue
class node_dashboardapp,node_filters,node_filteredtable,node_dspace toneAmber
class node_temporal,node_coauthors,node_communities,node_heatmap,node_keywords,node_authors,node_plots toneMint
```

## Components

### Data Preparation

- [Article query](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/sql/consultas_articulos_dspace.sql): `sql/consultas_articulos_dspace.sql`
- [Article CSV](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/data/articulos_comms_fac_y_rev.csv): `data/articulos_comms_fac_y_rev.csv`
- [ETL orchestrator](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py): `src/etl.py`
- [CSV extraction](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py): `src/etl.py`
- [Date cleaning](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py): `src/etl.py`
- [Parquet loading](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/etl.py): `src/etl.py`
- [Processed articles](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/data/articulos_procesados.parquet): `data/articulos_procesados.parquet`

### Dashboard

- [Streamlit dashboard](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Interactive filters](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Filtered records](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`

### Analytics

- [Publication trends](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Coauthor analysis](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Community analysis](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Production heatmap](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Top keywords](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Top authors](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/app.py): `app.py`
- [Plotly generators](https://github.com/diego-uzc-j/analisis-de-datos-de-repositorio-universitario/blob/main/src/plot.py): `src/plot.py`

### Other components

- **Dashboard user**
- **DSpace repository**

## Connections

- DSpace repository → Article query: queried by (evidence: `README.md`)
- Article query → Article CSV: produces source (evidence: `README.md`)
- ETL orchestrator → CSV extraction: calls (evidence: `src/etl.py`)
- CSV extraction → Article CSV: reads (evidence: `src/etl.py`)
- ETL orchestrator → Date cleaning: calls (evidence: `src/etl.py`)
- ETL orchestrator → Parquet loading: calls (evidence: `src/etl.py`)
- Parquet loading → Processed articles: writes (evidence: `src/etl.py`)
- Dashboard user → Streamlit dashboard: uses (evidence: `README.md`)
- Processed articles → Streamlit dashboard: feeds (evidence: `README.md`)
- Streamlit dashboard → Interactive filters: offers (evidence: `app.py`)
- Streamlit dashboard → Filtered records: renders (evidence: `app.py`)
- Streamlit dashboard → Publication trends: shows (evidence: `app.py`)
- Streamlit dashboard → Coauthor analysis: shows (evidence: `app.py`)
- Streamlit dashboard → Community analysis: shows (evidence: `app.py`)
- Streamlit dashboard → Production heatmap: shows (evidence: `app.py`)
- Streamlit dashboard → Top keywords: shows (evidence: `app.py`)
- Streamlit dashboard → Top authors: shows (evidence: `app.py`)
- Streamlit dashboard → Plotly generators: calls (evidence: `app.py`)
- Publication trends → Plotly generators: renders with (evidence: `app.py`)
- Coauthor analysis → Plotly generators: renders with (evidence: `app.py`)
- Community analysis → Plotly generators: renders with (evidence: `app.py`)
- Production heatmap → Plotly generators: renders with (evidence: `app.py`)
- Top keywords → Plotly generators: renders with (evidence: `app.py`)
- Top authors → Plotly generators: renders with (evidence: `app.py`)
