# diegosilva20/tcc-pipeline-openalex-databricks architecture

> Architecture diagram of the GitHub repository diegosilva20/tcc-pipeline-openalex-databricks, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-28). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/diegosilva20/tcc-pipeline-openalex-databricks
- Repository: https://github.com/diegosilva20/tcc-pipeline-openalex-databricks

## Overview

This repository appears to be a Databricks notebook pipeline for OpenAlex data: it includes sample exploration, bronze ingestion, separate silver transformations for authors and citations, and a gold transformation. The stage sequence and branches are inferred from notebook names; the README contains no further workflow details, and no source excerpts were available to confirm data transfers or execution wiring.

Main entry points: [`01_ingestao_bronze.ipynb`](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/01_ingestao_bronze.ipynb) (Bronze ingestion), [`02_transformacao_prata_autores.ipynb`](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/02_transformacao_prata_autores.ipynb) (Author transformation), [`02_transformacao_prata_citacoes.ipynb`](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/02_transformacao_prata_citacoes.ipynb) (Citation transformation), [`03_transformacao_ouro.ipynb`](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/03_transformacao_ouro.ipynb) (Gold transformation)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_exploration["Exploration"]
  node_sample["Sample exploration"]
end

subgraph group_bronze["Bronze ingestion"]
  node_ingest["Bronze ingestion"]
end

subgraph group_silver["Silver transformations"]
  node_authors["Author transformation"]
  node_citations["Citation transformation"]
end

subgraph group_gold["Gold transformation"]
  node_gold["Gold transformation"]
end

node_sample -->|"precedes"| node_ingest
node_ingest -->|"transforms to"| node_authors
node_ingest -->|"transforms to"| node_citations
node_authors -->|"transforms to"| node_gold
node_citations -->|"transforms to"| node_gold

click node_sample "https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/00_exploracao_amostra.ipynb"
click node_ingest "https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/01_ingestao_bronze.ipynb"
click node_authors "https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/02_transformacao_prata_autores.ipynb"
click node_citations "https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/02_transformacao_prata_citacoes.ipynb"
click node_gold "https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/03_transformacao_ouro.ipynb"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_sample toneBlue
class node_ingest toneAmber
class node_authors,node_citations toneMint
class node_gold toneRose
```

## Components

### Exploration

- [Sample exploration](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/00_exploracao_amostra.ipynb): `00_exploracao_amostra.ipynb`

### Bronze ingestion

- [Bronze ingestion](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/01_ingestao_bronze.ipynb): `01_ingestao_bronze.ipynb`

### Silver transformations

- [Author transformation](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/02_transformacao_prata_autores.ipynb): `02_transformacao_prata_autores.ipynb`
- [Citation transformation](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/02_transformacao_prata_citacoes.ipynb): `02_transformacao_prata_citacoes.ipynb`

### Gold transformation

- [Gold transformation](https://github.com/diegosilva20/tcc-pipeline-openalex-databricks/blob/main/03_transformacao_ouro.ipynb): `03_transformacao_ouro.ipynb`

## Connections

- Sample exploration → Bronze ingestion: precedes
- Bronze ingestion → Author transformation: transforms to
- Bronze ingestion → Citation transformation: transforms to
- Author transformation → Gold transformation: transforms to
- Citation transformation → Gold transformation: transforms to