# jpowerj/dsan6000-hw04 architecture

> Architecture diagram of the GitHub repository jpowerj/dsan6000-hw04, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-30). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jpowerj/dsan6000-hw04
- Repository: https://github.com/jpowerj/dsan6000-hw04

## Overview

This is a small educational assignment repository, not a production application. Its core workflow is to inspect Parquet’s columnar encoding, then compare analysis approaches using ACLED event data, including a DuckDB query against S3. The README identifies the notebook as the main set of instructions; the Python scripts provide pandas and DuckDB exercise entry points, though the pandas analysis and plotting are still placeholders. The graph reflects documented notebook capabilities and sampled script behavior; notebook contents were not sampled.

Main entry points: [`DSAN6000_HW4.ipynb`](https://github.com/jpowerj/dsan6000-hw04/blob/main/DSAN6000_HW4.ipynb) (Parquet notebook), [`hw04-2-duckdb.py`](https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-2-duckdb.py) (DuckDB exercise), [`hw04-1-pandas.py`](https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-1-pandas.py) (Pandas exercise)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_learning["Assignment workflow"]
  node_notebook["Parquet notebook<br/>[DSAN6000_HW4.ipynb]"]
  node_parquet["ACLED Parquet"]
end

subgraph group_implementations["Python exercises"]
  node_pandas["Pandas exercise<br/>[hw04-1-pandas.py]"]
  node_duckdb["DuckDB exercise<br/>[hw04-2-duckdb.py]"]
  node_memory["Memory measurement<br/>[hw04-2-duckdb.py]"]
end

node_learner(("Learner"))
node_s3[("S3 dataset")]

node_learner -->|"follows instructions"| node_notebook
node_notebook -->|"examines encoding"| node_parquet
node_notebook -->|"queries remotely"| node_s3
node_learner -.->|"runs exercise"| node_pandas
node_learner -.->|"runs exercise"| node_duckdb
node_duckdb -->|"queries Parquet"| node_s3
node_duckdb -->|"measures usage"| node_memory
node_pandas -.->|"intended load"| node_parquet

click node_notebook "https://github.com/jpowerj/dsan6000-hw04/blob/main/DSAN6000_HW4.ipynb"
click node_pandas "https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-1-pandas.py"
click node_duckdb "https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-2-duckdb.py"
click node_memory "https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-2-duckdb.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_notebook,node_parquet toneBlue
class node_pandas,node_duckdb,node_memory,node_s3 toneAmber
class node_learner toneIndigo
```

## Components

### Assignment workflow

- [Parquet notebook](https://github.com/jpowerj/dsan6000-hw04/blob/main/DSAN6000_HW4.ipynb): `DSAN6000_HW4.ipynb`
- **ACLED Parquet**

### Python exercises

- [Pandas exercise](https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-1-pandas.py): `hw04-1-pandas.py`
- [DuckDB exercise](https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-2-duckdb.py): `hw04-2-duckdb.py`
- [Memory measurement](https://github.com/jpowerj/dsan6000-hw04/blob/main/hw04-2-duckdb.py): `hw04-2-duckdb.py`

### Other components

- **Learner**
- **S3 dataset**

## Connections

- Learner → Parquet notebook: follows instructions (evidence: `README.md`)
- Parquet notebook → ACLED Parquet: examines encoding (evidence: `README.md`)
- Parquet notebook → S3 dataset: queries remotely (evidence: `README.md`)
- Learner → Pandas exercise: runs exercise
- Learner → DuckDB exercise: runs exercise
- DuckDB exercise → S3 dataset: queries Parquet (evidence: `hw04-2-duckdb.py`)
- DuckDB exercise → Memory measurement: measures usage (evidence: `hw04-2-duckdb.py`)
- Pandas exercise → ACLED Parquet: intended load
