# ambersub/minor-project architecture

> Architecture diagram of the GitHub repository ambersub/minor-project, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-05). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/ambersub/minor-project
- Repository: https://github.com/ambersub/minor-project

## Overview

ChunkFlow is a Python-facing CSV row utility and parallel chunk-processing library backed by a C++/OpenMP core. The main usage path is a Python caller invoking the CSV facade for parsing, arithmetic, or filtering; an optional path serializes records in ChunkProcessor, delegates chunk work to the core, and reads results or status from SQLite. The excerpts establish the public bindings and delegation, but do not expose the full chunk persistence implementation, so storage links are limited to the core’s stated responsibilities.

Main entry points: [`chunkflow/chunking.py`](https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py) (ChunkProcessor), [`src/chunkflow_core.cpp`](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp) (CSV core), [`chunkflow/__init__.py`](https://github.com/ambersub/minor-project/blob/main/chunkflow/__init__.py) (Public API), [`chunkflow/csv_math.py`](https://github.com/ambersub/minor-project/blob/main/chunkflow/csv_math.py) (CSV facade)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_api["Python API"]
  node_public_api["Public API<br/>[__init__.py]"]
  node_csv_facade["CSV facade<br/>[csv_math.py]"]
  node_chunk_processor["ChunkProcessor<br/>[chunking.py]"]
end

subgraph group_csv["CSV Operations"]
  node_csv_core["CSV core<br/>[chunkflow_core.cpp]"]
  node_csv_parse["Row parsing<br/>[chunkflow_core.cpp]"]
  node_row_arithmetic["Row arithmetic<br/>[chunkflow_core.cpp]"]
  node_batch_arithmetic["Batch arithmetic<br/>[chunkflow_core.cpp]"]
  node_row_filters["Row filtering<br/>[chunkflow_core.cpp]"]
end

subgraph group_chunk["Chunk Processing"]
  node_chunk_engine["Chunk engine<br/>[chunkflow_core.cpp]"]
  node_transform_callback["Transform callback<br/>[chunking.py]"]
end

subgraph group_state["Run State"]
  node_sqlite_store[("SQLite results<br/>[chunking.py]")]
  node_run_status["Run summary<br/>[chunking.py]"]
  node_log_file["Run log<br/>[chunkflow_core.cpp]"]
end

node_caller(("Python caller"))

node_caller -->|"calls"| node_public_api
node_public_api -->|"imports"| node_csv_facade
node_csv_facade -->|"delegates"| node_csv_core
node_csv_core -->|"provides parsing"| node_csv_parse
node_csv_core -->|"provides operations"| node_row_arithmetic
node_csv_core -->|"provides operations"| node_batch_arithmetic
node_csv_core -->|"provides filters"| node_row_filters
node_caller -.->|"uses optionally"| node_chunk_processor
node_chunk_processor -->|"calls process"| node_chunk_engine
node_chunk_engine -.->|"invokes callback"| node_transform_callback
node_chunk_processor -->|"reads results"| node_sqlite_store
node_chunk_processor -->|"reads status"| node_sqlite_store
node_chunk_processor -->|"returns summary"| node_run_status
node_chunk_engine -.->|"writes results"| node_sqlite_store
node_chunk_engine -.->|"writes log"| node_log_file

click node_public_api "https://github.com/ambersub/minor-project/blob/main/chunkflow/__init__.py"
click node_csv_facade "https://github.com/ambersub/minor-project/blob/main/chunkflow/csv_math.py"
click node_chunk_processor "https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py"
click node_csv_core "https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp"
click node_csv_parse "https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp"
click node_row_arithmetic "https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp"
click node_batch_arithmetic "https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp"
click node_row_filters "https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp"
click node_chunk_engine "https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp"
click node_transform_callback "https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py"
click node_sqlite_store "https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py"
click node_run_status "https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py"
click node_log_file "https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_public_api,node_csv_facade,node_chunk_processor toneBlue
class node_csv_core,node_csv_parse,node_row_arithmetic,node_batch_arithmetic,node_row_filters toneAmber
class node_chunk_engine,node_transform_callback toneMint
class node_sqlite_store,node_run_status,node_log_file toneRose
class node_caller toneIndigo
```

## Components

### Python API

- [Public API](https://github.com/ambersub/minor-project/blob/main/chunkflow/__init__.py): `chunkflow/__init__.py`
- [CSV facade](https://github.com/ambersub/minor-project/blob/main/chunkflow/csv_math.py): `chunkflow/csv_math.py`
- [ChunkProcessor](https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py): `chunkflow/chunking.py`

### CSV Operations

- [CSV core](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp): `src/chunkflow_core.cpp`
- [Row parsing](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp): `src/chunkflow_core.cpp`
- [Row arithmetic](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp): `src/chunkflow_core.cpp`
- [Batch arithmetic](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp): `src/chunkflow_core.cpp`
- [Row filtering](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp): `src/chunkflow_core.cpp`

### Chunk Processing

- [Chunk engine](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp): `src/chunkflow_core.cpp`
- [Transform callback](https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py): `chunkflow/chunking.py`

### Run State

- [SQLite results](https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py): `chunkflow/chunking.py`
- [Run summary](https://github.com/ambersub/minor-project/blob/main/chunkflow/chunking.py): `chunkflow/chunking.py`
- [Run log](https://github.com/ambersub/minor-project/blob/main/src/chunkflow_core.cpp): `src/chunkflow_core.cpp`

### Other components

- **Python caller**

## Connections

- Python caller → Public API: calls
- Public API → CSV facade: imports (evidence: `chunkflow/__init__.py`)
- CSV facade → CSV core: delegates (evidence: `chunkflow/csv_math.py`)
- CSV core → Row parsing: provides parsing (evidence: `src/chunkflow_core.cpp`)
- CSV core → Row arithmetic: provides operations (evidence: `src/chunkflow_core.cpp`)
- CSV core → Batch arithmetic: provides operations (evidence: `src/chunkflow_core.cpp`)
- CSV core → Row filtering: provides filters (evidence: `src/chunkflow_core.cpp`)
- Python caller → ChunkProcessor: uses optionally
- ChunkProcessor → Chunk engine: calls process (evidence: `chunkflow/chunking.py`)
- Chunk engine → Transform callback: invokes callback
- ChunkProcessor → SQLite results: reads results (evidence: `chunkflow/chunking.py`)
- ChunkProcessor → SQLite results: reads status (evidence: `chunkflow/chunking.py`)
- ChunkProcessor → Run summary: returns summary (evidence: `chunkflow/chunking.py`)
- Chunk engine → SQLite results: writes results
- Chunk engine → Run log: writes log (evidence: `src/chunkflow_core.cpp`)
