# praneetsahoo/fffff architecture

> Architecture diagram of the GitHub repository praneetsahoo/fffff, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-05). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/praneetsahoo/fffff
- Repository: https://github.com/praneetsahoo/fffff

## Overview

OpsIntel accepts operational CSV uploads, processes them asynchronously into cleaned records and quality results, and exposes those results through dashboard, records, and quality views. The diagram follows the documented upload workflow and sampled caller relationships. Some UI-to-endpoint details and unsampled route implementations are not shown, so those links are kept at the documented REST boundary.

Main entry points: [`app/static/js/api.js`](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/api.js) (API client), [`app/services/ingest.py`](https://github.com/praneetsahoo/fffff/blob/main/app/services/ingest.py) (Upload workflow), [`app/static/js/app.js`](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/app.js) (App bootstrap), [`app/static/js/pages/upload.js`](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/upload.js) (Upload view)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_experience["Web experience"]
  node_web["Web pages<br/>[web.py]"]
  node_appjs["App bootstrap<br/>[app.js]"]
  node_api_js["API client<br/>[api.js]"]
  node_upload_ui["Upload view<br/>[upload.js]"]
  node_dashboard_ui["Dashboard view<br/>[dashboard.js]"]
  node_records_ui["Records view<br/>[records.js]"]
  node_quality_ui["Quality view<br/>[quality.js]"]
  node_charts["SVG charts<br/>[charts.js]"]
  node_motion["Motion effects<br/>[motion.js]"]
  node_ui_helpers["UI helpers<br/>[ui.js]"]
end

subgraph group_api["API and orchestration"]
  node_upload_routes["Upload routes<br/>[uploads.py]"]
  node_dashboard_routes["Dashboard routes<br/>[dashboard.py]"]
  node_records_routes["Records routes<br/>[records.py]"]
  node_job_worker["Background jobs<br/>[jobs.py]"]
end

subgraph group_processing["Ingestion and processing"]
  node_ingest["Upload workflow<br/>[ingest.py]"]
  node_profile["Dataset contract<br/>[profile.py]"]
  node_csv_reader["CSV reader<br/>[reader.py]"]
  node_pipeline["Clean and derive<br/>[pipeline.py]"]
  node_cleaners["Field cleaners<br/>[cleaners.py]"]
end

subgraph group_data["Persistence and analytics"]
  node_storage["Object storage adapter<br/>[storage.py]"]
  node_s3[("S3 objects")]
  node_upload_repo["Upload data access<br/>[uploads.py]"]
  node_analytics_repo["Analytics queries<br/>[analytics.py]"]
  node_insights["Automatic insights<br/>[insights.py]"]
  node_db[("SQL database")]
end

node_browser(("Browser user"))

node_browser -->|"opens views"| node_web
node_appjs -->|"uses"| node_api_js
node_appjs -->|"loads"| node_upload_ui
node_appjs -->|"loads"| node_dashboard_ui
node_appjs -->|"loads"| node_records_ui
node_appjs -->|"loads"| node_quality_ui
node_dashboard_ui -->|"requests data"| node_api_js
node_records_ui -->|"requests data"| node_api_js
node_quality_ui -->|"requests data"| node_api_js
node_upload_ui -->|"submits uploads"| node_api_js
node_dashboard_ui -->|"renders charts"| node_charts
node_quality_ui -->|"renders charts"| node_charts
node_upload_ui -->|"renders progress"| node_charts
node_dashboard_ui -->|"uses"| node_ui_helpers
node_upload_ui -->|"uses"| node_ui_helpers
node_records_ui -->|"uses"| node_motion
node_quality_ui -->|"uses"| node_motion
node_api_js -->|"calls REST API"| node_upload_routes
node_api_js -->|"calls REST API"| node_dashboard_routes
node_api_js -->|"calls REST API"| node_records_routes
node_upload_routes -->|"accepts and retries"| node_ingest
node_upload_routes -->|"enqueues"| node_job_worker
node_job_worker -->|"processes jobs"| node_ingest
node_job_worker -->|"resumes pending jobs"| node_upload_repo
node_ingest -->|"loads contract"| node_profile
node_ingest -->|"reads and writes files"| node_storage
node_ingest -->|"runs pipeline"| node_pipeline
node_ingest -->|"persists results"| node_upload_repo
node_pipeline -->|"parses input"| node_csv_reader
node_pipeline -->|"applies rules"| node_profile
node_pipeline -->|"cleans fields"| node_cleaners
node_storage -->|"stores objects"| node_s3
node_upload_repo -->|"reads and writes"| node_db
node_analytics_repo -->|"queries"| node_db
node_dashboard_routes -->|"loads aggregates"| node_analytics_repo
node_dashboard_routes -->|"builds insights"| node_insights
node_records_routes -->|"queries records"| node_analytics_repo
node_analytics_repo -->|"returns query results"| node_db

click node_web "https://github.com/praneetsahoo/fffff/blob/main/app/routers/web.py"
click node_appjs "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/app.js"
click node_api_js "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/api.js"
click node_upload_ui "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/upload.js"
click node_dashboard_ui "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/dashboard.js"
click node_records_ui "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/records.js"
click node_quality_ui "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/quality.js"
click node_charts "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/charts.js"
click node_motion "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/motion.js"
click node_ui_helpers "https://github.com/praneetsahoo/fffff/blob/main/app/static/js/ui.js"
click node_upload_routes "https://github.com/praneetsahoo/fffff/blob/main/app/routers/uploads.py"
click node_dashboard_routes "https://github.com/praneetsahoo/fffff/blob/main/app/routers/dashboard.py"
click node_records_routes "https://github.com/praneetsahoo/fffff/blob/main/app/routers/records.py"
click node_job_worker "https://github.com/praneetsahoo/fffff/blob/main/app/services/jobs.py"
click node_ingest "https://github.com/praneetsahoo/fffff/blob/main/app/services/ingest.py"
click node_profile "https://github.com/praneetsahoo/fffff/blob/main/app/profile.py"
click node_csv_reader "https://github.com/praneetsahoo/fffff/blob/main/app/pipeline/reader.py"
click node_pipeline "https://github.com/praneetsahoo/fffff/blob/main/app/pipeline/pipeline.py"
click node_cleaners "https://github.com/praneetsahoo/fffff/blob/main/app/pipeline/cleaners.py"
click node_storage "https://github.com/praneetsahoo/fffff/blob/main/app/storage.py"
click node_upload_repo "https://github.com/praneetsahoo/fffff/blob/main/app/repositories/uploads.py"
click node_analytics_repo "https://github.com/praneetsahoo/fffff/blob/main/app/repositories/analytics.py"
click node_insights "https://github.com/praneetsahoo/fffff/blob/main/app/services/insights.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_web,node_appjs,node_api_js,node_upload_ui,node_dashboard_ui,node_records_ui,node_quality_ui,node_charts,node_motion,node_ui_helpers,node_browser toneBlue
class node_upload_routes,node_dashboard_routes,node_records_routes,node_job_worker toneAmber
class node_ingest,node_profile,node_csv_reader,node_pipeline,node_cleaners toneMint
class node_storage,node_s3,node_upload_repo,node_analytics_repo,node_insights,node_db toneRose
```

## Components

### Web experience

- [Web pages](https://github.com/praneetsahoo/fffff/blob/main/app/routers/web.py): `app/routers/web.py`
- [App bootstrap](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/app.js): `app/static/js/app.js`
- [API client](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/api.js): `app/static/js/api.js`
- [Upload view](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/upload.js): `app/static/js/pages/upload.js`
- [Dashboard view](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/dashboard.js): `app/static/js/pages/dashboard.js`
- [Records view](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/records.js): `app/static/js/pages/records.js`
- [Quality view](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/pages/quality.js): `app/static/js/pages/quality.js`
- [SVG charts](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/charts.js): `app/static/js/charts.js`
- [Motion effects](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/motion.js): `app/static/js/motion.js`
- [UI helpers](https://github.com/praneetsahoo/fffff/blob/main/app/static/js/ui.js): `app/static/js/ui.js`

### API and orchestration

- [Upload routes](https://github.com/praneetsahoo/fffff/blob/main/app/routers/uploads.py): `app/routers/uploads.py`
- [Dashboard routes](https://github.com/praneetsahoo/fffff/blob/main/app/routers/dashboard.py): `app/routers/dashboard.py`
- [Records routes](https://github.com/praneetsahoo/fffff/blob/main/app/routers/records.py): `app/routers/records.py`
- [Background jobs](https://github.com/praneetsahoo/fffff/blob/main/app/services/jobs.py): `app/services/jobs.py`

### Ingestion and processing

- [Upload workflow](https://github.com/praneetsahoo/fffff/blob/main/app/services/ingest.py): `app/services/ingest.py`
- [Dataset contract](https://github.com/praneetsahoo/fffff/blob/main/app/profile.py): `app/profile.py`
- [CSV reader](https://github.com/praneetsahoo/fffff/blob/main/app/pipeline/reader.py): `app/pipeline/reader.py`
- [Clean and derive](https://github.com/praneetsahoo/fffff/blob/main/app/pipeline/pipeline.py): `app/pipeline/pipeline.py`
- [Field cleaners](https://github.com/praneetsahoo/fffff/blob/main/app/pipeline/cleaners.py): `app/pipeline/cleaners.py`

### Persistence and analytics

- [Object storage adapter](https://github.com/praneetsahoo/fffff/blob/main/app/storage.py): `app/storage.py`
- **S3 objects**
- [Upload data access](https://github.com/praneetsahoo/fffff/blob/main/app/repositories/uploads.py): `app/repositories/uploads.py`
- [Analytics queries](https://github.com/praneetsahoo/fffff/blob/main/app/repositories/analytics.py): `app/repositories/analytics.py`
- [Automatic insights](https://github.com/praneetsahoo/fffff/blob/main/app/services/insights.py): `app/services/insights.py`
- **SQL database**

### Other components

- **Browser user**

## Connections

- Browser user → Web pages: opens views (evidence: `README.md`)
- App bootstrap → API client: uses (evidence: `app/static/js/app.js`)
- App bootstrap → Upload view: loads (evidence: `app/static/js/app.js`)
- App bootstrap → Dashboard view: loads (evidence: `app/static/js/app.js`)
- App bootstrap → Records view: loads (evidence: `app/static/js/app.js`)
- App bootstrap → Quality view: loads (evidence: `app/static/js/app.js`)
- Dashboard view → API client: requests data (evidence: `app/static/js/pages/dashboard.js`)
- Records view → API client: requests data (evidence: `app/static/js/pages/records.js`)
- Quality view → API client: requests data (evidence: `app/static/js/pages/quality.js`)
- Upload view → API client: submits uploads (evidence: `app/static/js/pages/upload.js`)
- Dashboard view → SVG charts: renders charts (evidence: `app/static/js/pages/dashboard.js`)
- Quality view → SVG charts: renders charts (evidence: `app/static/js/pages/quality.js`)
- Upload view → SVG charts: renders progress (evidence: `app/static/js/pages/upload.js`)
- Dashboard view → UI helpers: uses (evidence: `app/static/js/pages/dashboard.js`)
- Upload view → UI helpers: uses (evidence: `app/static/js/pages/upload.js`)
- Records view → Motion effects: uses (evidence: `app/static/js/pages/records.js`)
- Quality view → Motion effects: uses (evidence: `app/static/js/pages/quality.js`)
- API client → Upload routes: calls REST API (evidence: `README.md`)
- API client → Dashboard routes: calls REST API (evidence: `README.md`)
- API client → Records routes: calls REST API (evidence: `README.md`)
- Upload routes → Upload workflow: accepts and retries (evidence: `app/routers/uploads.py`)
- Upload routes → Background jobs: enqueues (evidence: `app/routers/uploads.py`)
- Background jobs → Upload workflow: processes jobs (evidence: `app/services/jobs.py`)
- Background jobs → Upload data access: resumes pending jobs (evidence: `app/services/jobs.py`)
- Upload workflow → Dataset contract: loads contract (evidence: `app/services/ingest.py`)
- Upload workflow → Object storage adapter: reads and writes files (evidence: `app/services/ingest.py`)
- Upload workflow → Clean and derive: runs pipeline (evidence: `app/services/ingest.py`)
- Upload workflow → Upload data access: persists results (evidence: `app/services/ingest.py`)
- Clean and derive → CSV reader: parses input (evidence: `app/pipeline/pipeline.py`)
- Clean and derive → Dataset contract: applies rules (evidence: `app/pipeline/pipeline.py`)
- Clean and derive → Field cleaners: cleans fields (evidence: `app/pipeline/pipeline.py`)
- Object storage adapter → S3 objects: stores objects (evidence: `README.md`)
- Upload data access → SQL database: reads and writes (evidence: `README.md`)
- Analytics queries → SQL database: queries (evidence: `README.md`)
- Dashboard routes → Analytics queries: loads aggregates (evidence: `app/routers/dashboard.py`)
- Dashboard routes → Automatic insights: builds insights (evidence: `app/routers/dashboard.py`)
- Records routes → Analytics queries: queries records (evidence: `app/routers/records.py`)
- Analytics queries → SQL database: returns query results (evidence: `app/repositories/analytics.py`)
