# joogatechsoln/dataflow architecture

> Architecture diagram of the GitHub repository joogatechsoln/dataflow, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-01). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/joogatechsoln/dataflow
- Repository: https://github.com/joogatechsoln/dataflow

## Overview

DataFlow Suite is a browser-based analytics platform. Users sign in, create a project, and move through Define → Collect → Clean → Analyze → Visualize → Report; data import, browser SQL/Python, charts, and client-side exports support that workflow. The app also provides AI assistance, learning resources, plugins, licensing, and team collaboration with cloud sync and version history. Relationships are based on the supplied excerpts, SOURCE INDEX references, and README; unsampled internals are represented only where documented.

Main entry points: [`src/App.tsx`](https://github.com/joogatechsoln/dataflow/blob/main/src/App.tsx) (App shell and routing), [`src/pages/Pipeline/Pipeline.tsx`](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Pipeline.tsx) (Pipeline dispatcher), [`src/lib/pipelineData.ts`](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/pipelineData.ts) (Pipeline data services), [`src/pages/Pipeline/Report/Report.tsx`](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Report/Report.tsx) (Report and export)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_shell["App shell"]
  node_app["App shell and routing<br/>[App.tsx]"]
  node_sidebar["Navigation<br/>[Sidebar.tsx]"]
  node_topbar["Workspace actions<br/>[TopBar.tsx]"]
  node_notifications["Notification feed"]
end

subgraph group_pipeline["Analytics pipeline"]
  node_pipeline["Pipeline dispatcher<br/>[Pipeline.tsx]"]
  node_define["Define problem<br/>[Define.tsx]"]
  node_collect["Collect data<br/>[Collect.tsx]"]
  node_clean["Clean data<br/>[Clean.tsx]"]
  node_analyze["Analyze data<br/>[Analyze.tsx]"]
  node_visualize["Visualize data<br/>[Visualize.tsx]"]
  node_report["Report and export<br/>[Report.tsx]"]
end

subgraph group_data["Data and persistence"]
  node_pipeline_data["Pipeline data services<br/>[pipelineData.ts]"]
  node_duckdb["Browser SQL engine<br/>[duckdb.ts]"]
  node_file_import["File import<br/>[fileImport.ts]"]
  node_local_db[("IndexedDB storage<br/>[db.ts]")]
  node_project_store["Project state<br/>[projectStore.ts]"]
  node_dashboard["Project dashboard<br/>[Dashboard.tsx]"]
end

subgraph group_collab["Identity and teams"]
  node_authpage["Authentication"]
  node_authstore["Auth state<br/>[authStore.ts]"]
  node_supabase["Supabase services<br/>[supabase.ts]"]
  node_team["Team workspace<br/>[TeamWorkspace.tsx]"]
  node_cloud_sync["Cloud sync and history<br/>[useCloudSync.ts]"]
  node_team_store["Team state<br/>[teamStore.ts]"]
  node_admin["Admin dashboard<br/>[AdminDashboard.tsx]"]
end

subgraph group_extensions["Platform capabilities"]
  node_assistant["AI assistant<br/>[AIAssistant.tsx]"]
  node_ai_api["AI request client<br/>[api.ts]"]
  node_marketplace["Plugin marketplace"]
  node_plugin_registry["Plugin registry<br/>[registry.ts]"]
  node_plugin_loader["Plugin loader<br/>[loader.ts]"]
  node_plugin_store["Installed plugins<br/>[pluginStore.ts]"]
  node_learn["Learning hub<br/>[LearnHub.tsx]"]
  node_license["Plan and license state<br/>[licenseStore.ts]"]
  node_analytics["Usage analytics<br/>[analytics.ts]"]
end

node_user(("User"))

node_user -->|"uses"| node_app
node_app -->|"gates access"| node_authpage
node_authpage -->|"authenticates with"| node_supabase
node_authpage -->|"sets session"| node_authstore
node_app -->|"renders"| node_sidebar
node_app -->|"renders"| node_topbar
node_app -->|"routes to"| node_pipeline
node_app -->|"opens"| node_assistant
node_app -->|"routes to"| node_marketplace
node_app -->|"shows"| node_notifications
node_pipeline -->|"dispatches"| node_define
node_pipeline -->|"dispatches"| node_collect
node_pipeline -->|"dispatches"| node_clean
node_pipeline -->|"dispatches"| node_analyze
node_pipeline -->|"dispatches"| node_visualize
node_pipeline -->|"dispatches"| node_report
node_collect -.->|"imports files"| node_file_import
node_file_import -.->|"registers data"| node_duckdb
node_clean -->|"profiles data"| node_pipeline_data
node_visualize -->|"gets chart data"| node_pipeline_data
node_pipeline_data -->|"loads project files"| node_local_db
node_pipeline_data -->|"queries tables"| node_duckdb
node_report -->|"reads project state"| node_project_store
node_report -->|"uses data helpers"| node_pipeline_data
node_report -.->|"exports PDF/PPTX"| node_user
node_dashboard -.->|"manages projects"| node_project_store
node_assistant -->|"sends prompts"| node_ai_api
node_assistant -->|"reads pipeline context"| node_project_store
node_team -->|"syncs projects"| node_cloud_sync
node_team -->|"uses workspace state"| node_team_store
node_cloud_sync -->|"pushes and pulls"| node_supabase
node_cloud_sync -->|"updates projects"| node_project_store
node_cloud_sync -->|"updates sync state"| node_team_store
node_admin -->|"manages cloud records"| node_supabase
node_marketplace -->|"loads listings"| node_plugin_registry
node_marketplace -->|"installs plugins"| node_plugin_loader
node_marketplace -->|"tracks installed plugins"| node_plugin_store
node_topbar -.->|"shows plan status"| node_license
node_license -->|"records opted-in usage"| node_analytics

click node_app "https://github.com/joogatechsoln/dataflow/blob/main/src/App.tsx"
click node_sidebar "https://github.com/joogatechsoln/dataflow/blob/main/src/components/Sidebar/Sidebar.tsx"
click node_topbar "https://github.com/joogatechsoln/dataflow/blob/main/src/components/TopBar/TopBar.tsx"
click node_authpage "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Auth/SupabaseAuthPage.tsx"
click node_authstore "https://github.com/joogatechsoln/dataflow/blob/main/src/store/authStore.ts"
click node_supabase "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/supabase.ts"
click node_pipeline "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Pipeline.tsx"
click node_define "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Define/Define.tsx"
click node_collect "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Collect/Collect.tsx"
click node_clean "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Clean/Clean.tsx"
click node_analyze "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Analyze/Analyze.tsx"
click node_visualize "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Visualize/Visualize.tsx"
click node_report "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Report/Report.tsx"
click node_pipeline_data "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/pipelineData.ts"
click node_duckdb "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/duckdb.ts"
click node_file_import "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/fileImport.ts"
click node_local_db "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/db.ts"
click node_project_store "https://github.com/joogatechsoln/dataflow/blob/main/src/store/projectStore.ts"
click node_dashboard "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Dashboard/Dashboard.tsx"
click node_team "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Team/TeamWorkspace.tsx"
click node_cloud_sync "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/useCloudSync.ts"
click node_team_store "https://github.com/joogatechsoln/dataflow/blob/main/src/store/teamStore.ts"
click node_admin "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Admin/AdminDashboard.tsx"
click node_assistant "https://github.com/joogatechsoln/dataflow/blob/main/src/components/AIAssistant/AIAssistant.tsx"
click node_ai_api "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/api.ts"
click node_marketplace "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Marketplace/PluginMarketplace.tsx"
click node_plugin_registry "https://github.com/joogatechsoln/dataflow/blob/main/src/plugins/registry.ts"
click node_plugin_loader "https://github.com/joogatechsoln/dataflow/blob/main/src/plugins/loader.ts"
click node_plugin_store "https://github.com/joogatechsoln/dataflow/blob/main/src/store/pluginStore.ts"
click node_learn "https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Learn/LearnHub.tsx"
click node_license "https://github.com/joogatechsoln/dataflow/blob/main/src/store/licenseStore.ts"
click node_analytics "https://github.com/joogatechsoln/dataflow/blob/main/src/lib/analytics.ts"
click node_notifications "https://github.com/joogatechsoln/dataflow/blob/main/src/components/Notifications/NotificationsPanel.tsx"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_app,node_sidebar,node_topbar,node_notifications,node_user toneBlue
class node_pipeline,node_define,node_collect,node_clean,node_analyze,node_visualize,node_report toneAmber
class node_pipeline_data,node_duckdb,node_file_import,node_local_db,node_project_store,node_dashboard toneMint
class node_authpage,node_authstore,node_supabase,node_team,node_cloud_sync,node_team_store,node_admin toneRose
class node_assistant,node_ai_api,node_marketplace,node_plugin_registry,node_plugin_loader,node_plugin_store,node_learn,node_license,node_analytics toneIndigo
```

## Components

### App shell

- [App shell and routing](https://github.com/joogatechsoln/dataflow/blob/main/src/App.tsx): `src/App.tsx`
- [Navigation](https://github.com/joogatechsoln/dataflow/blob/main/src/components/Sidebar/Sidebar.tsx): `src/components/Sidebar/Sidebar.tsx`
- [Workspace actions](https://github.com/joogatechsoln/dataflow/blob/main/src/components/TopBar/TopBar.tsx): `src/components/TopBar/TopBar.tsx`
- [Notification feed](https://github.com/joogatechsoln/dataflow/blob/main/src/components/Notifications/NotificationsPanel.tsx): `src/components/Notifications/NotificationsPanel.tsx`

### Analytics pipeline

- [Pipeline dispatcher](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Pipeline.tsx): `src/pages/Pipeline/Pipeline.tsx`
- [Define problem](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Define/Define.tsx): `src/pages/Pipeline/Define/Define.tsx`
- [Collect data](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Collect/Collect.tsx): `src/pages/Pipeline/Collect/Collect.tsx`
- [Clean data](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Clean/Clean.tsx): `src/pages/Pipeline/Clean/Clean.tsx`
- [Analyze data](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Analyze/Analyze.tsx): `src/pages/Pipeline/Analyze/Analyze.tsx`
- [Visualize data](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Visualize/Visualize.tsx): `src/pages/Pipeline/Visualize/Visualize.tsx`
- [Report and export](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Pipeline/Report/Report.tsx): `src/pages/Pipeline/Report/Report.tsx`

### Data and persistence

- [Pipeline data services](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/pipelineData.ts): `src/lib/pipelineData.ts`
- [Browser SQL engine](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/duckdb.ts): `src/lib/duckdb.ts`
- [File import](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/fileImport.ts): `src/lib/fileImport.ts`
- [IndexedDB storage](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/db.ts): `src/lib/db.ts`
- [Project state](https://github.com/joogatechsoln/dataflow/blob/main/src/store/projectStore.ts): `src/store/projectStore.ts`
- [Project dashboard](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Dashboard/Dashboard.tsx): `src/pages/Dashboard/Dashboard.tsx`

### Identity and teams

- [Authentication](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Auth/SupabaseAuthPage.tsx): `src/pages/Auth/SupabaseAuthPage.tsx`
- [Auth state](https://github.com/joogatechsoln/dataflow/blob/main/src/store/authStore.ts): `src/store/authStore.ts`
- [Supabase services](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/supabase.ts): `src/lib/supabase.ts`
- [Team workspace](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Team/TeamWorkspace.tsx): `src/pages/Team/TeamWorkspace.tsx`
- [Cloud sync and history](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/useCloudSync.ts): `src/lib/useCloudSync.ts`
- [Team state](https://github.com/joogatechsoln/dataflow/blob/main/src/store/teamStore.ts): `src/store/teamStore.ts`
- [Admin dashboard](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Admin/AdminDashboard.tsx): `src/pages/Admin/AdminDashboard.tsx`

### Platform capabilities

- [AI assistant](https://github.com/joogatechsoln/dataflow/blob/main/src/components/AIAssistant/AIAssistant.tsx): `src/components/AIAssistant/AIAssistant.tsx`
- [AI request client](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/api.ts): `src/lib/api.ts`
- [Plugin marketplace](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Marketplace/PluginMarketplace.tsx): `src/pages/Marketplace/PluginMarketplace.tsx`
- [Plugin registry](https://github.com/joogatechsoln/dataflow/blob/main/src/plugins/registry.ts): `src/plugins/registry.ts`
- [Plugin loader](https://github.com/joogatechsoln/dataflow/blob/main/src/plugins/loader.ts): `src/plugins/loader.ts`
- [Installed plugins](https://github.com/joogatechsoln/dataflow/blob/main/src/store/pluginStore.ts): `src/store/pluginStore.ts`
- [Learning hub](https://github.com/joogatechsoln/dataflow/blob/main/src/pages/Learn/LearnHub.tsx): `src/pages/Learn/LearnHub.tsx`
- [Plan and license state](https://github.com/joogatechsoln/dataflow/blob/main/src/store/licenseStore.ts): `src/store/licenseStore.ts`
- [Usage analytics](https://github.com/joogatechsoln/dataflow/blob/main/src/lib/analytics.ts): `src/lib/analytics.ts`

### Other components

- **User**

## Connections

- User → App shell and routing: uses
- App shell and routing → Authentication: gates access (evidence: `src/App.tsx`)
- Authentication → Supabase services: authenticates with (evidence: `src/pages/Auth/SupabaseAuthPage.tsx`)
- Authentication → Auth state: sets session (evidence: `src/pages/Auth/SupabaseAuthPage.tsx`)
- App shell and routing → Navigation: renders (evidence: `src/App.tsx`)
- App shell and routing → Workspace actions: renders (evidence: `src/App.tsx`)
- App shell and routing → Pipeline dispatcher: routes to (evidence: `src/App.tsx`)
- App shell and routing → AI assistant: opens (evidence: `src/App.tsx`)
- App shell and routing → Plugin marketplace: routes to (evidence: `src/App.tsx`)
- App shell and routing → Notification feed: shows (evidence: `src/App.tsx`)
- Pipeline dispatcher → Define problem: dispatches (evidence: `src/pages/Pipeline/Pipeline.tsx`)
- Pipeline dispatcher → Collect data: dispatches (evidence: `src/pages/Pipeline/Pipeline.tsx`)
- Pipeline dispatcher → Clean data: dispatches (evidence: `src/pages/Pipeline/Pipeline.tsx`)
- Pipeline dispatcher → Analyze data: dispatches (evidence: `src/pages/Pipeline/Pipeline.tsx`)
- Pipeline dispatcher → Visualize data: dispatches (evidence: `src/pages/Pipeline/Pipeline.tsx`)
- Pipeline dispatcher → Report and export: dispatches (evidence: `src/pages/Pipeline/Pipeline.tsx`)
- Collect data → File import: imports files
- File import → Browser SQL engine: registers data
- Clean data → Pipeline data services: profiles data (evidence: `src/pages/Pipeline/Clean/Clean.tsx`)
- Visualize data → Pipeline data services: gets chart data (evidence: `src/pages/Pipeline/Visualize/Visualize.tsx`)
- Pipeline data services → IndexedDB storage: loads project files (evidence: `src/lib/pipelineData.ts`)
- Pipeline data services → Browser SQL engine: queries tables (evidence: `src/lib/pipelineData.ts`)
- Report and export → Project state: reads project state (evidence: `src/pages/Pipeline/Report/Report.tsx`)
- Report and export → Pipeline data services: uses data helpers (evidence: `src/pages/Pipeline/Report/Report.tsx`)
- Report and export → User: exports PDF/PPTX
- Project dashboard → Project state: manages projects
- AI assistant → AI request client: sends prompts (evidence: `src/components/AIAssistant/AIAssistant.tsx`)
- AI assistant → Project state: reads pipeline context (evidence: `src/components/AIAssistant/AIAssistant.tsx`)
- Team workspace → Cloud sync and history: syncs projects (evidence: `src/pages/Team/TeamWorkspace.tsx`)
- Team workspace → Team state: uses workspace state (evidence: `src/pages/Team/TeamWorkspace.tsx`)
- Cloud sync and history → Supabase services: pushes and pulls (evidence: `src/lib/useCloudSync.ts`)
- Cloud sync and history → Project state: updates projects (evidence: `src/lib/useCloudSync.ts`)
- Cloud sync and history → Team state: updates sync state (evidence: `src/lib/useCloudSync.ts`)
- Admin dashboard → Supabase services: manages cloud records (evidence: `src/pages/Admin/AdminDashboard.tsx`)
- Plugin marketplace → Plugin registry: loads listings (evidence: `src/pages/Marketplace/PluginMarketplace.tsx`)
- Plugin marketplace → Plugin loader: installs plugins (evidence: `src/pages/Marketplace/PluginMarketplace.tsx`)
- Plugin marketplace → Installed plugins: tracks installed plugins (evidence: `src/pages/Marketplace/PluginMarketplace.tsx`)
- Workspace actions → Plan and license state: shows plan status
- Plan and license state → Usage analytics: records opted-in usage (evidence: `src/lib/analytics.ts`)
