# jefferyhcool/bilinote architecture

> Architecture diagram of the GitHub repository jefferyhcool/bilinote, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jefferyhcool/bilinote
- Repository: https://github.com/jefferyhcool/bilinote

## Overview

BiliNote is an AI video-to-notes application delivered as a React desktop/web client, a browser extension, and a FastAPI backend. The main workflow submits a supported video or local file, obtains subtitles or audio transcription, summarizes content with a configured model, then presents Markdown notes with optional screenshots, source links, history, and AI Q&A. The README documents these capabilities; sampled backend startup and extension code show selected wiring, but most route and processing implementations were not sampled, so undocumented internal calls are omitted.

Main entry points: [`backend/app/routers/note.py`](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/routers/note.py) (Note generation API), [`BillNote_extension/src/background/main.ts`](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/background/main.ts) (Browser extension), [`backend/main.py`](https://github.com/jefferyhcool/bilinote/blob/master/backend/main.py) (FastAPI application), [`backend/app/services/note.py`](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/note.py) (Task and note services)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_clients["User clients"]
  node_webdesk["Web and desktop UI<br/>[App.tsx]"]
  node_noteform["Note submission<br/>[NoteForm.tsx]"]
  node_historyview["Notes and history<br/>[NoteHistory.tsx]"]
  node_settings["Model and task settings<br/>[index.tsx]"]
  node_extension["Browser extension<br/>[main.ts]"]
  node_extsettings["Extension settings<br/>[Providers.vue]"]
  node_extpanel["Extension notes panel<br/>[Sidepanel.vue]"]
end

subgraph group_api["Backend API"]
  node_apiapp["FastAPI application<br/>[main.py]"]
  node_noteapi["Note generation API<br/>[note.py]"]
  node_chatapi["Chat API<br/>[chat.py]"]
  node_configapi["Configuration APIs<br/>[config.py]"]
  node_taskservice["Task and note services<br/>[note.py]"]
end

subgraph group_media["Media processing"]
  node_downloader["Platform downloaders"]
  node_transcription["Audio transcription"]
  node_subtitle["Subtitle extraction"]
  node_videoassets["Screenshots and uploads<br/>[ffmpeg_helper.py]"]
end

subgraph group_ai["AI and retrieval"]
  node_llm["LLM summarization"]
  node_chatrag["RAG and function tools<br/>[chat_service.py]"]
end

subgraph group_state["Persistence and configuration"]
  node_sqlite[("SQLite data<br/>[engine.py]")]
  node_providerconfig[("Provider records<br/>[provider_dao.py]")]
  node_transcriberconfig["Transcriber configuration"]
  node_proxyconfig["Global proxy settings"]
  node_extensionstorage[("Extension task storage<br/>[storage.ts]")]
end

node_user(("Video note user"))
node_modelproviders["Configured AI providers"]
node_video_platforms["Video platforms and local files"]
node_speech_engines["Transcription engines"]

node_user -->|"submits video"| node_webdesk
node_user -->|"starts summary"| node_extension
node_webdesk -->|"opens workspace"| node_noteform
node_noteform -.->|"requests generation"| node_noteapi
node_extension -->|"detects platform"| node_video_platforms
node_extension -->|"posts generation request"| node_noteapi
node_extension -->|"opens on success"| node_extpanel
node_extension -->|"stores task records"| node_extensionstorage
node_extsettings -.->|"shares settings"| node_extensionstorage
node_noteapi -.->|"gets video content"| node_downloader
node_noteapi -.->|"extracts subtitles"| node_subtitle
node_noteapi -.->|"transcribes audio"| node_transcription
node_downloader -->|"fetches media"| node_video_platforms
node_transcription -->|"uses engine"| node_speech_engines
node_noteapi -.->|"summarizes content"| node_llm
node_noteapi -.->|"creates screenshots"| node_videoassets
node_noteapi -.->|"manages note task"| node_taskservice
node_llm -->|"uses configured model"| node_modelproviders
node_chatapi -.->|"answers note questions"| node_chatrag
node_chatrag -.->|"queries model"| node_llm
node_settings -.->|"configures services"| node_configapi
node_extsettings -.->|"configures backend"| node_configapi
node_apiapp -->|"initializes database"| node_sqlite
node_apiapp -->|"seeds providers"| node_providerconfig
node_apiapp -->|"reads settings"| node_transcriberconfig
node_apiapp -->|"applies proxy"| node_proxyconfig
node_taskservice -.->|"persists task data"| node_sqlite
node_historyview -.->|"shows task history"| node_taskservice
node_noteapi -->|"accepts local video"| node_video_platforms

click node_webdesk "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/App.tsx"
click node_noteform "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/pages/HomePage/components/NoteForm.tsx"
click node_historyview "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/pages/HomePage/components/NoteHistory.tsx"
click node_settings "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/pages/SettingPage/index.tsx"
click node_extension "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/background/main.ts"
click node_extsettings "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/options/pages/Providers.vue"
click node_extpanel "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/sidepanel/Sidepanel.vue"
click node_apiapp "https://github.com/jefferyhcool/bilinote/blob/master/backend/main.py"
click node_noteapi "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/routers/note.py"
click node_chatapi "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/routers/chat.py"
click node_configapi "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/routers/config.py"
click node_downloader "https://github.com/jefferyhcool/bilinote/tree/master/backend/app/downloaders"
click node_transcription "https://github.com/jefferyhcool/bilinote/tree/master/backend/app/transcriber"
click node_subtitle "https://github.com/jefferyhcool/bilinote/tree/master/backend/app/downloaders"
click node_videoassets "https://github.com/jefferyhcool/bilinote/blob/master/backend/ffmpeg_helper.py"
click node_llm "https://github.com/jefferyhcool/bilinote/tree/master/backend/app/gpt"
click node_chatrag "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/chat_service.py"
click node_taskservice "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/note.py"
click node_sqlite "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/db/engine.py"
click node_providerconfig "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/db/provider_dao.py"
click node_transcriberconfig "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/transcriber_config_manager.py"
click node_proxyconfig "https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/proxy_config_manager.py"
click node_extensionstorage "https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/logic/storage.ts"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_webdesk,node_noteform,node_historyview,node_settings,node_extension,node_extsettings,node_extpanel,node_user toneBlue
class node_apiapp,node_noteapi,node_chatapi,node_configapi,node_taskservice toneAmber
class node_downloader,node_transcription,node_subtitle,node_videoassets toneMint
class node_llm,node_chatrag toneRose
class node_sqlite,node_providerconfig,node_transcriberconfig,node_proxyconfig,node_extensionstorage,node_modelproviders,node_video_platforms,node_speech_engines toneIndigo
```

## Components

### User clients

- [Web and desktop UI](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/App.tsx): `BillNote_frontend/src/App.tsx`
- [Note submission](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/pages/HomePage/components/NoteForm.tsx): `BillNote_frontend/src/pages/HomePage/components/NoteForm.tsx`
- [Notes and history](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/pages/HomePage/components/NoteHistory.tsx): `BillNote_frontend/src/pages/HomePage/components/NoteHistory.tsx`
- [Model and task settings](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_frontend/src/pages/SettingPage/index.tsx): `BillNote_frontend/src/pages/SettingPage/index.tsx`
- [Browser extension](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/background/main.ts): `BillNote_extension/src/background/main.ts`
- [Extension settings](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/options/pages/Providers.vue): `BillNote_extension/src/options/pages/Providers.vue`
- [Extension notes panel](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/sidepanel/Sidepanel.vue): `BillNote_extension/src/sidepanel/Sidepanel.vue`

### Backend API

- [FastAPI application](https://github.com/jefferyhcool/bilinote/blob/master/backend/main.py): `backend/main.py`
- [Note generation API](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/routers/note.py): `backend/app/routers/note.py`
- [Chat API](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/routers/chat.py): `backend/app/routers/chat.py`
- [Configuration APIs](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/routers/config.py): `backend/app/routers/config.py`
- [Task and note services](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/note.py): `backend/app/services/note.py`

### Media processing

- [Platform downloaders](https://github.com/jefferyhcool/bilinote/tree/master/backend/app/downloaders): `backend/app/downloaders`
- [Audio transcription](https://github.com/jefferyhcool/bilinote/tree/master/backend/app/transcriber): `backend/app/transcriber`
- [Subtitle extraction](https://github.com/jefferyhcool/bilinote/tree/master/backend/app/downloaders): `backend/app/downloaders`
- [Screenshots and uploads](https://github.com/jefferyhcool/bilinote/blob/master/backend/ffmpeg_helper.py): `backend/ffmpeg_helper.py`

### AI and retrieval

- [LLM summarization](https://github.com/jefferyhcool/bilinote/tree/master/backend/app/gpt): `backend/app/gpt`
- [RAG and function tools](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/chat_service.py): `backend/app/services/chat_service.py`

### Persistence and configuration

- [SQLite data](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/db/engine.py): `backend/app/db/engine.py`
- [Provider records](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/db/provider_dao.py): `backend/app/db/provider_dao.py`
- [Transcriber configuration](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/transcriber_config_manager.py): `backend/app/services/transcriber_config_manager.py`
- [Global proxy settings](https://github.com/jefferyhcool/bilinote/blob/master/backend/app/services/proxy_config_manager.py): `backend/app/services/proxy_config_manager.py`
- [Extension task storage](https://github.com/jefferyhcool/bilinote/blob/master/BillNote_extension/src/logic/storage.ts): `BillNote_extension/src/logic/storage.ts`

### Other components

- **Video note user**
- **Configured AI providers**
- **Video platforms and local files**
- **Transcription engines**

## Connections

- Video note user → Web and desktop UI: submits video
- Video note user → Browser extension: starts summary
- Web and desktop UI → Note submission: opens workspace (evidence: `BillNote_frontend/src/App.tsx`)
- Note submission → Note generation API: requests generation
- Browser extension → Video platforms and local files: detects platform (evidence: `BillNote_extension/src/background/main.ts`)
- Browser extension → Note generation API: posts generation request (evidence: `BillNote_extension/src/background/main.ts`)
- Browser extension → Extension notes panel: opens on success (evidence: `BillNote_extension/src/background/main.ts`)
- Browser extension → Extension task storage: stores task records (evidence: `BillNote_extension/src/background/main.ts`)
- Extension settings → Extension task storage: shares settings
- Note generation API → Platform downloaders: gets video content
- Note generation API → Subtitle extraction: extracts subtitles
- Note generation API → Audio transcription: transcribes audio
- Platform downloaders → Video platforms and local files: fetches media
- Audio transcription → Transcription engines: uses engine
- Note generation API → LLM summarization: summarizes content
- Note generation API → Screenshots and uploads: creates screenshots
- Note generation API → Task and note services: manages note task
- LLM summarization → Configured AI providers: uses configured model
- Chat API → RAG and function tools: answers note questions
- RAG and function tools → LLM summarization: queries model
- Model and task settings → Configuration APIs: configures services
- Extension settings → Configuration APIs: configures backend
- FastAPI application → SQLite data: initializes database (evidence: `backend/main.py`)
- FastAPI application → Provider records: seeds providers (evidence: `backend/main.py`)
- FastAPI application → Transcriber configuration: reads settings (evidence: `backend/main.py`)
- FastAPI application → Global proxy settings: applies proxy (evidence: `backend/main.py`)
- Task and note services → SQLite data: persists task data
- Notes and history → Task and note services: shows task history
- Note generation API → Video platforms and local files: accepts local video
