How jefferyhcool/bilinote works
BiliNote is an AI video-to-notes application delivered as a React desktop/web client, a browser extension, and a FastAPI backend. The main workflow submits a supported video or local file, obtains subtitles or audio transcription, summarizes content with a configured model, then presents Markdown notes with optional screenshots, source links, history, and AI Q&A. The README documents these capabilities; sampled backend startup and extension code show selected wiring, but most route and processing implementations were not sampled, so undocumented internal calls are omitted.
Main entry points: routers/note.py Note generation API · main.ts Browser extension · main.py FastAPI application · services/note.py Task and note services
Components 27
User clients
- Web and desktop UI
BillNote_frontend/src/App.tsx - Note submission
BillNote_frontend/src/pages/HomePage/components/NoteForm.tsx - Notes and history
BillNote_frontend/src/pages/HomePage/components/NoteHistory.tsx - Model and task settings
BillNote_frontend/src/pages/SettingPage/index.tsx - Browser extension
BillNote_extension/src/background/main.ts - Extension settings
BillNote_extension/src/options/pages/Providers.vue - Extension notes panel
BillNote_extension/src/sidepanel/Sidepanel.vue
Backend API
- FastAPI application
backend/main.py - Note generation API
backend/app/routers/note.py - Chat API
backend/app/routers/chat.py - Configuration APIs
backend/app/routers/config.py - Task and note services
backend/app/services/note.py
Media processing
- Platform downloaders
backend/app/downloaders - Audio transcription
backend/app/transcriber - Subtitle extraction
backend/app/downloaders - Screenshots and uploads
backend/ffmpeg_helper.py
AI and retrieval
- LLM summarization
backend/app/gpt - RAG and function tools
backend/app/services/chat_service.py
Persistence and configuration
- SQLite data
backend/app/db/engine.py - Provider records
backend/app/db/provider_dao.py - Transcriber configuration
backend/app/services/transcriber_config_manager.py - Global proxy settings
backend/app/services/proxy_config_manager.py - Extension task storage
BillNote_extension/src/logic/storage.ts
Other components
- Video note user
- Configured AI providers
- Video platforms and local files
- Transcription engines
Connections 29
- Video note user → Web and desktop UI: submits video
- Video note user → Browser extension: starts summary
- Web and desktop UI → Note submission: opens workspace
BillNote_frontend/src/App.tsx - Note submission → Note generation API: requests generation
- Browser extension → Video platforms and local files: detects platform
BillNote_extension/src/background/main.ts - Browser extension → Note generation API: posts generation request
BillNote_extension/src/background/main.ts - Browser extension → Extension notes panel: opens on success
BillNote_extension/src/background/main.ts - Browser extension → Extension task storage: stores task records
BillNote_extension/src/background/main.ts - Extension settings → Extension task storage: shares settings
- Note generation API → Platform downloaders: gets video content
- Note generation API → Subtitle extraction: extracts subtitles
- Note generation API → Audio transcription: transcribes audio
- Platform downloaders → Video platforms and local files: fetches media
- Audio transcription → Transcription engines: uses engine
- Note generation API → LLM summarization: summarizes content
- Note generation API → Screenshots and uploads: creates screenshots
- Note generation API → Task and note services: manages note task
- LLM summarization → Configured AI providers: uses configured model
- Chat API → RAG and function tools: answers note questions
- RAG and function tools → LLM summarization: queries model
- Model and task settings → Configuration APIs: configures services
- Extension settings → Configuration APIs: configures backend
- FastAPI application → SQLite data: initializes database
backend/main.py - FastAPI application → Provider records: seeds providers
backend/main.py - FastAPI application → Transcriber configuration: reads settings
backend/main.py - FastAPI application → Global proxy settings: applies proxy
backend/main.py - Task and note services → SQLite data: persists task data
- Notes and history → Task and note services: shows task history
- Note generation API → Video platforms and local files: accepts local video