How nutlope/notesgpt works
Main System Components
a) Client Layer:
• Next.js Frontend (App Router)
• Components hierarchy
• Authentication UI (Clerk)
• Recording Interface
b) Backend Services:
• Convex Backend
• Authentication Service (Clerk)
• AI Services Layer
• Together.ai (LLM & Embeddings)
• Replicate (Whisper transcription)
c) Data Storage:
• Convex Database
• Convex File Storage
• Vector Storage (for embeddings)
Component Relationships and Data Flow
[User Interface Layer]
• ↑↓
[Authentication Layer (Clerk)]
• ↑↓
[Next.js App Router]
• ↑↓
[Convex Backend]
• ↑↓
[Service Layer]
• Together.ai
• Replicate
• File Storage
Specific Implementation Details
a) Frontend Architecture:
• App router structure (/dashboard, /record, /recording)
• Component organization (pages, UI components)
• Client-side state management
b) Backend Architecture:
• Convex functions and API endpoints
• File storage system
• Vector search implementation
• Authentication flow
c) AI Pipeline:
• Voice recording flow
• Whisper transcription process
• Together.ai processing (Mixtral model)
• Embedding generation and search
Key Interactions to Highlight
• Voice Recording Flow:
• [Recording UI] → [File Storage] → [Whisper] → [Text Processing]
• Action Item Generation:
• [Transcribed Text] → [Together.ai] → [Action Items Storage]
• Search Flow:
• [Search Input] → [Vector Search] → [Embeddings] → [Results]
Implementation Notes
• Nested components
• Grouping of related components
• Clear labeling of services and interactions