How shailendra1703/kurma works
Main Components
a) PDF Processing Layer
• PDF Input Handler
• Document Chunking Component
• Text Extraction Service
b) Vector Database Layer
• Document Embeddings Storage
• Vector Index Management
• Similarity Search Engine
c) RAG Pipeline
• Query Processing Component
• Context Retrieval System
• Response Generation Module
d) User Interface Layer
• Web Interface (indicated by htmlTemplates.py)
• API Endpoints (handled in app.py)
[User Interface Layer]
• ↓↑
[RAG Pipeline Layer]
• ↓↑
[Vector Database Layer]
• ↓↑
[PDF Processing Layer]
Specific Component Details
For each major component, include these elements:
a) PDF Processing Layer:
• PDF input acceptance
• Document splitting process
• Text extraction flow
• Embedding generation
b) Vector Database Layer:
• Document vector storage
• Indexing mechanism
• Search functionality
c) RAG Pipeline:
• Query embedding process
• Retrieval mechanism
• LLM integration
• Response synthesis
d) User Interface:
• Web interface components
• API endpoints
• User interaction flow
Important Elements to Highlight
• Document the flow of data from PDF upload to response generation
• Interaction between the vector database and the RAG pipeline
• How the user interface connects to the backend services
• Query processing flow