How hungreeee/resume-screening-rag-pipeline works
Component Breakdown
Frontend Layer:
• It to API/Service layer below
Processing Layer (Core):
• Create three main processing blocks:
1. Query Processing Block:
• Query Classifier
• Function Calling Module
• Chat History Manager
2. RAG Pipeline Block (Central):
• Sub-query Generator
• Retriever Module (with two sub-components):
• RAG Retriever
• RAG Fusion Retriever
• Document Re-ranker
• Context Augmentation Module
3. LLM Generation Block:
• LLM Agent (OpenAI)
• Response Generator
Data Storage Layer:
• Vector Stores (FAISS):
• PDF Vector Store
• Synthetic Vector Store
• Document Storage:
• Resume Database
• Job Descriptions
• Evaluation Results
Integration Points
Clear connections between:
• Vector stores and retrieval components
• LLM services and generation components
• Storage systems and processing modules
Key Technical Elements to Highlight
• Langchain
• OpenAI
• HuggingFace
• FAISS
• Streamlit
Additional Elements
Include:
• Version/environment indicators
• External service connections
• System boundaries
Performance Flow
"Small-to-Big retrieval" process:
• Text chunk processing
• Document retrieval
• Full-text augmentation