How mileschintw/rust-lancedb-graphrag works
Lancet is a RAG/GraphRAG platform: clients submit documents and questions through a Go control plane, which coordinates a Rust data plane for ingestion and answer generation. The query path combines dense and BM25 retrieval, fusion, optional reranking and graph context, then assembles cited answers and streams workflow events. A separate Python evaluation harness exercises the service and measures quality, latency, and preregistered gates. Edges reflect README statements and shown source references; some internal calls and storage wiring are not visible in the supplied excerpts, so they are omitted rather than inferred.
Main entry points: service.rs Engine Service · main.go HTTP API · ingest.rs Document Ingestion · retrieve.rs Retrieval Stage
Components 23
Go Control Plane
- HTTP API
gateway/main.go - Engine Client
gateway/internal/engineclient/engineclient.go - Document Store
gateway/db - SSE Events
gateway/internal/sse/sse.go
Rust Data Plane
- gRPC Contract
proto/lancet/v1/lancet.proto - Engine Service
engine/src/service.rs - Document Ingestion
engine/src/ingest.rs - Chunking
engine/src/chunker/mod.rs - LanceDB Access
engine/src/db/mod.rs - Workflow Runner
engine/src/workflow/runner.rs - Retrieval Stage
engine/src/workflow/nodes/retrieve.rs - Hybrid Retrieval
engine/src/retrieval/mod.rs - Reranking
engine/src/rerank/mod.rs - Knowledge Graph
engine/src/graph/mod.rs - Prompt Assembly
engine/src/prompt.rs - Answer Generation
engine/src/generation/mod.rs
Evaluation Harness
- Service Eval Client
eval/src/lancet_eval/client.py - Evaluation Arms
eval/src/lancet_eval/arms.py - Scoring & Reports
eval/src/lancet_eval/score.py - Metrics & Statistics
eval/src/lancet_eval/metrics.py - Evaluation Gates
eval/src/lancet_eval/thresholds.py
Other components
- User / Client
- OpenRouter
Connections 24
- User / Client → HTTP API: submits queries
- HTTP API → Engine Client: dispatches RPC
gateway/main.go - HTTP API → Document Store: reads and writes
gateway/main.go - HTTP API → SSE Events: streams events
gateway/main.go - Engine Client → gRPC Contract: uses contract
gateway/internal/engineclient/engineclient.go - Engine Service → gRPC Contract: implements service
engine/src/service.rs - Engine Service → Document Ingestion: handles ingestion
engine/src/service.rs - Document Ingestion → Chunking: chunks documents
engine/src/ingest.rs - Document Ingestion → LanceDB Access: mutates indexes
engine/src/ingest.rs - Engine Service → LanceDB Access: queries storage
engine/src/service.rs - Engine Service → Workflow Runner: runs queries
engine/src/service.rs - Workflow Runner → Retrieval Stage: dispatches stage
engine/src/workflow/nodes/retrieve.rs - Retrieval Stage → Hybrid Retrieval: retrieves candidates
engine/src/workflow/nodes/retrieve.rs - Retrieval Stage → Reranking: reranks candidates
engine/src/workflow/nodes/retrieve.rs - Engine Service → Knowledge Graph: provides graph context
engine/src/service.rs - Engine Service → Answer Generation: generates answer
engine/src/service.rs - Answer Generation → Prompt Assembly: assembles evidence prompt
engine/src/generation/mod.rs - Answer Generation → OpenRouter: calls provider
- Reranking → OpenRouter: calls provider
- Service Eval Client → HTTP API: queries endpoint
eval/src/lancet_eval/client.py - Evaluation Arms → Service Eval Client: runs service arms
eval/src/lancet_eval/arms.py - Evaluation Arms → Scoring & Reports: records measurements
eval/src/lancet_eval/arms.py - Scoring & Reports → Metrics & Statistics: computes metrics
eval/src/lancet_eval/score.py - Scoring & Reports → Evaluation Gates: checks gates
eval/src/lancet_eval/score.py