How adieuj777/rag-framework-generator works
Autou-build is a web-based Advanced RAG framework generator with an evaluation-and-selection workflow. Users configure RAG strategies and providers, preview or write a generated project, or select documents and compare configurations through a background evaluator. The evaluator loads documents, synthesizes test questions, runs each RAG configuration, scores answers, and returns a ranking. The source excerpts show the main orchestration paths; generated-project templates are present in the tree but were not sampled, so their internal behavior is not expanded here.
Main entry points: evaluate.py Evaluation orchestrator · main.py FastAPI routes · engine.py Spec and generation engine · eval_runner.py Evaluation job runner
Components 18
Web interface
- Browser UI
autou-build/app/static/app.js - FastAPI routes
autou-build/app/main.py - Directory picker
autou-build/app/directory_picker.py
Framework generation
- Strategy options
autou-build/app/config.py - Spec and generation engine
autou-build/app/generator/engine.py - Project templates
autou-build/app/generator/templates
RAG evaluation
- Evaluation job runner
autou-build/app/eval_runner.py - Evaluation orchestrator
autou-build/rag_evaluator/evaluate.py - Document loading
autou-build/rag_evaluator/evaluate.py - Test-set synthesis
autou-build/rag_evaluator/testset.py - Configurable RAG pipeline
autou-build/rag_evaluator/rag.py - Evaluation metrics
autou-build/rag_evaluator/metrics.py - Ranked evaluation report
autou-build/rag_evaluator/evaluate.py
Shared model setup
- Provider factories
autou-build/providers.py
Other components
- User
- Target project files
- LLM and embedding providers
- Vector stores
Connections 20
- User → Browser UI: configures or evaluates
autou-build/app/static/app.js - Browser UI → FastAPI routes: calls API
autou-build/app/static/app.js - FastAPI routes → Strategy options: reads options
autou-build/app/main.py - FastAPI routes → Spec and generation engine: validates and generates
autou-build/app/main.py - Spec and generation engine → Strategy options: validates against
autou-build/app/generator/engine.py - Spec and generation engine → Provider factories: uses provider definitions
autou-build/app/generator/engine.py - Spec and generation engine → Project templates: renders templates
autou-build/app/generator/engine.py - FastAPI routes → Target project files: writes generated files
autou-build/app/main.py - FastAPI routes → Directory picker: requests directory
autou-build/app/main.py - FastAPI routes → Evaluation job runner: starts and polls jobs
autou-build/app/main.py - Evaluation job runner → Evaluation orchestrator: launches evaluator
autou-build/app/eval_runner.py - Evaluation orchestrator → Document loading: loads selected files
autou-build/rag_evaluator/evaluate.py - Evaluation orchestrator → Provider factories: builds models
autou-build/rag_evaluator/evaluate.py - Provider factories → LLM and embedding providers: constructs clients
autou-build/providers.py - Evaluation orchestrator → Test-set synthesis: generates test set
autou-build/rag_evaluator/evaluate.py - Evaluation orchestrator → Configurable RAG pipeline: builds each configuration
autou-build/rag_evaluator/evaluate.py - Configurable RAG pipeline → Vector stores: creates index
autou-build/rag_evaluator/rag.py - Evaluation orchestrator → Evaluation metrics: scores answers
autou-build/rag_evaluator/evaluate.py - Evaluation orchestrator → Ranked evaluation report: ranks results
autou-build/rag_evaluator/evaluate.py - Evaluation job runner → Ranked evaluation report: reads report file
autou-build/app/eval_runner.py