How prateek1771/jev_lab works
Jev Lab compares Jev, LLM, and plain-code approaches across 24 independent AI decision experiments. Users select an experiment, submit one example or run its labeled dataset, then inspect outcomes and reports in the Next.js or Streamlit UI. The API exposes experiment metadata, live and streamed dataset runs, saved-run reports, and downloads. The experiments span classification and scoring, routing and tool safety, retrieval and verification, and agent and business workflows. Their implementations vary; the sampled clients show Jev and OpenRouter calls, while unsampled project details are represented only at the documented experiment-suite level.
Main entry points: projects Experiment suite · main.py Web API · app.py Streamlit UI · openrouter.py Model-call helpers
Components 19
User interfaces
- Next.js UI
web/app/page.tsx - Streamlit UI
app.py - Streamlit rendering
core/ui.py
API and orchestration
- Web API
api/main.py - Project discovery
core/projects.py
Decision experiments
- Experiment suite
projects - Classification and scoring
projects/01_classification - Routing and tool gates
projects/04_routing - RAG and citation checks
projects/08_rag_filter - Safety and detection
projects/11_injection_detector - Agents and workflows
projects/16_agent_router - Context and memory
projects/21_context_filter
Model integrations
- Model-call helpers
shared/openrouter.py - Provider settings
config/settings.py
Results and reporting
- Run and result
core/run.py - Metrics and reports
core/report.py - Saved dataset runs
Other components
- User
- OpenRouter service
Connections 22
- User → Next.js UI: uses
- User → Streamlit UI: uses
- Next.js UI → Web API: requests data
- Web API → Project discovery: discovers projects
- Streamlit UI → Project discovery: discovers projects
- Web API → Experiment suite: runs experiment
- Streamlit UI → Experiment suite: runs experiment
- Experiment suite → Model-call helpers: uses shared calls
- Model-call helpers → Provider settings: reads settings
- Model-call helpers → OpenRouter service: calls API
- Experiment suite → Run and result: returns results
- Web API → Metrics and reports: builds reports
- Web API → Saved dataset runs: writes and reads
- Web API → Run and result: serializes results
- Streamlit UI → Streamlit rendering: renders results
- Streamlit rendering → Metrics and reports: formats batch results
- Experiment suite → Classification and scoring: includes
- Experiment suite → Routing and tool gates: includes
- Experiment suite → RAG and citation checks: includes
- Experiment suite → Safety and detection: includes
- Experiment suite → Agents and workflows: includes
- Experiment suite → Context and memory: includes