How anshikaaggarwal/crashtest-ai works
CrashTest lets an engineer submit an agent prompt and scenario, run autonomous inbox or adversarial leak tests, and inspect a judge-scored, auditable verdict. Its main execution route coordinates scenario validation, an agent or attacker loop, and judging; a suite runner applies that process across scenarios for reports. Separate product branches cover live voice testing, threat modeling, and voice-authored scenarios. Edges reflect the sampled calls and index references; some browser-to-route connections are not shown in the excerpts and are left unasserted.
Main entry points: route.ts Crash API · Dashboard.tsx Dashboard · suite.ts Batch Runner · secrets.ts Canary Scanner
Components 27
Testing Interface
- Dashboard
app/Dashboard.tsx - Crash Runner
app/CrashRunner.tsx - Live Call UI
app/LiveCall.tsx - Scenario Composer
app/ScenarioComposer.tsx - Threat Model UI
app/ThreatModel.tsx
Test Execution
- Crash API
app/api/crash/route.ts - Live API
app/api/live/route.ts - Suite API
app/api/suite/route.ts - Draft API
app/api/scenario/draft/route.ts - Autonomous Agent
lib/agent.ts - Red-Team Loop
lib/attacker.ts - Live Test Engine
lib/live.ts - Fake Tools
lib/tools.ts
Scenarios & Verdicts
- Scenario Library
lib/scenarios.ts - Draft Validation
lib/scenarioDraft.ts - Canary Scanner
lib/secrets.ts - Safety Judge
lib/judge.ts - Event Types
lib/events.ts
Reports & Voice
- Batch Runner
lib/suite.ts - Report Builder
lib/report.ts - Report API
app/api/report/route.ts - Suite Report UI
app/SuiteReport.tsx - Threat Catalog
lib/threats.ts - Browser Speech
lib/speech.ts - TTS API
app/api/tts/route.ts - Maya TTS Client
lib/maya.ts
Other components
- Engineer
Connections 36
- Engineer → Dashboard: uses
README.md - Dashboard → Crash Runner: opens
app/Dashboard.tsx - Dashboard → Live Call UI: opens
app/Dashboard.tsx - Dashboard → Scenario Composer: opens
app/Dashboard.tsx - Dashboard → Threat Model UI: opens
app/Dashboard.tsx - Dashboard → Suite Report UI: opens
app/Dashboard.tsx - Crash API → Scenario Library: selects
app/api/crash/route.ts - Crash API → Draft Validation: validates
app/api/crash/route.ts - Crash API → Autonomous Agent: runs
app/api/crash/route.ts - Crash API → Red-Team Loop: runs
app/api/crash/route.ts - Crash API → Safety Judge: scores
app/api/crash/route.ts - Autonomous Agent → Fake Tools: invokes
lib/agent.ts - Red-Team Loop → Fake Tools: invokes
lib/attacker.ts - Red-Team Loop → Canary Scanner: scans replies
lib/attacker.ts - Safety Judge → Canary Scanner: caps ratings
lib/judge.ts - Crash API → Event Types: streams
app/api/crash/route.ts - Live API → Live Test Engine: runs
app/api/live/route.ts - Live API → Safety Judge: scores
app/api/live/route.ts - Live API → Canary Scanner: checks leaks
app/api/live/route.ts - Live Test Engine → Scenario Library: uses
lib/live.ts - Live Test Engine → Fake Tools: uses
lib/live.ts - Live Test Engine → Canary Scanner: checks leaks
lib/live.ts - Suite API → Batch Runner: runs
app/api/suite/route.ts - Batch Runner → Scenario Library: selects
lib/suite.ts - Batch Runner → Autonomous Agent: runs
lib/suite.ts - Batch Runner → Red-Team Loop: runs
lib/suite.ts - Batch Runner → Safety Judge: scores
lib/suite.ts - Report API → Report Builder: builds
app/api/report/route.ts - Report Builder → Batch Runner: summarizes
lib/report.ts - Draft API → Draft Validation: creates drafts
app/api/scenario/draft/route.ts - Draft Validation → Canary Scanner: checks canaries
lib/scenarioDraft.ts - Threat Model UI → Threat Catalog: shows threats
app/ThreatModel.tsx - Threat Model UI → Scenario Library: browses
app/ThreatModel.tsx - Live Call UI → Browser Speech: uses speech
app/LiveCall.tsx - TTS API → Maya TTS Client: requests speech
app/api/tts/route.ts - Browser Speech → TTS API: requests readback
README.md