How karkuak/qualgraph-scenario-lab works
Scenario Lab is a command-line tool for running synthetic software-quality scenarios and evaluating advisory QualGraph outputs against known ground truth. Its main workflow validates and loads a scenario pack, optionally applies an entropy profile, canonicalizes evidence, generates journey and impact/test/release analyses, then scores and writes a report. The graph preserves the major evaluation and output stages visible in the source index. Several adapter and canonical modules are present, but their runtime wiring is not established by the excerpts, so they are not connected speculatively.
Main entry points: runScenario.ts Scenario runner · scoreScenario.ts Scenario scoring · validateScenarioPack.ts Pack validation · cli.ts CLI
Components 24
Command Line
- CLI
scenario-lab/src/cli.ts - Scenario runner
scenario-lab/src/runtime/runScenario.ts
Scenario Inputs
- Pack validation
scenario-lab/src/runtime/validateScenarioPack.ts - Pack loading
scenario-lab/src/runtime/loadScenarioPack.ts - Provenance
scenario-lab/src/runtime/provenance.ts - File access
scenario-lab/src/runtime/fs.ts - Entropy profile
scenario-lab/src/runtime/applyEntropyProfile.ts - Scenario pack model
scenario-lab/src/types/scenarioPack.ts
Evidence Modeling
- Canonical evidence
scenario-lab/src/canonical/canonicalEvidence.ts - Telemetry adapter
scenario-lab/src/adapters/telemetrytestAdapter.ts
Quality Analysis
- Journey quality map
scenario-lab/src/simulatedQualGraph/buildJourneyQualityMap.ts - Impact draft
scenario-lab/src/simulatedQualGraph/generateImpactDraft.ts - Test recommendation
scenario-lab/src/simulatedQualGraph/generateAdvisoryTestRecommendation.ts - Deterministic validation
scenario-lab/src/simulatedQualGraph/runDeterministicValidation.ts - Failure hypotheses
scenario-lab/src/simulatedQualGraph/generateFailureClusterHypotheses.ts - Release evidence pack
scenario-lab/src/simulatedQualGraph/generateReleaseEvidencePack.ts - Analysis output model
scenario-lab/src/types/qualgraphOutputs.ts
Evaluation
- Scenario scoring
scenario-lab/src/runtime/scoreScenario.ts - Ground-truth comparison
scenario-lab/src/runtime/compareToGroundTruth.ts - Realism scoring
scenario-lab/src/evaluation/realismScore.ts - Output guardrails
scenario-lab/src/guardrails/boundedLanguageCheck.ts - Evaluation report
scenario-lab/src/runtime/generateEvaluationReport.ts - Evaluation model
scenario-lab/src/types/evaluation.ts
Other components
- Scenario operator
Connections 23
- Scenario operator → CLI: runs
scenario-lab/src/cli.ts - CLI → Pack validation: validates pack
scenario-lab/src/cli.ts - CLI → Scenario runner: starts scenario
scenario-lab/src/cli.ts - Scenario runner → Pack validation: validates pack
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Pack loading: loads pack
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Entropy profile: applies profile
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Canonical evidence: builds evidence
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Telemetry adapter: uses adapter
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Journey quality map: builds map
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Impact draft: generates draft
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Test recommendation: generates advice
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Deterministic validation: checks telemetry
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Failure hypotheses: forms hypotheses
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Release evidence pack: builds pack
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Scenario scoring: scores outputs
scenario-lab/src/runtime/runScenario.ts - Scenario runner → Evaluation report: formats report
scenario-lab/src/runtime/runScenario.ts - Scenario scoring → Ground-truth comparison: compares truth
scenario-lab/src/runtime/scoreScenario.ts - Scenario scoring → Realism scoring: scores realism
scenario-lab/src/runtime/scoreScenario.ts - Scenario scoring → Output guardrails: checks language
scenario-lab/src/runtime/scoreScenario.ts - Pack loading → File access: reads files
scenario-lab/src/runtime/loadScenarioPack.ts - Pack loading → Provenance: loads provenance
scenario-lab/src/runtime/loadScenarioPack.ts - Pack validation → File access: reads files
scenario-lab/src/runtime/validateScenarioPack.ts - Pack validation → Provenance: checks sidecars
scenario-lab/src/runtime/validateScenarioPack.ts