# jmreddy2106/gendeptrace_benchmark architecture

> Architecture diagram of the GitHub repository jmreddy2106/gendeptrace_benchmark, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-22). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jmreddy2106/gendeptrace_benchmark
- Repository: https://github.com/jmreddy2106/gendeptrace_benchmark

## Overview

GenDepTrace is a dependency-governance research pipeline: users build or load benchmark tasks, generate code with a deterministic or local HuggingFace model, then evaluate extracted dependency claims and produce admission decisions plus SBOM and provenance records. Its central evaluation stage resolves claims against package registries, checks resolved versions with OSV, scores risk, and applies policy. The repository also provides real-SCA baseline wrappers and experiment statistics. Relationships among evaluation internals follow its imports and the README; unsampled benchmark and reporting internals are represented only at their supported module paths.

Main entry points: [`gendepbench/evaluation.py`](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/evaluation.py) (Dependency evaluation), [`gendepbench/cli.py`](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/cli.py) (Command interface), [`gendepbench/generation.py`](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/generation.py) (Code generation), [`gendepbench/utils.py`](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/utils.py) (JSONL and hashing)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_workflow["Benchmark and generation"]
  node_cli["Command interface<br/>[cli.py]"]
  node_benchmark["Task benchmark<br/>[benchmark.py]"]
  node_generator["Code generation<br/>[generation.py]"]
end

subgraph group_governance["Dependency governance"]
  node_evaluation["Dependency evaluation<br/>[evaluation.py]"]
  node_extraction["Claim extraction<br/>[extraction.py]"]
  node_registry["Registry resolution<br/>[registries.py]"]
  node_osv["OSV vulnerability check<br/>[osv.py]"]
  node_risk["Risk scoring<br/>[risk.py]"]
  node_policy["Admission policy<br/>[policy.py]"]
end

subgraph group_evidence["Evidence and artifacts"]
  node_sbom["CycloneDX SBOM<br/>[sbom.py]"]
  node_provenance["Provenance records<br/>[provenance.py]"]
  node_timing["Stage timing<br/>[timing.py]"]
  node_utils["JSONL and hashing<br/>[utils.py]"]
end

subgraph group_experiments["Experiment analysis"]
  node_baselines["SCA baselines<br/>[baselines.py]"]
  node_statistics["Experiment statistics<br/>[statistics.py]"]
end

node_user(("Researcher"))
node_hf["HuggingFace models"]
node_package_registries["PyPI and npm"]
node_osv_service["OSV service"]
node_sca_tools["SCA tools"]

node_user -->|"runs commands"| node_cli
node_cli -->|"builds tasks"| node_benchmark
node_cli -->|"starts generation"| node_generator
node_generator -.->|"loads models"| node_hf
node_cli -->|"starts evaluation"| node_evaluation
node_cli -->|"summarizes runs"| node_statistics
node_evaluation -->|"extracts claims"| node_extraction
node_evaluation -->|"resolves claims"| node_registry
node_registry -->|"queries packages"| node_package_registries
node_evaluation -->|"checks resolved versions"| node_osv
node_osv -->|"queries vulnerabilities"| node_osv_service
node_evaluation -->|"computes factors"| node_risk
node_evaluation -->|"decides admission"| node_policy
node_evaluation -->|"creates SBOM"| node_sbom
node_evaluation -->|"records lineage"| node_provenance
node_evaluation -->|"tracks stages"| node_timing
node_baselines -->|"invokes scanners"| node_sca_tools
node_evaluation -->|"reads and writes data"| node_utils
node_generator -->|"writes generations"| node_utils
node_cli -->|"reads run data"| node_utils

click node_cli "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/cli.py"
click node_benchmark "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/benchmark.py"
click node_generator "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/generation.py"
click node_evaluation "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/evaluation.py"
click node_extraction "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/extraction.py"
click node_registry "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/registries.py"
click node_osv "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/osv.py"
click node_risk "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/risk.py"
click node_policy "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/policy.py"
click node_sbom "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/sbom.py"
click node_provenance "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/provenance.py"
click node_timing "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/timing.py"
click node_baselines "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/baselines.py"
click node_statistics "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/statistics.py"
click node_utils "https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/utils.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_cli,node_benchmark,node_generator toneBlue
class node_evaluation,node_extraction,node_registry,node_osv,node_risk,node_policy toneAmber
class node_sbom,node_provenance,node_timing,node_utils toneMint
class node_baselines,node_statistics toneRose
class node_user,node_hf,node_package_registries,node_osv_service,node_sca_tools toneIndigo
```

## Components

### Benchmark and generation

- [Command interface](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/cli.py): `gendepbench/cli.py`
- [Task benchmark](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/benchmark.py): `gendepbench/benchmark.py`
- [Code generation](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/generation.py): `gendepbench/generation.py`

### Dependency governance

- [Dependency evaluation](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/evaluation.py): `gendepbench/evaluation.py`
- [Claim extraction](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/extraction.py): `gendepbench/extraction.py`
- [Registry resolution](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/registries.py): `gendepbench/registries.py`
- [OSV vulnerability check](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/osv.py): `gendepbench/osv.py`
- [Risk scoring](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/risk.py): `gendepbench/risk.py`
- [Admission policy](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/policy.py): `gendepbench/policy.py`

### Evidence and artifacts

- [CycloneDX SBOM](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/sbom.py): `gendepbench/sbom.py`
- [Provenance records](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/provenance.py): `gendepbench/provenance.py`
- [Stage timing](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/timing.py): `gendepbench/timing.py`
- [JSONL and hashing](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/utils.py): `gendepbench/utils.py`

### Experiment analysis

- [SCA baselines](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/baselines.py): `gendepbench/baselines.py`
- [Experiment statistics](https://github.com/jmreddy2106/gendeptrace_benchmark/blob/main/gendepbench/statistics.py): `gendepbench/statistics.py`

### Other components

- **Researcher**
- **HuggingFace models**
- **PyPI and npm**
- **OSV service**
- **SCA tools**

## Connections

- Researcher → Command interface: runs commands (evidence: `gendepbench/cli.py`)
- Command interface → Task benchmark: builds tasks (evidence: `gendepbench/cli.py`)
- Command interface → Code generation: starts generation (evidence: `gendepbench/cli.py`)
- Code generation → HuggingFace models: loads models (evidence: `README.md`)
- Command interface → Dependency evaluation: starts evaluation (evidence: `gendepbench/cli.py`)
- Command interface → Experiment statistics: summarizes runs (evidence: `gendepbench/cli.py`)
- Dependency evaluation → Claim extraction: extracts claims (evidence: `gendepbench/evaluation.py`)
- Dependency evaluation → Registry resolution: resolves claims (evidence: `gendepbench/evaluation.py`)
- Registry resolution → PyPI and npm: queries packages (evidence: `gendepbench/registries.py`)
- Dependency evaluation → OSV vulnerability check: checks resolved versions (evidence: `gendepbench/evaluation.py`)
- OSV vulnerability check → OSV service: queries vulnerabilities (evidence: `gendepbench/osv.py`)
- Dependency evaluation → Risk scoring: computes factors (evidence: `gendepbench/evaluation.py`)
- Dependency evaluation → Admission policy: decides admission (evidence: `gendepbench/evaluation.py`)
- Dependency evaluation → CycloneDX SBOM: creates SBOM (evidence: `gendepbench/evaluation.py`)
- Dependency evaluation → Provenance records: records lineage (evidence: `gendepbench/evaluation.py`)
- Dependency evaluation → Stage timing: tracks stages (evidence: `gendepbench/evaluation.py`)
- SCA baselines → SCA tools: invokes scanners (evidence: `gendepbench/baselines.py`)
- Dependency evaluation → JSONL and hashing: reads and writes data (evidence: `gendepbench/evaluation.py`)
- Code generation → JSONL and hashing: writes generations (evidence: `gendepbench/generation.py`)
- Command interface → JSONL and hashing: reads run data (evidence: `gendepbench/cli.py`)
