How iqm-finland/iqm-benchmarks works
IQM Benchmarks is a modular quantum-hardware characterization suite. A user configures a benchmark, selects a hardware backend, executes circuits, and uses benchmark results and plots to assess device performance. The README identifies a shared Benchmark/BenchmarkBase API and a legacy BenchmarkExperiment that coordinates dependencies and result storage. Benchmark families and mGST are represented as distinct domain branches. The README and sampled references establish the high-level workflow; most benchmark implementations were not sampled, so their internal execution links are not inferred.
Main entry points: weekly.py Weekly configurations · algorithm.py GST reconstruction · benchmark_runner.py Benchmark runner · reporting.py GST reporting
Components 27
Execution
- Benchmark runner
benchmark_runner.py - Weekly configurations
scheduled_experiments/adonis/weekly.py - Benchmark API
src/iqm/benchmarks/benchmark.py - Benchmark configurations
src/iqm/benchmarks/benchmark_definition.py - Circuit containers
src/iqm/benchmarks/circuit_containers.py - Experiment coordination
src/iqm/benchmarks/benchmark.py
Gate characterization
- Clifford RB
src/iqm/benchmarks/randomized_benchmarking/clifford_rb/clifford_rb.py - Interleaved RB
src/iqm/benchmarks/randomized_benchmarking/interleaved_rb/interleaved_rb.py - Mirror RB
src/iqm/benchmarks/randomized_benchmarking/mirror_rb/mirror_rb.py - Error per layer
src/iqm/benchmarks/randomized_benchmarking/eplg/eplg.py
Holistic benchmarks
- Quantum Volume
src/iqm/benchmarks/quantum_volume/quantum_volume.py - CLOPS
src/iqm/benchmarks/quantum_volume/clops.py
Entanglement and optimization
- GHZ fidelity
src/iqm/benchmarks/entanglement/ghz.py - Graph states
src/iqm/benchmarks/entanglement/graph_states.py - Q-Score
src/iqm/benchmarks/optimization/qscore.py
Compressive GST
- Compressive GST
src/iqm/benchmarks/compressive_gst/compressive_gst.py - GST analysis
src/iqm/benchmarks/compressive_gst/gst_analysis.py - GST reconstruction
src/mGST/algorithm.py - Manifold optimization
src/mGST/optimization.py - Numerical kernels
src/mGST/low_level_jit.py - GST utilities
src/mGST/additional_fns.py - Qiskit bridge
src/mGST/qiskit_interface.py - pyGSTi bridge
src/mGST/compatibility.py - GST reporting
src/mGST/reporting/reporting.py - GST figures
src/mGST/reporting/figure_gen.py
Other components
- Benchmark user
- Quantum backend
Connections 26
- Benchmark user → Benchmark configurations: sets options
README.md - Benchmark user → Quantum backend: selects backend
README.md - Benchmark runner → Weekly configurations: loads configurations
benchmark_runner.py - Benchmark runner → Interleaved RB: runs
benchmark_runner.py - Benchmark runner → Quantum Volume: runs
benchmark_runner.py - Benchmark runner → GHZ fidelity: runs
benchmark_runner.py - Weekly configurations → Clifford RB: configures
scheduled_experiments/adonis/weekly.py - Weekly configurations → Interleaved RB: configures
scheduled_experiments/adonis/weekly.py - Weekly configurations → Mirror RB: configures
scheduled_experiments/adonis/weekly.py - Weekly configurations → CLOPS: configures
scheduled_experiments/adonis/weekly.py - Weekly configurations → Quantum Volume: configures
scheduled_experiments/adonis/weekly.py - Weekly configurations → GHZ fidelity: configures
scheduled_experiments/adonis/weekly.py - Benchmark API → Quantum backend: executes on
- Experiment coordination → Benchmark API: coordinates
README.md - Compressive GST → GST reconstruction: reconstructs with
- GST reconstruction → Manifold optimization: optimizes via
src/mGST/algorithm.py - GST reconstruction → Numerical kernels: calls kernels
src/mGST/algorithm.py - GST reconstruction → GST utilities: uses utilities
src/mGST/algorithm.py - GST reconstruction → GST figures: generates figures
src/mGST/algorithm.py - GST utilities → Numerical kernels: calls kernels
src/mGST/additional_fns.py - Manifold optimization → Numerical kernels: calls kernels
src/mGST/optimization.py - Qiskit bridge → Quantum backend: builds circuits for
- GST reporting → GST reconstruction: runs reconstruction
src/mGST/reporting/reporting.py - GST reporting → pyGSTi bridge: converts models
src/mGST/reporting/reporting.py - GST reporting → GST utilities: samples data
src/mGST/reporting/reporting.py - GST figures → GST reporting: uses report data
src/mGST/reporting/figure_gen.py