How saberzahhar/kpviz works
KPViz is a local evaluation and paper-figure workbench for keyphrase prediction experiments. Users point it at cards, documents, and inference runs; the app incrementally scans and derives aligned evaluation data into DuckDB, then presents dataset, model, architecture, and issue views. The five research-question workbenches analyze runs and produce figures, tables, and exports. The graph follows documented capabilities and indexed references; unsampled page implementations are represented by their exact tree paths, without assuming their internal call flow.
Main entry points: appfactory.py Dash application · scanner.py Incremental scanner · insights.py Insights hub · figures.py Figure specifications
Components 26
Runtime and scanning
- CLI entry
kpviz/cli.py - Dash application
kpviz/appfactory.py - Incremental scanner
kpviz/scanner.py - Runtime settings
kpviz/config.py
Data and evaluation
- Card parsing
kpviz/cards.py - File ingestion
kpviz/ingest.py - Derived analysis
kpviz/derive.py - Text and tokenizers
kpviz/textproc.py - Run costs
kpviz/costs.py - DuckDB store
kpviz/db.py - Evaluation metrics
kpviz/metrics.py
Catalog views
- Overview
kpviz/pages/home.py - Dataset explorer
kpviz/pages/datasets.py - Model explorer
kpviz/pages/models.py - Architecture explorer
kpviz/pages/architectures.py
Research workbenches
- Insights hub
kpviz/pages/insights.py - Dataset agreement
kpviz/pages/rq/rq1.py - Data quality
kpviz/pages/rq/rq2.py - Context windows
kpviz/pages/rq/rq3.py - Quality vs cost
kpviz/pages/rq/rq4.py - Hyperparameters
kpviz/pages/rq/rq5.py - Statistical methods
kpviz/stats.py
Figures and export
- Figure specifications
kpviz/figures.py - UI components
kpviz/ui.py - Paper exports
kpviz/export.py
Other components
- Researcher
Connections 41
- Researcher → CLI entry: starts
README.md - CLI entry → Runtime settings: configures
kpviz/cli.py - CLI entry → Incremental scanner: scans
kpviz/cli.py - CLI entry → Dash application: launches
kpviz/cli.py - Researcher → Dash application: uses
README.md - Dash application → Incremental scanner: starts scan
kpviz/appfactory.py - Dash application → Overview: routes to
kpviz/appfactory.py - Dash application → Dataset explorer: routes to
kpviz/appfactory.py - Dash application → Model explorer: routes to
kpviz/appfactory.py - Dash application → Architecture explorer: routes to
kpviz/appfactory.py - Dash application → Insights hub: routes to
kpviz/appfactory.py - Incremental scanner → Card parsing: reads cards
kpviz/scanner.py - Incremental scanner → File ingestion: uses ingestion
kpviz/scanner.py - Incremental scanner → Derived analysis: derives data
kpviz/scanner.py - Incremental scanner → Text and tokenizers: processes text
kpviz/scanner.py - Incremental scanner → Run costs: calculates costs
kpviz/scanner.py - Incremental scanner → DuckDB store: writes index
kpviz/scanner.py - File ingestion → DuckDB store: stores records
kpviz/ingest.py - Derived analysis → Text and tokenizers: uses primitives
kpviz/derive.py - Overview → DuckDB store: reads catalog
kpviz/pages/home.py - Dataset explorer → Evaluation metrics: gets scores
kpviz/pages/datasets.py - Dataset explorer → DuckDB store: reads data
kpviz/pages/datasets.py - Architecture explorer → Run costs: shows costs
kpviz/pages/architectures.py - Insights hub → Dataset agreement: dispatches
kpviz/pages/insights.py - Insights hub → Data quality: dispatches
kpviz/pages/insights.py - Insights hub → Context windows: dispatches
kpviz/pages/insights.py - Insights hub → Quality vs cost: dispatches
kpviz/pages/insights.py - Insights hub → Hyperparameters: dispatches
kpviz/pages/insights.py - Dataset agreement → Statistical methods: tests results
kpviz/pages/rq/rq1.py - Data quality → Statistical methods: tests results
kpviz/pages/rq/rq2.py - Context windows → Statistical methods: tests results
kpviz/pages/rq/rq3.py - Quality vs cost → Statistical methods: tests results
kpviz/pages/rq/rq4.py - Hyperparameters → Statistical methods: tests results
kpviz/pages/rq/rq5.py - Dataset agreement → Evaluation metrics: scores runs
kpviz/pages/rq/rq1.py - Data quality → Figure specifications: builds figures
kpviz/pages/rq/rq2.py - Context windows → Figure specifications: builds figures
kpviz/pages/rq/rq3.py - Quality vs cost → Figure specifications: builds figures
kpviz/pages/rq/rq4.py - Hyperparameters → Figure specifications: builds figures
kpviz/pages/rq/rq5.py - UI components → Figure specifications: renders specs
kpviz/ui.py - UI components → Paper exports: offers export
kpviz/ui.py - Paper exports → Figure specifications: rerenders specs
kpviz/export.py