How bhargeshjani03/huffman-coding works
This is a lossless Huffman-compression system for MNIST model parameters, with a Flask dashboard for running compression and inspecting results. The main workflow trains an MNIST model, extracts its tensor bytes and reconstruction manifest, compresses them into a HUFC container, then decodes and verifies bytes, weights, and predictions while recording metrics. The graph preserves the Huffman implementation layers and the dashboard’s analysis branch. Source excerpts show the integration and core codec calls; some training and frontend wiring is documented or indexed but not excerpted, so uncertain links are omitted or marked dashed.
Main entry points: integrate_mnist.py Integration Runner · app.py Dashboard API · encoder.py Payload Encoder · huffman_tree.py Huffman Tree
Components 19
MNIST Model
- MNIST Training
scripts/train_mnist.py - MNIST Model
src/model.py
Huffman Codec
- Byte Frequencies
src/frequency.py - Huffman Tree
src/huffman_tree.py - Min Heap
src/min_heap.py - Tree Nodes
src/node.py - Payload Encoder
src/encoder.py - Bitstream Packing
src/bitstream.py - HUFC Container
src/container_format.py - Container Decoder
src/decoder.py
Compression Workflow
- Integration Runner
scripts/integrate_mnist.py - Tensor Payload
src/tensor_payload.py - Verification
src/verification.py - Compression Metrics
src/metrics.py - Model Artifacts
checkpoints
Dashboard
- Dashboard API
web/app.py - Dashboard UI
web/static/script.js
Other components
- User
- MNIST Dataset
Connections 24
- MNIST Training → MNIST Model: trains
scripts/train_mnist.py - MNIST Training → MNIST Dataset: uses data
- Integration Runner → MNIST Model: loads weights
scripts/integrate_mnist.py - Integration Runner → Tensor Payload: extracts bytes
scripts/integrate_mnist.py - Integration Runner → HUFC Container: builds container
scripts/integrate_mnist.py - Integration Runner → Container Decoder: decodes container
scripts/integrate_mnist.py - Integration Runner → Verification: verifies reconstruction
scripts/integrate_mnist.py - Integration Runner → Compression Metrics: calculates metrics
scripts/integrate_mnist.py - Integration Runner → Model Artifacts: reads and writes
scripts/integrate_mnist.py - Integration Runner → MNIST Dataset: evaluates on
scripts/integrate_mnist.py - HUFC Container → Payload Encoder: encodes payload
src/container_format.py - Payload Encoder → Byte Frequencies: counts bytes
src/encoder.py - Payload Encoder → Huffman Tree: builds codebook
src/encoder.py - Payload Encoder → Bitstream Packing: packs codes
src/encoder.py - Huffman Tree → Min Heap: uses priority queue
src/huffman_tree.py - Huffman Tree → Tree Nodes: creates nodes
src/huffman_tree.py - Container Decoder → HUFC Container: reads format constants
src/decoder.py - Verification → MNIST Model: rebuilds model
src/verification.py - Dashboard API → Model Artifacts: reads results and container
web/app.py - Dashboard API → Container Decoder: analyzes payload
web/app.py - Dashboard API → Huffman Tree: builds analysis tree
web/app.py - Dashboard API → Integration Runner: runs compression
web/app.py - User → Dashboard API: requests dashboard
web/app.py - Dashboard UI → Dashboard API: calls API