How open-mmlab/mmrazor works
MMRazor is an OpenMMLab model-compression toolkit for NAS, pruning, knowledge distillation, and quantization. Its principal workflow is to configure a compression method for a vision model, run the applicable search or training process, and obtain a compressed or quantized model. Shared model components, task modules, and registries support these methods. The README documents the major capabilities and plug-and-play design; the sampled source excerpts show selected search, delivery, recording, and graph behavior, not every algorithm’s runtime wiring.
Main entry points: nas Architecture Search · distillers Distillers · quantization Quantization Algorithms · architectures Model Architectures
Components 30
Workflow
- Method Configs
configs - Training Entry
tools/train.py - Training Loops
mmrazor/engine/runner - Compressed Model
Search and Pruning
- Architecture Search
mmrazor/models/algorithms/nas - Search Loops
mmrazor/engine/runner - Metric Predictors
mmrazor/models/task_modules/predictor/handler - Pruning Algorithms
mmrazor/models/algorithms/pruning - Group Fisher
mmrazor/implementations/pruning/group_fisher
Distillation
- Distillation Algorithms
mmrazor/models/algorithms/distill/configurable - Distillers
mmrazor/models/distillers - Distillation Losses
mmrazor/models/losses - Distillation Delivery
mmrazor/models/task_modules/delivery/delivery_manager.py - Model Recorders
mmrazor/models/task_modules/recorder/recorder_manager.py
Quantization
- Quantization Algorithms
mmrazor/models/algorithms/quantization - Quantizers
mmrazor/models/quantizers - Fake Quantizers
mmrazor/models/fake_quants - Quantization Observers
mmrazor/models/observers - GPTQ Compression
mmrazor/implementations/quantization/gptq/gptq.py
Shared Model Services
- Model Architectures
mmrazor/models/architectures - Dynamic Operations
mmrazor/models/architectures/dynamic_ops - Mutable Components
mmrazor/models/mutables - Model Mutators
mmrazor/models/mutators - Module Graph
mmrazor/structures/graph/module_graph.py - CRD Dataset
mmrazor/datasets/crd_dataset_wrapper.py - Component Registry
mmrazor/registry/registry.py - Module Registration
mmrazor/utils/setup_env.py - BN Calibration
mmrazor/engine/runner/utils/calibrate_bn_mixin.py
Other components
- Model Engineer
- Vision Project
Connections 31
- Model Engineer → Method Configs: configures
README.md - Method Configs → Training Entry: runs with
- Training Entry → Training Loops: launches
- Training Loops → Compressed Model: produces
- Vision Project → Architecture Search: integrates with
README.md - Vision Project → Pruning Algorithms: integrates with
README.md - Vision Project → Distillation Algorithms: integrates with
README.md - Vision Project → Quantization Algorithms: integrates with
README.md - Architecture Search → Compressed Model: searches
README.md - Pruning Algorithms → Compressed Model: slims
README.md - Distillation Algorithms → Compressed Model: distills
README.md - Quantization Algorithms → Compressed Model: quantizes
README.md - Search Loops → Metric Predictors: uses
- Architecture Search → Model Mutators: uses
- Pruning Algorithms → Group Fisher: includes
README.md - Distillation Algorithms → Distillers: uses
- Distillers → Distillation Losses: computes with
- Distillers → Distillation Delivery: coordinates
- Distillers → Model Recorders: records with
- Quantization Algorithms → Quantizers: uses
- Quantizers → Fake Quantizers: uses
- Quantizers → Quantization Observers: uses
- Quantization Algorithms → GPTQ Compression: includes
- Architecture Search → Model Architectures: searches
- Model Architectures → Dynamic Operations: uses
mmrazor/models/architectures/dynamic_ops/__init__.py - Model Architectures → Mutable Components: contains
- Model Mutators → Mutable Components: controls
- Module Graph → Model Architectures: traces
mmrazor/structures/graph/module_graph.py - CRD Dataset → Vision Project: provides samples
- Module Registration → Component Registry: registers modules
mmrazor/utils/setup_env.py - Search Loops → BN Calibration: calibrates with
mmrazor/engine/runner/utils/__init__.py