How shashank-mcw/torch-mlir works
Torch-MLIR is a PyTorch-to-MLIR compiler bridge. Its user-facing workflow imports models through FX or ONNX into the Torch dialect, then provides transformations and lowerings to backend-oriented dialects such as Linalg, StableHLO, TOSA, and TMTensor. The repository also includes TorchScript/JIT importing and a lazy-tensor backend, plus a reference backend and registration APIs. The README establishes FX and ONNX as entry points; some downstream connections are shown only where the source index or excerpts support them.
Main entry points: TorchOps.cpp Torch dialect · Transforms Torch transforms · InitAll.cpp Dialect and pass registry · mlir_lowering_context.cpp Lazy backend
Components 18
Model import
- FX API
python/torch_mlir/fx.py - FX importer
python/torch_mlir/extras/fx_importer.py - ONNX importer
projects/onnx_c_importer/OnnxImporter.cpp - JIT importer
projects/jit_ir_common/csrc/jit_ir_importer/function_importer.cpp
Torch IR
- Torch dialect
lib/Dialect/Torch/IR/TorchOps.cpp - Torch types
lib/Dialect/Torch/IR/TorchTypes.cpp - Torch transforms
lib/Dialect/Torch/Transforms
Lowering
- ONNX conversion
lib/Conversion/TorchOnnxToTorch/DefaultDomainQtoZ.cpp - Linalg lowering
lib/Conversion/TorchToLinalg/Uncategorized.cpp - TMTensor lowering
lib/Conversion/TorchToTMTensor/TorchToTMTensor.cpp - Other lowerings
lib/Conversion - TMTensor dialect
lib/Dialect/TMTensor/IR/TMTensorOps.cpp
Backend integration
- Dialect and pass registry
lib/InitAll.cpp - C API
lib/CAPI/Registration.cpp - Reference backend
lib/RefBackend/RefBackend.cpp - Lazy backend
projects/ltc/csrc/base_lazy_backend/mlir_lowering_context.cpp
Other components
- PyTorch models
- ONNX models
Connections 19
- PyTorch models → FX API: supplies graph
README.md - FX API → FX importer: calls importer
python/torch_mlir/fx.py - FX importer → Torch dialect: creates operations
python/torch_mlir/extras/fx_importer.py - ONNX models → ONNX importer: supplies model
README.md - ONNX importer → ONNX conversion: imports ONNX ops
- ONNX conversion → Torch dialect: rewrites to Torch ops
- JIT importer → Torch dialect: imports JIT IR
- Torch dialect → Torch types: uses types
- Torch transforms → Torch dialect: rewrites operations
lib/Dialect/Torch/Transforms/ScalarizeShapes.cpp - Torch dialect → Linalg lowering: lowers operations
lib/Conversion/TorchToLinalg/Uncategorized.cpp - Torch dialect → TMTensor lowering: lowers operations
lib/Conversion/TorchToTMTensor/TorchToTMTensor.cpp - TMTensor lowering → TMTensor dialect: creates operations
lib/Conversion/TorchToTMTensor/TorchToTMTensor.cpp - Torch dialect → Other lowerings: supports conversion
- Dialect and pass registry → Torch dialect: registers dialect
lib/InitAll.cpp - Dialect and pass registry → Other lowerings: registers passes
lib/InitAll.cpp - C API → Torch dialect: exposes operations
- Lazy backend → JIT importer: imports function
projects/ltc/csrc/base_lazy_backend/mlir_lowering_context.cpp - Lazy backend → Torch transforms: verifies module
projects/ltc/csrc/base_lazy_backend/mlir_lowering_context.cpp - Reference backend → Torch transforms: uses backend contract
lib/RefBackend/RefBackend.cpp