How shootthesound/comfyui-realtime-lora works
This ComfyUI custom-node toolkit trains LoRAs, analyzes and selectively applies them, and edits model layers and selected model components. The main workflow starts in ComfyUI: a user supplies training data and settings, a trainer invokes a chosen backend and produces a LoRA; users can then analyze/load LoRAs or edit model components in generation workflows. The README documents capabilities beyond the sampled excerpts; those branches are included, but only evidenced relationships are drawn.
Main entry points: sdxl_lora_trainer.py sd-scripts trainers · musubi_zimage_lora_trainer.py Musubi trainers · lora_analyzer_v2.py Combined analyzer · realtime_lora_trainer.py AI-Toolkit trainer
Components 24
LoRA training
- AI-Toolkit trainer
realtime_lora_trainer.py - sd-scripts trainers
sdxl_lora_trainer.py - Musubi trainers
musubi_zimage_lora_trainer.py - Musubi dataset config
musubi_zimage_config_template.py - sd-scripts config
sdxl_config_template.py
LoRA analysis and loading
- LoRA analyzer
lora_analyzer.py - Combined analyzer
lora_analyzer_v2.py - Quantization helpers
quant_utils.py - Selective loaders
selective_lora_loader.py - Scheduled loader
scheduled_lora_loader.py
Model editing
- Model layer editor
model_layer_analyzer.py - FLUX Klein editor
flux_klein_debiaser_node.py - FLUX VAE editor
flux_vae_debiaser_node.py - Z-Image editor
zimage_deep_debiaser_node.py - Qwen3 4B editor
qwen3_4b_text_encoder_debiaser_node.py - Qwen3 8B editor
qwen3_8b_text_encoder_debiaser_node.py
Encoder inspection
- FLUX VAE inspector
flux_vae_inspector_node.py - Qwen3 4B inspector
qwen3_4b_text_encoder_inspector_node.py - Qwen3 8B inspector
qwen3_8b_text_encoder_inspector_node.py
Other components
- ComfyUI user
- ComfyUI workflows
- AI-Toolkit
- sd-scripts
- Musubi Tuner
Connections 24
- ComfyUI user → ComfyUI workflows: builds workflows
README.md - ComfyUI workflows → AI-Toolkit trainer: starts training
README.md - ComfyUI workflows → sd-scripts trainers: starts training
README.md - ComfyUI workflows → Musubi trainers: starts training
README.md - AI-Toolkit trainer → AI-Toolkit: invokes backend
README.md - sd-scripts trainers → sd-scripts: invokes backend
README.md - Musubi trainers → Musubi Tuner: invokes backend
musubi_zimage_lora_trainer.py - Musubi trainers → Musubi dataset config: imports config
musubi_zimage_lora_trainer.py - sd-scripts trainers → sd-scripts config: imports config
sdxl_lora_trainer.py - ComfyUI workflows → LoRA analyzer: analyzes LoRAs
README.md - ComfyUI workflows → Combined analyzer: analyzes LoRAs
README.md - ComfyUI workflows → Selective loaders: loads LoRAs
README.md - ComfyUI workflows → Scheduled loader: schedules strength
README.md - Combined analyzer → Quantization helpers: uses helpers
lora_analyzer_v2.py - Combined analyzer → Selective loaders: imports loader
lora_analyzer_v2.py - ComfyUI workflows → Model layer editor: edits model layers
README.md - ComfyUI workflows → FLUX Klein editor: edits FLUX Klein
README.md - ComfyUI workflows → FLUX VAE editor: edits VAE
README.md - ComfyUI workflows → Z-Image editor: edits Z-Image
- ComfyUI workflows → Qwen3 4B editor: edits encoder
- ComfyUI workflows → Qwen3 8B editor: edits encoder
- ComfyUI workflows → FLUX VAE inspector: inspects VAE
README.md - ComfyUI workflows → Qwen3 4B inspector: inspects encoder
README.md - ComfyUI workflows → Qwen3 8B inspector: inspects encoder
README.md