How tencent-hunyuan/hy-world-2.0 works
HY-World 2.0 generates persistent 3D worlds from text or a single image, and reconstructs 3D scenes from multi-view images or video. Generation proceeds through panorama creation, trajectory planning, world expansion, and Gaussian-splat composition; reconstruction runs WorldMirror inference and saves visual and geometric outputs. The README documents the generation stages, while the indexed source references support the shown reconstruction wiring. Several generation links are therefore documented capability-level relationships rather than inspected call sites.
Main entry points: pipelines World Expansion · worldmirror.py WorldMirror Core · panogen Panorama Generation · pipeline.py Inference Pipeline
Components 22
World Generation
- Panorama Generation
hyworld2/panogen - Trajectory Planning
hyworld2/worldgen/traj_generate.py - World Expansion
hyworld2/worldgen/models/pipelines - WorldStereo
hyworld2/worldgen/models/worldstereo.py - PCD Keyframes
hyworld2/worldgen/models/pipelines/pipeline_pcd_keyframe.py - DMD Keyframes
hyworld2/worldgen/models/pipelines/pipeline_dmd_keyframe.py - Reference Keyframes
hyworld2/worldgen/models/pipelines/pipeline_ref_keyframe.py - Gaussian Composition
hyworld2/worldgen/world_gs_trainer.py - Splat Processing
hyworld2/worldgen/gs - Meshes and 3DGS
hyworld2/worldgen/gs/extract_mesh.py
Panorama Models
- HY-Pano Model
hyworld2/panogen/hunyuan_image_3/modeling_hunyuan_image_3.py - Qwen Panorama
hyworld2/panogen/qwen_image/pipeline_qwen_pano.py
World Reconstruction
- Reconstruction App
hyworld2/worldrecon/gradio_app.py - Inference Pipeline
hyworld2/worldrecon/pipeline.py - 3D and Visual Outputs
hyworld2/worldrecon/hyworldmirror/utils/inference_utils.py
WorldMirror Model
- WorldMirror Core
hyworld2/worldrecon/hyworldmirror/models/models/worldmirror.py - Transformer Blocks
hyworld2/worldrecon/hyworldmirror/models/layers/block.py - Dense Predictions
hyworld2/worldrecon/hyworldmirror/models/heads/dense_head.py - Camera Predictions
hyworld2/worldrecon/hyworldmirror/models/heads/camera_head.py - Gaussian Predictions
hyworld2/worldrecon/hyworldmirror/models/heads/gs_head.py
Other components
- Text or Image Creator
- Multi-view or Video
Connections 20
- Text or Image Creator → Panorama Generation: starts generation
- Panorama Generation → HY-Pano Model: uses panorama model
hyworld2/panogen/hunyuan_image_3/modeling_hunyuan_image_3.py - Panorama Generation → Qwen Panorama: uses panorama model
- Panorama Generation → Trajectory Planning: plans trajectory
- Trajectory Planning → World Expansion: guides expansion
- World Expansion → WorldStereo: runs WorldStereo
hyworld2/worldgen/models/pipelines/pipeline_pcd_keyframe.py - World Expansion → PCD Keyframes: offers keyframe pipeline
hyworld2/worldgen/models/pipelines/pipeline_pcd_keyframe.py - World Expansion → DMD Keyframes: offers keyframe pipeline
hyworld2/worldgen/models/pipelines/pipeline_dmd_keyframe.py - World Expansion → Reference Keyframes: offers keyframe pipeline
hyworld2/worldgen/models/pipelines/pipeline_ref_keyframe.py - World Expansion → Gaussian Composition: composes world
- Gaussian Composition → Splat Processing: processes splats
hyworld2/worldgen/world_gs_trainer.py - Splat Processing → Meshes and 3DGS: exports meshes
hyworld2/worldgen/gs/extract_mesh.py - Multi-view or Video → Reconstruction App: submits views
- Reconstruction App → Inference Pipeline: calls inference
hyworld2/worldrecon/gradio_app.py - Inference Pipeline → WorldMirror Core: runs model
hyworld2/worldrecon/pipeline.py - WorldMirror Core → Transformer Blocks: uses transformer blocks
hyworld2/worldrecon/hyworldmirror/models/models/worldmirror.py - WorldMirror Core → Dense Predictions: predicts dense maps
hyworld2/worldrecon/hyworldmirror/models/models/worldmirror.py - WorldMirror Core → Camera Predictions: predicts cameras
hyworld2/worldrecon/hyworldmirror/models/models/worldmirror.py - WorldMirror Core → Gaussian Predictions: predicts Gaussians
hyworld2/worldrecon/hyworldmirror/models/models/worldmirror.py - Inference Pipeline → 3D and Visual Outputs: saves predictions
hyworld2/worldrecon/hyworldmirror/utils/inference_utils.py