How vbookshelf/jai-world-vrm-3d-embodied-ai works
Jai World is a Flask-backed, browser-based 3D embodied-AI experience. The user controls Y-bot and chats with AI-controlled X-bot; each chat turn uses the browser’s world-state snapshot, a selected model can issue tool calls, and resulting actions are sent back for the world to enact. The graph also preserves the documented vision, exploration, block manipulation, and walking/dancing capabilities. Backend excerpts show tool dispatch and queued actions; the frontend implementation is unsampled, so its internal wiring is represented only where the README documents it.
Main entry points: openrouter-app.py OpenRouter Backend · ollama-app.py Ollama Backend · index.html World Interface · models VRM Avatars
Components 13
3D World
- World Interface
Jai-World-v1.0/templates/index.html - VRM Avatars
Jai-World-v1.0/static/models - Rumba Animation
Jai-World-v1.0/static/animations/rumba-dancing.fbx - Chat and Console
Jai-World-v1.0/templates/index.html
AI Agent
- Avatar Movement
Jai-World-v1.0/openrouter-app.py - Block Actions
Jai-World-v1.0/openrouter-app.py - Location Tools
Jai-World-v1.0/openrouter-app.py - World Vision
Jai-World-v1.0/openrouter-app.py
Model Backends
- OpenRouter Backend
Jai-World-v1.0/openrouter-app.py - Ollama Backend
Jai-World-v1.0/ollama-app.py
Other components
- User
- OpenRouter Model
- Ollama Service
Connections 20
- User → World Interface: controls
README.md - User → Chat and Console: chats with
README.md - World Interface → VRM Avatars: loads models
README.md - World Interface → Rumba Animation: plays dance
README.md - Chat and Console → OpenRouter Backend: sends chat state
README.md - Chat and Console → Ollama Backend: sends chat state
README.md - OpenRouter Backend → OpenRouter Model: requests completion
Jai-World-v1.0/openrouter-app.py - Ollama Backend → Ollama Service: requests completion
Jai-World-v1.0/ollama-app.py - OpenRouter Backend → Avatar Movement: dispatches tools
Jai-World-v1.0/openrouter-app.py - OpenRouter Backend → Block Actions: dispatches tools
Jai-World-v1.0/openrouter-app.py - OpenRouter Backend → Location Tools: dispatches tools
Jai-World-v1.0/openrouter-app.py - OpenRouter Backend → World Vision: dispatches tools
Jai-World-v1.0/openrouter-app.py - Ollama Backend → Avatar Movement: dispatches tools
Jai-World-v1.0/ollama-app.py - Ollama Backend → Block Actions: dispatches tools
Jai-World-v1.0/ollama-app.py - Ollama Backend → Location Tools: dispatches tools
Jai-World-v1.0/ollama-app.py - Ollama Backend → World Vision: dispatches tools
Jai-World-v1.0/ollama-app.py - Avatar Movement → World Interface: queues actions
Jai-World-v1.0/openrouter-app.py - Block Actions → World Interface: queues actions
Jai-World-v1.0/openrouter-app.py - Location Tools → World Interface: reports location info
README.md - World Vision → Chat and Console: returns images
README.md