How jeongwoo0328/non-contact-vla-system works
VLAsystem is a vision-language-action robotics experiment system: it analyzes an image into scene/object data, accepts user commands, routes them to conversation or robot skills, and sends actions to simulation and optionally Arduino hardware. The graph preserves documented perception stages, memory, semantic analysis, and the skill set. Some subsystem links come from the README or SOURCE INDEX rather than inspected implementations; those are cited accordingly, and uncertain links are omitted.
Main entry points: phi_reasoning_module.py Command Router and Planner · main.py Pipeline and Command Loop · perception_core.py Vision 3D · target_skill.py Target Skill Logic
Components 21
Scene Perception
- Vision 3D
perception_core.py - Scene Objects
Language and Memory
- Pipeline and Command Loop
main.py - Command Router and Planner
phi_reasoning_module.py - Semantic Analyzer
semantic_analyzer.py - Word Mapping Data
words_data.json - Conversation Memory
memory_manager.py - Memory State
Robot Skills
- Look Skill
skills/look.py - Point Skill
skills/point.py - Target Skill Logic
skills/target_skill.py - Raise Lower Skill
skills/raise_low.py - Motion Skill
skills/motion.py - Grasp Skill
skills/grasp.py - Idle Skill
skills/idle.py
Robot Execution
- Robot Geometry
robot_geometry.py - PyBullet Simulator
pybullet_module.py - Arduino Servo Firmware
sketch_jul12a.ino
Other components
- User
- Image Input
- Servo Hardware
Connections 23
- Image Input → Vision 3D: provides image
README.md - Vision 3D → Scene Objects: produces objects
README.md - Pipeline and Command Loop → Vision 3D: initializes and processes
main.py - User → Pipeline and Command Loop: enters commands
README.md - Pipeline and Command Loop → Command Router and Planner: routes requests
main.py - Scene Objects → Command Router and Planner: provides scene data
README.md - Command Router and Planner → Semantic Analyzer: uses analysis
phi_reasoning_module.py - Command Router and Planner → Conversation Memory: uses memory
phi_reasoning_module.py - Conversation Memory → Memory State: persists state
README.md - Command Router and Planner → Look Skill: dispatches skill
phi_reasoning_module.py - Command Router and Planner → Point Skill: dispatches skill
phi_reasoning_module.py - Command Router and Planner → Raise Lower Skill: dispatches skill
phi_reasoning_module.py - Command Router and Planner → Motion Skill: dispatches skill
phi_reasoning_module.py - Command Router and Planner → Grasp Skill: dispatches skill
phi_reasoning_module.py - Command Router and Planner → Idle Skill: dispatches skill
phi_reasoning_module.py - Look Skill → Target Skill Logic: uses targeting
skills/look.py - Point Skill → Target Skill Logic: uses targeting
skills/point.py - Target Skill Logic → Robot Geometry: converts coordinates
skills/target_skill.py - Command Router and Planner → PyBullet Simulator: plans actions for
README.md - Pipeline and Command Loop → PyBullet Simulator: executes actions
main.py - PyBullet Simulator → Robot Geometry: uses coordinates
pybullet_module.py - Pipeline and Command Loop → Arduino Servo Firmware: synchronizes commands
main.py - Arduino Servo Firmware → Servo Hardware: controls servos
README.md