# jeongwoo0328/non-contact-vla-system architecture

> Architecture diagram of the GitHub repository jeongwoo0328/non-contact-vla-system, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-19). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jeongwoo0328/non-contact-vla-system
- Repository: https://github.com/jeongwoo0328/non-contact-vla-system

## Overview

VLAsystem is a vision-language-action robotics experiment system: it analyzes an image into scene/object data, accepts user commands, routes them to conversation or robot skills, and sends actions to simulation and optionally Arduino hardware. The graph preserves documented perception stages, memory, semantic analysis, and the skill set. Some subsystem links come from the README or SOURCE INDEX rather than inspected implementations; those are cited accordingly, and uncertain links are omitted.

Main entry points: [`phi_reasoning_module.py`](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/phi_reasoning_module.py) (Command Router and Planner), [`main.py`](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/main.py) (Pipeline and Command Loop), [`perception_core.py`](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/perception_core.py) (Vision 3D), [`skills/target_skill.py`](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/target_skill.py) (Target Skill Logic)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_perception["Scene Perception"]
  node_vision["Vision 3D<br/>[perception_core.py]"]
  node_scene["Scene Objects"]
end

subgraph group_reasoning["Language and Memory"]
  node_main["Pipeline and Command Loop<br/>[main.py]"]
  node_reasoner["Command Router and Planner"]
  node_semantic["Semantic Analyzer"]
  node_words["Word Mapping Data<br/>[words_data.json]"]
  node_memory["Conversation Memory<br/>[memory_manager.py]"]
  node_memory_store[("Memory State")]
end

subgraph group_skills["Robot Skills"]
  node_look["Look Skill<br/>[look.py]"]
  node_point["Point Skill<br/>[point.py]"]
  node_target["Target Skill Logic<br/>[target_skill.py]"]
  node_raise_low["Raise Lower Skill<br/>[raise_low.py]"]
  node_motion["Motion Skill<br/>[motion.py]"]
  node_grasp["Grasp Skill<br/>[grasp.py]"]
  node_idle["Idle Skill<br/>[idle.py]"]
end

subgraph group_execution["Robot Execution"]
  node_geometry["Robot Geometry<br/>[robot_geometry.py]"]
  node_sim["PyBullet Simulator<br/>[pybullet_module.py]"]
  node_arduino["Arduino Servo Firmware<br/>[sketch_jul12a.ino]"]
end

node_user(("User"))
node_camera(("Image Input"))
node_servos["Servo Hardware"]

node_camera -->|"provides image"| node_vision
node_vision -->|"produces objects"| node_scene
node_main -->|"initializes and processes"| node_vision
node_user -->|"enters commands"| node_main
node_main -->|"routes requests"| node_reasoner
node_scene -->|"provides scene data"| node_reasoner
node_reasoner -->|"uses analysis"| node_semantic
node_reasoner -->|"uses memory"| node_memory
node_memory -->|"persists state"| node_memory_store
node_reasoner -->|"dispatches skill"| node_look
node_reasoner -->|"dispatches skill"| node_point
node_reasoner -->|"dispatches skill"| node_raise_low
node_reasoner -->|"dispatches skill"| node_motion
node_reasoner -->|"dispatches skill"| node_grasp
node_reasoner -->|"dispatches skill"| node_idle
node_look -->|"uses targeting"| node_target
node_point -->|"uses targeting"| node_target
node_target -->|"converts coordinates"| node_geometry
node_reasoner -->|"plans actions for"| node_sim
node_main -->|"executes actions"| node_sim
node_sim -->|"uses coordinates"| node_geometry
node_main -->|"synchronizes commands"| node_arduino
node_arduino -->|"controls servos"| node_servos

click node_vision "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/perception_core.py"
click node_main "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/main.py"
click node_reasoner "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/phi_reasoning_module.py"
click node_semantic "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/semantic_analyzer.py"
click node_words "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/words_data.json"
click node_memory "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/memory_manager.py"
click node_look "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/look.py"
click node_point "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/point.py"
click node_target "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/target_skill.py"
click node_raise_low "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/raise_low.py"
click node_motion "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/motion.py"
click node_grasp "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/grasp.py"
click node_idle "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/idle.py"
click node_geometry "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/robot_geometry.py"
click node_sim "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/pybullet_module.py"
click node_arduino "https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/sketch_jul12a.ino"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_vision,node_scene,node_user toneBlue
class node_main,node_reasoner,node_semantic,node_words,node_memory,node_memory_store toneAmber
class node_look,node_point,node_target,node_raise_low,node_motion,node_grasp,node_idle toneMint
class node_geometry,node_sim,node_arduino toneRose
class node_camera,node_servos toneIndigo
```

## Components

### Scene Perception

- [Vision 3D](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/perception_core.py): `perception_core.py`
- **Scene Objects**

### Language and Memory

- [Pipeline and Command Loop](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/main.py): `main.py`
- [Command Router and Planner](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/phi_reasoning_module.py): `phi_reasoning_module.py`
- [Semantic Analyzer](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/semantic_analyzer.py): `semantic_analyzer.py`
- [Word Mapping Data](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/words_data.json): `words_data.json`
- [Conversation Memory](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/memory_manager.py): `memory_manager.py`
- **Memory State**

### Robot Skills

- [Look Skill](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/look.py): `skills/look.py`
- [Point Skill](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/point.py): `skills/point.py`
- [Target Skill Logic](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/target_skill.py): `skills/target_skill.py`
- [Raise Lower Skill](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/raise_low.py): `skills/raise_low.py`
- [Motion Skill](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/motion.py): `skills/motion.py`
- [Grasp Skill](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/grasp.py): `skills/grasp.py`
- [Idle Skill](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/skills/idle.py): `skills/idle.py`

### Robot Execution

- [Robot Geometry](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/robot_geometry.py): `robot_geometry.py`
- [PyBullet Simulator](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/pybullet_module.py): `pybullet_module.py`
- [Arduino Servo Firmware](https://github.com/jeongwoo0328/non-contact-vla-system/blob/main/sketch_jul12a.ino): `sketch_jul12a.ino`

### Other components

- **User**
- **Image Input**
- **Servo Hardware**

## Connections

- Image Input → Vision 3D: provides image (evidence: `README.md`)
- Vision 3D → Scene Objects: produces objects (evidence: `README.md`)
- Pipeline and Command Loop → Vision 3D: initializes and processes (evidence: `main.py`)
- User → Pipeline and Command Loop: enters commands (evidence: `README.md`)
- Pipeline and Command Loop → Command Router and Planner: routes requests (evidence: `main.py`)
- Scene Objects → Command Router and Planner: provides scene data (evidence: `README.md`)
- Command Router and Planner → Semantic Analyzer: uses analysis (evidence: `phi_reasoning_module.py`)
- Command Router and Planner → Conversation Memory: uses memory (evidence: `phi_reasoning_module.py`)
- Conversation Memory → Memory State: persists state (evidence: `README.md`)
- Command Router and Planner → Look Skill: dispatches skill (evidence: `phi_reasoning_module.py`)
- Command Router and Planner → Point Skill: dispatches skill (evidence: `phi_reasoning_module.py`)
- Command Router and Planner → Raise Lower Skill: dispatches skill (evidence: `phi_reasoning_module.py`)
- Command Router and Planner → Motion Skill: dispatches skill (evidence: `phi_reasoning_module.py`)
- Command Router and Planner → Grasp Skill: dispatches skill (evidence: `phi_reasoning_module.py`)
- Command Router and Planner → Idle Skill: dispatches skill (evidence: `phi_reasoning_module.py`)
- Look Skill → Target Skill Logic: uses targeting (evidence: `skills/look.py`)
- Point Skill → Target Skill Logic: uses targeting (evidence: `skills/point.py`)
- Target Skill Logic → Robot Geometry: converts coordinates (evidence: `skills/target_skill.py`)
- Command Router and Planner → PyBullet Simulator: plans actions for (evidence: `README.md`)
- Pipeline and Command Loop → PyBullet Simulator: executes actions (evidence: `main.py`)
- PyBullet Simulator → Robot Geometry: uses coordinates (evidence: `pybullet_module.py`)
- Pipeline and Command Loop → Arduino Servo Firmware: synchronizes commands (evidence: `main.py`)
- Arduino Servo Firmware → Servo Hardware: controls servos (evidence: `README.md`)
