# ayin1412/forzahorizon6-visionai architecture

> Architecture diagram of the GitHub repository ayin1412/forzahorizon6-visionai, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-03). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/ayin1412/forzahorizon6-visionai
- Repository: https://github.com/ayin1412/forzahorizon6-visionai

## Overview

This repository is a camera-only closed-loop Forza Horizon 6 driving agent, with a training path for producing geometry-mediated driving models. At runtime, the driver combines game imagery with telemetry, invokes the network, and sends control through a virtual Xbox gamepad; optional trajectory overlay and state broadcasting support inspection. The README also describes line, waypoint, speed-profile, slip, and control outputs. Training derives targets from recordings and optimizes the same network. Connections for unsampled capture, actuation, and dashboard wiring are omitted where excerpts do not establish the implementation details.

Main entry points: [`scripts/drive.py`](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py) (Realtime driver), [`scripts/train.py`](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/train.py) (Training pipeline), [`scripts/model.py`](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py) (DrivingNet), [`data/models/model_30.pt`](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/data/models/model_30.pt) (Released weights)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_runtime["Driving runtime"]
  node_telemetry["Game telemetry<br/>[drive.py]"]
  node_frames["Camera frames<br/>[drive.py]"]
  node_driver["Realtime driver<br/>[drive.py]"]
  node_gamepad["Virtual gamepad<br/>[drive.py]"]
end

subgraph group_network["Geometry model"]
  node_model["DrivingNet<br/>[model.py]"]
  node_visual["Visual backbone<br/>[model.py]"]
  node_geometry["Geometry heads<br/>[model.py]"]
  node_control["Control heads<br/>[model.py]"]
  node_weights["Released weights<br/>[model_30.pt]"]
  node_metadata["Model metadata<br/>[meta.json]"]
end

subgraph group_training["Training"]
  node_recordings["Driving recordings"]
  node_trainer["Training pipeline<br/>[train.py]"]
  node_dataset[("Derived dataset<br/>[train.py]")]
end

subgraph group_inspection["Inspection"]
  node_trajectory["Trajectory overlay<br/>[drive.py]"]
  node_broadcaster["State broadcaster<br/>[drive.py]"]
  node_dashboard["Dashboard UI<br/>[dashboard.html]"]
end

node_game(("Forza game"))

node_game -.->|"provides view"| node_frames
node_game -.->|"provides telemetry"| node_telemetry
node_frames -.->|"feeds images"| node_driver
node_telemetry -.->|"provides state"| node_driver
node_driver -->|"invokes"| node_model
node_model -->|"extracts features"| node_visual
node_visual -->|"predicts geometry"| node_geometry
node_geometry -->|"feeds detached inputs"| node_control
node_driver -.->|"sends controls"| node_gamepad
node_driver -.->|"loads checkpoint"| node_weights
node_driver -->|"reads configuration"| node_metadata
node_recordings -->|"supplies examples"| node_trainer
node_trainer -->|"derives targets"| node_dataset
node_trainer -->|"trains"| node_model
node_driver -->|"updates waypoints"| node_trajectory
node_driver -->|"publishes state"| node_broadcaster
node_broadcaster -.->|"serves dashboard data"| node_dashboard

click node_telemetry "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py"
click node_frames "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py"
click node_driver "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py"
click node_gamepad "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py"
click node_model "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py"
click node_visual "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py"
click node_geometry "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py"
click node_control "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py"
click node_weights "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/data/models/model_30.pt"
click node_metadata "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/data/models/meta.json"
click node_trainer "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/train.py"
click node_dataset "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/train.py"
click node_trajectory "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py"
click node_broadcaster "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py"
click node_dashboard "https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/ui/dashboard.html"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_telemetry,node_frames,node_driver,node_gamepad toneBlue
class node_model,node_visual,node_geometry,node_control,node_weights,node_metadata toneAmber
class node_recordings,node_trainer,node_dataset toneMint
class node_trajectory,node_broadcaster,node_dashboard toneRose
class node_game toneIndigo
```

## Components

### Driving runtime

- [Game telemetry](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py): `scripts/drive.py`
- [Camera frames](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py): `scripts/drive.py`
- [Realtime driver](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py): `scripts/drive.py`
- [Virtual gamepad](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py): `scripts/drive.py`

### Geometry model

- [DrivingNet](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py): `scripts/model.py`
- [Visual backbone](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py): `scripts/model.py`
- [Geometry heads](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py): `scripts/model.py`
- [Control heads](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/model.py): `scripts/model.py`
- [Released weights](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/data/models/model_30.pt): `data/models/model_30.pt`
- [Model metadata](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/data/models/meta.json): `data/models/meta.json`

### Training

- **Driving recordings**
- [Training pipeline](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/train.py): `scripts/train.py`
- [Derived dataset](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/train.py): `scripts/train.py`

### Inspection

- [Trajectory overlay](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py): `scripts/drive.py`
- [State broadcaster](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/drive.py): `scripts/drive.py`
- [Dashboard UI](https://github.com/ayin1412/forzahorizon6-visionai/blob/main/scripts/ui/dashboard.html): `scripts/ui/dashboard.html`

### Other components

- **Forza game**

## Connections

- Forza game → Camera frames: provides view (evidence: `README.md`)
- Forza game → Game telemetry: provides telemetry (evidence: `README.md`)
- Camera frames → Realtime driver: feeds images (evidence: `README.md`)
- Game telemetry → Realtime driver: provides state (evidence: `README.md`)
- Realtime driver → DrivingNet: invokes (evidence: `scripts/drive.py`)
- DrivingNet → Visual backbone: extracts features (evidence: `scripts/model.py`)
- Visual backbone → Geometry heads: predicts geometry (evidence: `scripts/model.py`)
- Geometry heads → Control heads: feeds detached inputs (evidence: `scripts/model.py`)
- Realtime driver → Virtual gamepad: sends controls (evidence: `scripts/drive.py`)
- Realtime driver → Released weights: loads checkpoint
- Realtime driver → Model metadata: reads configuration (evidence: `scripts/drive.py`)
- Driving recordings → Training pipeline: supplies examples (evidence: `scripts/train.py`)
- Training pipeline → Derived dataset: derives targets (evidence: `scripts/train.py`)
- Training pipeline → DrivingNet: trains (evidence: `scripts/train.py`)
- Realtime driver → Trajectory overlay: updates waypoints (evidence: `scripts/drive.py`)
- Realtime driver → State broadcaster: publishes state (evidence: `scripts/drive.py`)
- State broadcaster → Dashboard UI: serves dashboard data
