# fy403/webrtc architecture

> Architecture diagram of the GitHub repository fy403/webrtc, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/fy403/webrtc
- Repository: https://github.com/fy403/webrtc

## Overview

This is a low-latency remote-control system for RC vehicles. The principal workflow runs from browser input through WebRTC data channels to RC-frame parsing and motor actuation, with telemetry flowing back; a separate video/audio path streams vehicle media to the browser. Shell access uses its own WebRTC data channel, and signaling coordinates connection setup. The README documents these system-level links; source excerpts show selected receiver pipelines and motor-driver dispatch. Other source relationships are not inferred where the sampled evidence does not establish them.

Main entry points: [`signaling_server/nodejs/signaling-server.js`](https://github.com/fy403/webrtc/blob/radxa_3w/signaling_server/nodejs/signaling-server.js) (Signaling server), [`recv/av_track/src/webrtc_receiver.cpp`](https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/webrtc_receiver.cpp) (WebRTC receiver), [`web/data_rtc.js`](https://github.com/fy403/webrtc/blob/radxa_3w/web/data_rtc.js) (Data channel client), [`av_track/src/webrtc_publisher.cpp`](https://github.com/fy403/webrtc/blob/radxa_3w/av_track/src/webrtc_publisher.cpp) (WebRTC publisher)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_browser["Browser control"]
  node_controllers["Input controllers"]
  node_curve["Control curves<br/>[curve_manager.js]"]
  node_browser_data["Data channel client<br/>[data_rtc.js]"]
  node_browser_video["Video client<br/>[video_rtc.js]"]
  node_browser_cmd["Shell client<br/>[cmd_rtc.js]"]
end

subgraph group_connectivity["WebRTC connectivity"]
  node_signaling["Signaling server"]
end

subgraph group_media["Media streaming"]
  node_publisher["WebRTC publisher"]
  node_capture["Audio/video capture<br/>[video_capturer.cpp]"]
  node_receiver["WebRTC receiver"]
  node_video_pipeline["Video decode pipeline<br/>[video_pipeline.cpp]"]
  node_video_output["Virtual camera output<br/>[v4l2_output.cpp]"]
  node_audio_pipeline["Audio decode pipeline<br/>[audio_pipeline.cpp]"]
  node_audio_output["Audio output"]
end

subgraph group_vehicle["Vehicle control and telemetry"]
  node_data_main["Control service<br/>[main.cpp]"]
  node_rc_client["RC client<br/>[rc_client.cpp]"]
  node_motor_controller["Motor controller"]
  node_motor_drivers["Motor drivers<br/>[crsf_driver.cpp]"]
  node_telemetry["System telemetry<br/>[system_monitor.cpp]"]
end

subgraph group_remote["Remote services"]
  node_shell_service["Shell service<br/>[main.cpp]"]
  node_shell_executor["Command execution<br/>[shell_executor.cpp]"]
  node_mcp_protocol["MCP protocol<br/>[protocol.ts]"]
  node_mcp_client["Device client<br/>[device_client.ts]"]
end

node_operator(("Operator"))
node_vehicle{{"Vehicle hardware"}}

node_operator -->|"selects input"| node_controllers
node_controllers -.->|"shapes controls"| node_curve
node_controllers -->|"sends controls"| node_browser_data
node_browser_data -->|"exchanges setup"| node_signaling
node_browser_video -->|"exchanges setup"| node_signaling
node_browser_cmd -->|"exchanges setup"| node_signaling
node_publisher -->|"exchanges setup"| node_signaling
node_publisher -->|"publishes captured media"| node_capture
node_publisher -->|"streams media"| node_browser_video
node_browser_data -->|"sends RC frames"| node_rc_client
node_rc_client -->|"dispatches controls"| node_motor_controller
node_motor_controller -->|"selects driver"| node_motor_drivers
node_motor_drivers -.->|"actuates motors"| node_vehicle
node_rc_client -.->|"reads status"| node_telemetry
node_telemetry -->|"returns telemetry"| node_browser_data
node_browser_cmd -->|"sends commands"| node_shell_service
node_shell_service -.->|"executes commands"| node_shell_executor
node_receiver -->|"exchanges setup"| node_signaling
node_browser_video -->|"streams RTP"| node_receiver
node_receiver -->|"routes video"| node_video_pipeline
node_video_pipeline -->|"writes frames"| node_video_output
node_receiver -->|"routes audio"| node_audio_pipeline
node_audio_pipeline -->|"writes PCM"| node_audio_output
node_mcp_client -->|"uses protocol"| node_mcp_protocol

click node_controllers "https://github.com/fy403/webrtc/blob/radxa_3w/web/controller_manager.js"
click node_curve "https://github.com/fy403/webrtc/blob/radxa_3w/web/curve_manager.js"
click node_browser_data "https://github.com/fy403/webrtc/blob/radxa_3w/web/data_rtc.js"
click node_browser_video "https://github.com/fy403/webrtc/blob/radxa_3w/web/video_rtc.js"
click node_browser_cmd "https://github.com/fy403/webrtc/blob/radxa_3w/web/cmd_rtc.js"
click node_signaling "https://github.com/fy403/webrtc/blob/radxa_3w/signaling_server/nodejs/signaling-server.js"
click node_publisher "https://github.com/fy403/webrtc/blob/radxa_3w/av_track/src/webrtc_publisher.cpp"
click node_capture "https://github.com/fy403/webrtc/blob/radxa_3w/av_track/src/video_capturer.cpp"
click node_receiver "https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/webrtc_receiver.cpp"
click node_video_pipeline "https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/video_pipeline.cpp"
click node_video_output "https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/v4l2_output.cpp"
click node_audio_pipeline "https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/audio_pipeline.cpp"
click node_audio_output "https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/pulse_audio_output.cpp"
click node_data_main "https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/main.cpp"
click node_rc_client "https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/rc_client.cpp"
click node_motor_controller "https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/motor_controller.cpp"
click node_motor_drivers "https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/crsf_driver.cpp"
click node_telemetry "https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/system_monitor.cpp"
click node_shell_service "https://github.com/fy403/webrtc/blob/radxa_3w/cmd_track/src/main.cpp"
click node_shell_executor "https://github.com/fy403/webrtc/blob/radxa_3w/cmd_track/src/shell_executor.cpp"
click node_mcp_protocol "https://github.com/fy403/webrtc/blob/radxa_3w/recv/mcp/src/protocol.ts"
click node_mcp_client "https://github.com/fy403/webrtc/blob/radxa_3w/recv/mcp/src/device_client.ts"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_controllers,node_curve,node_browser_data,node_browser_video,node_browser_cmd toneBlue
class node_signaling toneAmber
class node_publisher,node_capture,node_receiver,node_video_pipeline,node_video_output,node_audio_pipeline,node_audio_output toneMint
class node_data_main,node_rc_client,node_motor_controller,node_motor_drivers,node_telemetry toneRose
class node_shell_service,node_shell_executor,node_mcp_protocol,node_mcp_client,node_operator,node_vehicle toneIndigo
```

## Components

### Browser control

- [Input controllers](https://github.com/fy403/webrtc/blob/radxa_3w/web/controller_manager.js): `web/controller_manager.js`
- [Control curves](https://github.com/fy403/webrtc/blob/radxa_3w/web/curve_manager.js): `web/curve_manager.js`
- [Data channel client](https://github.com/fy403/webrtc/blob/radxa_3w/web/data_rtc.js): `web/data_rtc.js`
- [Video client](https://github.com/fy403/webrtc/blob/radxa_3w/web/video_rtc.js): `web/video_rtc.js`
- [Shell client](https://github.com/fy403/webrtc/blob/radxa_3w/web/cmd_rtc.js): `web/cmd_rtc.js`

### WebRTC connectivity

- [Signaling server](https://github.com/fy403/webrtc/blob/radxa_3w/signaling_server/nodejs/signaling-server.js): `signaling_server/nodejs/signaling-server.js`

### Media streaming

- [WebRTC publisher](https://github.com/fy403/webrtc/blob/radxa_3w/av_track/src/webrtc_publisher.cpp): `av_track/src/webrtc_publisher.cpp`
- [Audio/video capture](https://github.com/fy403/webrtc/blob/radxa_3w/av_track/src/video_capturer.cpp): `av_track/src/video_capturer.cpp`
- [WebRTC receiver](https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/webrtc_receiver.cpp): `recv/av_track/src/webrtc_receiver.cpp`
- [Video decode pipeline](https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/video_pipeline.cpp): `recv/av_track/src/video_pipeline.cpp`
- [Virtual camera output](https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/v4l2_output.cpp): `recv/av_track/src/v4l2_output.cpp`
- [Audio decode pipeline](https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/audio_pipeline.cpp): `recv/av_track/src/audio_pipeline.cpp`
- [Audio output](https://github.com/fy403/webrtc/blob/radxa_3w/recv/av_track/src/pulse_audio_output.cpp): `recv/av_track/src/pulse_audio_output.cpp`

### Vehicle control and telemetry

- [Control service](https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/main.cpp): `data_track/src/main.cpp`
- [RC client](https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/rc_client.cpp): `data_track/src/rc_client.cpp`
- [Motor controller](https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/motor_controller.cpp): `data_track/src/motor_controller.cpp`
- [Motor drivers](https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/crsf_driver.cpp): `data_track/src/crsf_driver.cpp`
- [System telemetry](https://github.com/fy403/webrtc/blob/radxa_3w/data_track/src/system_monitor.cpp): `data_track/src/system_monitor.cpp`

### Remote services

- [Shell service](https://github.com/fy403/webrtc/blob/radxa_3w/cmd_track/src/main.cpp): `cmd_track/src/main.cpp`
- [Command execution](https://github.com/fy403/webrtc/blob/radxa_3w/cmd_track/src/shell_executor.cpp): `cmd_track/src/shell_executor.cpp`
- [MCP protocol](https://github.com/fy403/webrtc/blob/radxa_3w/recv/mcp/src/protocol.ts): `recv/mcp/src/protocol.ts`
- [Device client](https://github.com/fy403/webrtc/blob/radxa_3w/recv/mcp/src/device_client.ts): `recv/mcp/src/device_client.ts`

### Other components

- **Operator**
- **Vehicle hardware**

## Connections

- Operator → Input controllers: selects input (evidence: `README.md`)
- Input controllers → Control curves: shapes controls
- Input controllers → Data channel client: sends controls (evidence: `README.md`)
- Data channel client → Signaling server: exchanges setup (evidence: `README.md`)
- Video client → Signaling server: exchanges setup (evidence: `README.md`)
- Shell client → Signaling server: exchanges setup (evidence: `README.md`)
- WebRTC publisher → Signaling server: exchanges setup (evidence: `README.md`)
- WebRTC publisher → Audio/video capture: publishes captured media (evidence: `README.md`)
- WebRTC publisher → Video client: streams media (evidence: `README.md`)
- Data channel client → RC client: sends RC frames (evidence: `README.md`)
- RC client → Motor controller: dispatches controls (evidence: `data_track/src/motor_controller.cpp`)
- Motor controller → Motor drivers: selects driver (evidence: `data_track/src/motor_controller.cpp`)
- Motor drivers → Vehicle hardware: actuates motors
- RC client → System telemetry: reads status
- System telemetry → Data channel client: returns telemetry (evidence: `README.md`)
- Shell client → Shell service: sends commands (evidence: `README.md`)
- Shell service → Command execution: executes commands
- WebRTC receiver → Signaling server: exchanges setup (evidence: `README.md`)
- Video client → WebRTC receiver: streams RTP (evidence: `README.md`)
- WebRTC receiver → Video decode pipeline: routes video
- Video decode pipeline → Virtual camera output: writes frames (evidence: `recv/av_track/src/video_pipeline.cpp`)
- WebRTC receiver → Audio decode pipeline: routes audio
- Audio decode pipeline → Audio output: writes PCM (evidence: `recv/av_track/src/audio_pipeline.cpp`)
- Device client → MCP protocol: uses protocol (evidence: `recv/mcp/src/device_client.ts`)
