How wwbing/vehicleterminal works
This repository is an embedded Qt in-vehicle terminal paired with an optional modular voice assistant. The user-facing workflow runs from the Qt main window into navigation, media, weather, and monitoring features; the voice workflow recognizes speech, interprets it with an offline LLM, and synthesizes spoken output, with ZeroMQ connecting the AI services. README-level architecture and capabilities are documented, but most application source was not sampled, so subsystem links below rely on those documented relationships rather than inspected calls.
Main entry points: mainwindow.cpp Qt Main Window · ZmqClient.cpp ZeroMQ Messaging · musicplayer.cpp Music Player · monitor.cpp Environment Monitor
Components 27
Vehicle Terminal
- Qt Main Window
VehicleTerminal/mainwindow.cpp - Application Entry
VehicleTerminal/main.cpp - Settings
VehicleTerminal/settingwindow.cpp - Music Player
VehicleTerminal/Music/musicplayer.cpp - Music Search
VehicleTerminal/Music/searchmusic.cpp - Map Navigation
VehicleTerminal/Map/baidumap.cpp - Weather
VehicleTerminal/Weather/weather.cpp - Environment Monitor
VehicleTerminal/Monitor/monitor.cpp - Camera Capture
VehicleTerminal/Monitor/capture_thread.cpp - Speech Interface
VehicleTerminal/speechrecognition.cpp
Voice Interaction
- Speech Recognition
LLM_Voice_Flow/voice/sherpa-onnx - Language Recognition
LLM_Voice_Flow/voice/sherpa-onnx - Instruction Parsing
LLM_Voice_Flow - Offline LLM
LLM_Voice_Flow/llm/rknn-llm - ZeroMQ Messaging
LLM_Voice_Flow/zmq-comm-kit/src/ZmqClient.cpp - Speech Synthesis
LLM_Voice_Flow/tts/tts_server/src/main.cpp
Hardware Access
- GPS Interface
VehicleTerminal/Map/gps.c - Sensor Drivers
驱动/dht11_driver/dht11_dri.c - I2C Sensor Access
VehicleTerminal/Monitor/i2cbusses.c - RK3576 NPU
- Camera Device
- Vehicle Speakers
External Services
- Network APIs
- Baidu Maps
- Music API
- Weather API
Other components
- Driver
Connections 32
- Driver → Qt Main Window: interacts
- Application Entry → Qt Main Window: creates
VehicleTerminal/main.cpp - Qt Main Window → Settings: dispatches
- Qt Main Window → Music Player: dispatches
- Qt Main Window → Map Navigation: dispatches
- Qt Main Window → Weather: dispatches
- Qt Main Window → Environment Monitor: dispatches
- Music Player → Music Search: searches
- Music Player → Music API: requests
- Map Navigation → GPS Interface: reads location
- Map Navigation → Baidu Maps: displays maps
- Weather → Weather API: requests forecast
- Environment Monitor → Sensor Drivers: reads environment
- Environment Monitor → I2C Sensor Access: reads sensor
- Environment Monitor → Camera Capture: shows video
- Camera Capture → Camera Device: captures video
- Driver → Speech Interface: speaks
- Speech Interface → Speech Recognition: sends audio
- Speech Recognition → Language Recognition: recognizes language
- Speech Recognition → ZeroMQ Messaging: sends transcript
- Language Recognition → ZeroMQ Messaging: sends language
- ZeroMQ Messaging → Offline LLM: routes transcript
- Offline LLM → Instruction Parsing: interprets request
- Offline LLM → RK3576 NPU: runs inference
- Instruction Parsing → ZeroMQ Messaging: routes instruction
LLM_Voice_Flow/zmq-comm-kit/src/ZmqClient.cpp - Offline LLM → ZeroMQ Messaging: sends response
- ZeroMQ Messaging → Speech Synthesis: routes text
LLM_Voice_Flow/tts/tts_server/src/main.cpp - Speech Synthesis → Vehicle Speakers: plays audio
LLM_Voice_Flow/tts/tts_server/src/main.cpp - Speech Synthesis → ZeroMQ Messaging: reports playback
LLM_Voice_Flow/tts/tts_server/src/main.cpp - Instruction Parsing → Qt Main Window: controls features
- Weather → Network APIs: uses network
- Music Player → Network APIs: uses network