How stephen4513/interactive-lab-hub works
This repository is a collection of Interactive Device Design lab prototypes, not one integrated application. Its workflows range from Raspberry Pi hardware interactions and speech interfaces to camera-based observation and networked pixel/device interactions. The clearest internal call paths are the study assistant’s reuse of speech output, hand-pose tracking, the pixel server’s optional MQTT bridge, and the MQTT rule exercises. Many other lab scripts are listed but unsampled, so their connections are omitted rather than inferred.
Main entry points: common.py MQTT Shared Client · mqtt_bridge.py Pixel MQTT Bridge · app.py Collaborative Pixel Server · echo_bot.py Echo Voice Loop
Components 24
Hardware Prototypes
- Clock Prototypes
Lab 2 - Display and Sensors
Lab 2 - Physical Controls
Lab 4
Speech Interfaces
- Echo Voice Loop
Lab 3/speech-scripts/echo_bot.py - Study Assistant
Lab 3/speech-scripts/study_assistant.py - Speech Experiments
Lab 3/speech-scripts
Observant Systems
- Hand Tracking
Lab 5/HandTrackingModule.py - Gesture Volume Control
Lab 5/hand_pose.py - Camera-to-Qwen Pipeline
Lab 5/yolo_to_qwen.py - Vision Prototypes
Lab 5
Networked Interactions
- Collaborative Pixel Server
Lab 6/app.py - Pixel MQTT Bridge
Lab 6/mqtt_bridge.py - MQTT Viewer
Lab 6/mqtt_viewer.py - Pixel Publisher
Lab 6/pixel_grid_publisher.py - Device Descriptions
Lab 6/stretch/describe.py - Rule Compiler
Lab 6/stretch/compile_rule.py - MQTT Rule Runner
Lab 6/stretch/run_rule.py - MQTT Shared Client
Lab 6/stretch/common.py
Other components
- Device User
- Camera
- Ollama Service
- MQTT Broker
- WebSocket Clients
- Audio Devices
Connections 16
- Study Assistant → Echo Voice Loop: uses speaker
Lab 3/speech-scripts/study_assistant.py - Device User → Echo Voice Loop: speaks to
Lab 3/speech-scripts/echo_bot.py - Echo Voice Loop → Audio Devices: records and plays
Lab 3/speech-scripts/echo_bot.py - Device User → Study Assistant: operates
Lab 3/speech-scripts/study_assistant.py - Gesture Volume Control → Hand Tracking: uses landmarks
Lab 5/hand_pose.py - Camera → Camera-to-Qwen Pipeline: provides frames
Lab 5/yolo_to_qwen.py - Camera-to-Qwen Pipeline → Ollama Service: requests answer
Lab 5/yolo_to_qwen.py - Collaborative Pixel Server → WebSocket Clients: serves updates
Lab 6/app.py - Collaborative Pixel Server → Pixel MQTT Bridge: starts optionally
Lab 6/app.py - Pixel MQTT Bridge → MQTT Broker: subscribes
Lab 6/mqtt_bridge.py - Pixel MQTT Bridge → Collaborative Pixel Server: broadcasts updates
Lab 6/mqtt_bridge.py - Device Descriptions → MQTT Shared Client: connects through
Lab 6/stretch/describe.py - Rule Compiler → MQTT Shared Client: reads descriptions
Lab 6/stretch/compile_rule.py - MQTT Rule Runner → MQTT Shared Client: connects through
Lab 6/stretch/run_rule.py - MQTT Shared Client → MQTT Broker: connects
Lab 6/stretch/common.py - MQTT Rule Runner → MQTT Broker: subscribes and publishes
Lab 6/stretch/run_rule.py