How beruk-ggg/brain-eye-arm works
Brain-Eye-Arm is a camera-guided shape-sorting system: the operator views live detections and requests a pick; vision turns camera frames into tracked, robot-coordinate parts, and a worker runs a retryable pick-and-place cycle through the Dobot TCP server. The map follows that workflow and includes the detector’s model, measurement, and calibration layers. Edges reflect the excerpts or README; unsampled capabilities and internals are represented only where documented, not inferred from filenames.
Main entry points: detector.py Shape detector · web.py Flask HMI · service.py Vision service · config.py Runtime configuration
Components 19
Vision
- Basler camera
vision/camera.py - Vision service
app/service.py - Shape detector
vision/detector.py - ONNX inference
vision/onnx_model.py - Orientation measure
vision/orientation.py - Color classifier
vision/color.py - Coordinate calibration
vision/calibration.py - Shape model
vision/shapes.py - Centroid tracker
vision/tracker.py
Operator app
- Flask HMI
app/web.py - HMI page
app/static/hmi.js - Detection overlay
app/overlay.py - Pick selection
app/selection.py - Pick worker
app/pick_worker.py
Robot control
- Pick-and-place controller
robot/picker.py - Robot TCP client
robot/client.py - Dobot TCP server
server_script/dobot_tcp_server.py
Configuration
- Runtime configuration
config.py
Other components
- Operator
Connections 21
- Operator → HMI page: uses
README.md - HMI page → Flask HMI: requests
README.md - Basler camera → Vision service: supplies frames
app/service.py - Vision service → Shape detector: detects frames
app/service.py - Shape detector → ONNX inference: runs inference
vision/detector.py - Shape detector → Orientation measure: measures tilt
vision/detector.py - Shape detector → Color classifier: classifies color
vision/detector.py - Shape detector → Coordinate calibration: maps coordinates
vision/detector.py - Shape detector → Shape model: builds detections
vision/detector.py - Vision service → Centroid tracker: updates tracks
app/service.py - Flask HMI → Vision service: reads snapshots
README.md - Flask HMI → Detection overlay: draws detections
app/web.py - Flask HMI → Pick selection: filters picks
app/web.py - Flask HMI → Pick worker: submits jobs
README.md - Pick worker → Vision service: pauses and redetects
app/pick_worker.py - Pick worker → Pick-and-place controller: runs cycle
app/pick_worker.py - Pick-and-place controller → Robot TCP client: sends robot commands
robot/picker.py - Robot TCP client → Dobot TCP server: TCP protocol
robot/client.py - Runtime configuration → Shape detector: configures
main.py - Runtime configuration → Pick-and-place controller: sets targets and motion
main.py - Runtime configuration → Robot TCP client: sets connection
main.py