How krushang004/intelliboard works
This is an interactive whiteboard prototype: users draw and operate tools with webcam-tracked hand gestures, keyboard fallbacks, or ESP32 buttons, then use OCR, arithmetic solving, speech, and PDF export on the canvas. The main loop coordinates the runtime, with tracking, gesture classification, canvas operations, and feature modules as distinct layers. README documents shape recognition, but the available tree and excerpts do not show an implementation, so it is omitted. Edges reflect explicit README flows and calls visible in excerpts; unsampled internals are not inferred.
Main entry points: main.py App loop · esp32_controller.py Serial controller · hand_tracker.py Hand tracker · pdf_export.py PDF export
Components 15
App control
- App loop
main.py - Runtime settings
config.py
Hand interaction
- Hand tracker
hand_tracker.py - Gesture classifier
gestures.py
Whiteboard
- Air canvas
air_canvas.py
Note features
- OCR engine
ocr_engine.py - Math solver
math_solver.py - Speech output
speech.py - PDF export
pdf_export.py - Saved notes
saved_notes
ESP32 controls
- Serial controller
esp32_controller.py
Other components
- Whiteboard user
- Webcam
- ESP32 board
esp32/whiteboard_controller/whiteboard_controller.ino - Keyboard
Connections 19
- Whiteboard user → Webcam: gestures
README.md - Webcam → App loop: video frames
main.py - App loop → Hand tracker: processes frames
main.py - Hand tracker → Gesture classifier: landmarks
- App loop → Gesture classifier: classifies hand
main.py - App loop → Air canvas: updates strokes
main.py - App loop → Runtime settings: reads settings
main.py - Whiteboard user → Keyboard: fallback commands
README.md - Keyboard → App loop: commands
main.py - Whiteboard user → ESP32 board: button input
README.md - ESP32 board → Serial controller: serial commands
README.md - Serial controller → App loop: reads commands
main.py - App loop → Serial controller: sends status
main.py - App loop → OCR engine: recognizes canvas
main.py - App loop → Math solver: solves expression
main.py - App loop → Speech output: speaks result
main.py - App loop → PDF export: exports canvas
main.py - PDF export → Saved notes: writes PDF
- App loop → OCR engine: math input OCR
main.py