How khanh02-vin/smart-cam works
SmartCamMobile is a React Native camera-coaching shell. The user grants camera and add-only photo-library permissions, views a live preview, and can capture/save a photo; frame samples go through MobileCoachBridge to the coaching core and resulting guidance is drawn as a Skia overlay. Pose inference is intended to use an optional local iOS MediaPipe provider, but the README says it is not yet verified and the current UI fails closed. The coaching-core source is outside this file tree, so its internal stages are not expanded here.
Main entry points: App.tsx Mobile app · PoseLandmarkerProvider.ts Provider registry · SmartCamPoseLandmarker.nitro.ts Nitro pose contract · SmartCamPoseLandmarker.swift iOS MediaPipe provider
Components 10
Camera and capture
- Camera preview
- Mobile app
App.tsx - Photo library
Coaching interface
- Frame bridge
src/MobileCoachBridge.ts - Pose overlay
src/PoseOverlay.tsx
Pose provider
- Provider registry
src/PoseLandmarkerProvider.ts - Nitro pose contract
src/SmartCamPoseLandmarker.nitro.ts - iOS MediaPipe provider
smartcam-pose/ios/SmartCamPoseLandmarker.swift
Other components
- Camera user
- MediaPipe Tasks Vision
Connections 12
- Camera user → Mobile app: uses
README.md - Mobile app → Camera preview: configures preview
App.tsx - Camera preview → Mobile app: delivers frames
App.tsx - Mobile app → Frame bridge: processes frames
App.tsx - Mobile app → Provider registry: initializes provider
App.tsx - Mobile app → Provider registry: requests pose
App.tsx - Provider registry → Nitro pose contract: uses contract
src/PoseLandmarkerProvider.ts - Nitro pose contract → iOS MediaPipe provider: implemented by
README.md - iOS MediaPipe provider → MediaPipe Tasks Vision: runs inference
smartcam-pose/ios/SmartCamPoseLandmarker.swift - Mobile app → Pose overlay: renders guidance
App.tsx - Mobile app → Photo library: saves captured photo
App.tsx - Camera user → Photo library: grants add permission
README.md