How hemanthvsp1/describeit works
DescribeIt offers web and native-mobile clients for capturing or selecting an image, requesting a mode-specific explanation, and presenting it visually and through speech. The Express service exposes /api/describe, selects general, reading, safety, navigation, or PDF prompts, and calls Anthropic; both clients submit to that route. The web client also supports history and demo/upload flows, while the mobile app provides camera capture, mode selection, speech, and haptic feedback. README describes a different Next.js layout and /api/analyze; the graph follows the supplied tree and sampled implementation, so unsampled feature wiring is omitted.
Main entry points: index.tsx Mobile capture flow · server.js Image analysis route · app.js Web capture and modes · api.ts Mobile API client
Components 19
Web experience
- Web capture and modes
public/js/app.js - Results and history
public/js/app.js - Web app shell
public/index.html
Mobile experience
- Mobile capture flow
mobile/app/index.tsx - Camera controls
mobile/components/CaptureButton.tsx - Mode selector
mobile/components/ModeToggle.tsx - Result card
mobile/components/ResultCard.tsx - Mobile API client
mobile/utils/api.ts
Analysis service
- Express service
server.js - Image analysis route
server.js - Analysis prompts
server.js
Accessibility and delivery
- Browser speech
public/js/app.js - Mobile speech
mobile/hooks/useSpeech.ts - Voice command stub
mobile/hooks/useVoiceCommand.ts - Offline shell worker
public/sw.js
Other components
- Web user
- Mobile user
- Anthropic vision model
- Device camera
Connections 21
- Web user → Web capture and modes: captures or uploads
- Web capture and modes → Device camera: captures image
- Web capture and modes → Image analysis route: posts image
- Image analysis route → Analysis prompts: selects prompt
- Image analysis route → Anthropic vision model: submits image
- Anthropic vision model → Image analysis route: returns description
- Image analysis route → Web capture and modes: returns description
- Web capture and modes → Results and history: displays and records
- Results and history → Browser speech: speaks result
- Web user → Mobile capture flow: captures photo
- Mobile capture flow → Camera controls: invokes capture
- Mobile capture flow → Mode selector: selects mode
- Mobile capture flow → Mobile API client: sends photo and mode
- Mobile API client → Image analysis route: posts image
- Image analysis route → Mobile API client: returns description
- Mobile API client → Mobile capture flow: returns description
- Mobile capture flow → Result card: shows result
- Mobile capture flow → Mobile speech: speaks result
- Mobile capture flow → Voice command stub: checks support
- Express service → Web app shell: serves web assets
- Web capture and modes → Offline shell worker: registers worker