How asadmulani5/emotionverse works
EmotionVerse is a real-time emotion analytics application. A user selects an analysis mode, types text and grants camera access; the frontend sends captured frames and text over Socket.IO. The backend analyzes supplied modalities, combines scores for fusion results, and returns them for smoothing, timeline updates, and dashboard display. The backend also exposes separate REST prediction endpoints, including voice analysis, although the shown frontend does not capture or send audio. The graph follows the sampled source; it does not assume an unshown audio workflow.
Main entry points: App.js App and Socket Client · main.py API and Socket Handler · WebcamCapture.jsx Webcam Capture · EmotionDashboard.jsx Emotion Dashboard
Components 11
Frontend
- App and Socket Client
frontend/src/App.js - Webcam Capture
frontend/src/components/WebcamCapture.jsx - Emotion Dashboard
frontend/src/components/EmotionDashboard.jsx
Backend
- API and Socket Handler
backend/main.py
Emotion Models
- Text Analysis
backend/models/text_model.py - Face Analysis
backend/models/face_model.py - Voice Analysis
backend/models/voice_model.py - Weighted Fusion
backend/fusion.py
Results
- Smoothing and Timeline
frontend/src/App.js
Other components
- User
- Browser Camera
Connections 13
- User → App and Socket Client: enters text, selects mode
frontend/src/App.js - Browser Camera → Webcam Capture: provides video stream
frontend/src/components/WebcamCapture.jsx - App and Socket Client → Webcam Capture: renders, passes callback
frontend/src/App.js - Webcam Capture → App and Socket Client: sends captured frame
frontend/src/components/WebcamCapture.jsx - App and Socket Client → API and Socket Handler: emits analyze event
frontend/src/App.js - API and Socket Handler → App and Socket Client: emits emotion result
backend/main.py - API and Socket Handler → Text Analysis: calls prediction
backend/main.py - API and Socket Handler → Face Analysis: calls prediction
backend/main.py - API and Socket Handler → Voice Analysis: calls prediction
backend/main.py - API and Socket Handler → Weighted Fusion: passes modality scores
backend/main.py - App and Socket Client → Smoothing and Timeline: updates history and log
frontend/src/App.js - Smoothing and Timeline → Emotion Dashboard: supplies smoothed scores
frontend/src/App.js - App and Socket Client → Emotion Dashboard: renders results
frontend/src/App.js