How sayan4496/transcadence works
TransCadence turns an uploaded English video into a Hindi-dubbed MP4 with synchronized SRT subtitles. The frontend uploads and then exposes translation, processing, status polling, and download; the backend handles upload-time validation, audio extraction, and word-timed transcription, followed by Hindi translation and the dubbing pipeline. The main pipeline orchestrates speech generation, timing adjustment, audio composition, subtitles, video rendering, and synchronization checks. The README documents those capabilities; some service-to-service calls are supported only by its workflow description or the source index, so those edges are marked as documented rather than inferred from filenames.
Main entry points: job_processing_service.py Dubbing orchestrator · upload.py Video upload · main.py API application · api.ts API client
Components 25
Web interface
- Dubbing workspace
frontend/src/App.tsx - API client
frontend/src/api.ts - Local job history
frontend/src/jobs.ts
Backend API
- API application
backend/app/main.py - Video upload
backend/app/api/upload.py - Transcription route
backend/app/api/transcribe.py - Translation route
backend/app/api/translate.py - Job routes
backend/app/api/jobs.py
Speech and translation
- Word-timed ASR
backend/app/services/asr_service.py - Hindi translation
backend/app/services/translation_service.py - Cadence alignment
backend/app/services/sync_service.py - Hindi speech TTS
backend/app/services/tts_service.py
Media composition
- Video validation
backend/app/services/video_service.py - Audio extraction
backend/app/services/audio_service.py - Dubbing orchestrator
backend/app/services/job_processing_service.py - Audio adjustment
backend/app/services/audio_adjustment_service.py - Timeline audio mix
backend/app/services/audio_mix_service.py - SRT subtitles
backend/app/services/srt_service.py - Dubbed video render
backend/app/services/video_generation_service.py - Sync validation
backend/app/services/sync_validation_service.py
Job and files
- Local media files
Other components
- Video user
- Google Gemini
- Piper voice model
- FFmpeg
Connections 31
- Video user → Dubbing workspace: uploads video
Readme.MD - Dubbing workspace → API client: requests API
frontend/src/App.tsx - Dubbing workspace → Local job history: updates history
frontend/src/App.tsx - API client → Video upload: POST upload
Readme.MD - API client → Translation route: POST translate
Readme.MD - API client → Job routes: process, poll, download
Readme.MD - API application → Video upload: registers route
backend/app/main.py - API application → Transcription route: registers route
backend/app/main.py - API application → Translation route: registers route
backend/app/main.py - API application → Job routes: registers route
backend/app/main.py - Video upload → Video validation: validates video
backend/app/api/upload.py - Video upload → Audio extraction: extracts audio
backend/app/api/upload.py - Video upload → Word-timed ASR: transcribes audio
backend/app/api/upload.py - Video upload → Local media files: stores upload and transcript
backend/app/api/upload.py - Transcription route → Word-timed ASR: transcribes job
backend/app/api/transcribe.py - Translation route → Hindi translation: translates segments
backend/app/api/translate.py - Hindi translation → Google Gemini: generates translation
backend/app/services/translation_service.py - Job routes → Dubbing orchestrator: processes job
backend/app/api/jobs.py - Dubbing orchestrator → Cadence alignment: aligns speech windows
Readme.MD - Dubbing orchestrator → Hindi speech TTS: synthesizes Hindi
Readme.MD - Hindi speech TTS → Piper voice model: synthesizes voice
backend/app/services/tts_service.py - Dubbing orchestrator → Audio adjustment: fits clip duration
backend/app/services/job_processing_service.py - Audio adjustment → FFmpeg: applies atempo
backend/app/services/audio_adjustment_service.py - Dubbing orchestrator → Timeline audio mix: composes timeline audio
backend/app/services/job_processing_service.py - Dubbing orchestrator → SRT subtitles: writes subtitles
backend/app/services/job_processing_service.py - Dubbing orchestrator → Dubbed video render: renders final video
backend/app/services/job_processing_service.py - Dubbed video render → FFmpeg: encodes video
backend/app/services/video_generation_service.py - Dubbed video render → Video validation: reads video metadata
backend/app/services/video_generation_service.py - Dubbing orchestrator → Sync validation: checks synchronization
Readme.MD - Dubbing orchestrator → Local media files: reads and writes job artifacts
backend/app/services/job_processing_service.py - Job routes → Local media files: returns status and download
Readme.MD