How arjun-thekkethil11/syncsentry works
SyncSentry analyzes uploaded video for audio/video drift, applies corrections where confidence permits, independently verifies the result, and optionally corrects captions. The web app submits files and presents previews, status, and downloads; the analyzer also exposes API and CLI entry points. The README documents piecewise and wide-range detection capabilities, though their internal wiring is only partly visible in the sampled source, so the graph shows only supported relationships. Some frontend and API implementation details were not sampled.
Main entry points: pipeline.py Fix pipeline · api.py HTTP API · client.ts API client · UploadForm.tsx Upload form
Components 21
Web interface
- Web app
webapp/src/App.tsx - Analyze page
webapp/src/pages/Analyze.tsx - Upload form
webapp/src/components/UploadForm.tsx - API client
webapp/src/api/client.ts - Results panel
webapp/src/components/ResultsPanel.tsx
Analyzer entry points
- HTTP API
analyzer/syncsentry/api.py - CLI
analyzer/syncsentry/cli.py - Fix pipeline
analyzer/syncsentry/pipeline.py
Sync detection
- Coarse correlation
analyzer/syncsentry/detectors/coarse_xcorr.py - SyncNet offset
analyzer/syncsentry/lipsync/syncnet_offset.py - Speaker and face analysis
analyzer/syncsentry/lipsync - Piecewise offsets
analyzer/syncsentry/lipsync/piecewise_offset.py - Wide-range offsets
analyzer/syncsentry/lipsync/wide_range_offset.py - Caption drift
analyzer/syncsentry/captions/drift_check.py
Correction and output
- A/V correction
analyzer/syncsentry/fixer/av_fix.py - Piecewise correction
analyzer/syncsentry/fixer/piecewise_fix.py - Caption correction
analyzer/syncsentry/fixer/caption_fix.py - Summary report
analyzer/syncsentry/report/summary.py
Other components
- User
- Video and optional captions
- Browser
Connections 24
- User → Web app: opens
- Web app → Analyze page: routes to
- User → Upload form: selects files
- Analyze page → Upload form: presents
- Upload form → API client: submits
- API client → HTTP API: POST /v1/fix
- Video and optional captions → HTTP API: uploads
- HTTP API → Fix pipeline: runs
- CLI → Fix pipeline: runs
- Fix pipeline → Coarse correlation: estimates offset
- Fix pipeline → SyncNet offset: optionally estimates
- SyncNet offset → Speaker and face analysis: uses face and speech analysis
- Fix pipeline → Piecewise offsets: checks segment offsets
- Fix pipeline → Wide-range offsets: extends offset search
- Fix pipeline → A/V correction: applies A/V correction
- Fix pipeline → Coarse correlation: remeasures correction
- Fix pipeline → Caption drift: checks caption drift
- Fix pipeline → Caption correction: corrects captions
- Fix pipeline → Piecewise correction: corrects segments
- Fix pipeline → Summary report: builds summary
- HTTP API → API client: returns result
- API client → Results panel: provides result
- Results panel → Browser: previews and downloads
- Browser → HTTP API: fetches output