How aws-solutions-library-samples/guidance-for-real-time-multilingual-subtitling-for-live-video-on-aws works
The product is an AWS-backed live multilingual subtitling system. A live video source enters MediaConnect/MediaLive and MediaPackage for encoding and HLS delivery; a separate UDP audio receiver transcribes and translates speech, stores subtitle segments, and serves them as WebVTT for the player. The README also documents authentication, reset/control, and adaptive playback capabilities. Links between runtime audio ingestion and its deployment, and some frontend API behavior, are not fully visible in sampled source; those uncertain integrations are omitted rather than treated as confirmed calls.
Main entry points: udp-audio-receiver-stack.js Subtitle table · app.js Video player · index.js WebVTT delivery API · base-live-streaming-stack.js WebVTT CDN
Components 18
Live video delivery
- Live input
lib/medialive-stack.js - MediaLive encoding
lib/medialive-stack.js - MediaPackage HLS
lib/base-live-streaming-stack.js - HLS CDN
lib/base-live-streaming-stack.js
Subtitle processing
- UDP audio receiver
lib/udp-audio-receiver-stack.js - Transcription and translation
lib/IBC2025_Subtitle_v3.js - Subtitle table
lib/udp-audio-receiver-stack.js - WebVTT delivery API
lib/lambdas/webvtt-delivery/index.js - WebVTT augmentation
lib/lambdas/webvtt-edge/index.mjs - WebVTT CDN
lib/base-live-streaming-stack.js
Viewer experience
- Player hosting
lib/video-player-stack.js - Video player
lib/front-end/video-player/app.js - Cognito authentication
lib/cognito-stack.js
System control
- Reset and cleanup
lib/lambdas/video-reset/index.js - Receiver infrastructure
lib/udp-audio-receiver-stack.js - Player deployment
lib/deploy-stack.js
Other components
- Stream operator
- Viewer
Connections 18
- Stream operator → Live input: sends live feed
README.md - Live input → MediaLive encoding: ingested by
README.md - MediaLive encoding → MediaPackage HLS: packages stream
lib/medialive-stack.js - MediaPackage HLS → HLS CDN: origin delivery
lib/base-live-streaming-stack.js - UDP audio receiver → Transcription and translation: feeds audio
- Transcription and translation → Subtitle table: stores segments
- WebVTT delivery API → Subtitle table: queries captions
lib/lambdas/webvtt-delivery/index.js - WebVTT delivery API → MediaPackage HLS: fetches VTT timing
lib/lambdas/webvtt-delivery/index.js - WebVTT CDN → WebVTT delivery API: routes VTT requests
lib/base-live-streaming-stack.js - WebVTT CDN → WebVTT augmentation: invokes at origin
lib/base-live-streaming-stack.js - Viewer → Player hosting: opens player
README.md - Video player → HLS CDN: plays HLS
README.md - Video player → WebVTT CDN: loads subtitles
lib/front-end/video-player/app.js - Video player → Cognito authentication: redirects to login
lib/front-end/video-player/app.js - Player hosting → Cognito authentication: OAuth callback configured
lib/cognito-stack.js - Receiver infrastructure → Subtitle table: creates table
lib/udp-audio-receiver-stack.js - Player deployment → Player hosting: deploys frontend
lib/deploy-stack.js - Reset and cleanup → Subtitle table: deletes items
lib/lambdas/video-reset/index.js