How yazinsai/tilawa works
Tilawa is an offline Quran-recitation recognition product: callers provide 16 kHz audio and receive verse matches, transcript and progress events. The primary path is audio chunks into a core session, through Zipformer inference and streaming phoneme/verse tracking, then events to a caller or the web interface. FastConformer is a documented alternate engine for one-shot transcription. The frontend adds word-level correction and reporting. Core relationships are supported by the README and indexed imports; some runtime wiring is not shown in the sampled excerpts, so uncertain links are omitted.
Main entry points: session.ts Recognition session · engine.ts Streaming engine · main.ts Web interface · search.ts Verse search
Components 25
Session API
- Recognition session
packages/core/src/recitation/session.ts - FastConformer session
packages/core/src/session.ts
Audio inference
- Frame posteriors
packages/core/src/recitation/posteriors.ts - Zipformer runner
packages/core/src/recitation/zipformerRunner.ts - Feature extraction
packages/core/src/recitation/fbank.ts
Verse recognition
- Streaming engine
packages/core/src/recitation/engine.ts - Engine settings
packages/core/src/recitation/config.ts - Verse corpus
packages/core/src/recitation/corpus.ts - CTC decoding
packages/core/src/recitation/ctcDecoder.ts - Phoneme alignment
packages/core/src/recitation/alignment.ts - Phoneme costs
packages/core/src/recitation/phonemeCost.ts - Verse search
packages/core/src/recitation/search.ts - Word tracker
packages/core/src/recitation/tracker.ts - Correction analysis
packages/core/src/recitation/correction.ts - Slip detection
packages/core/src/recitation/slipHead.ts - Structural checks
packages/core/src/recitation/structural.ts - Display Quran data
packages/core/src/quran-db.ts - FastConformer tracker
packages/core/src/tracker.ts
Web experience
- Web interface
web/frontend/src/main.ts - Web session worker
web/frontend/src/worker/zipformer-session.ts - Correction view
web/frontend/src/correction-view.ts - User reports
web/frontend/src/report-dialog.ts - Microphone chunks
web/frontend/public/audio-processor.js
Other components
- Audio caller
- ONNX Runtime
Connections 24
- Audio caller → Recognition session: feeds audio
README.md - Recognition session → Streaming engine: streams chunks
packages/core/src/recitation/session.ts - Streaming engine → CTC decoding: expands tokens
packages/core/src/recitation/engine.ts - Streaming engine → Phoneme alignment: aligns text
packages/core/src/recitation/engine.ts - Streaming engine → Word tracker: tracks words
packages/core/src/recitation/engine.ts - Streaming engine → Verse search: locates verses
packages/core/src/recitation/engine.ts - Verse search → Phoneme alignment: aligns candidates
packages/core/src/recitation/search.ts - Verse search → Phoneme costs: scores phonemes
packages/core/src/recitation/search.ts - Recognition session → Verse corpus: loads corpus
packages/core/src/recitation/session.ts - Recognition session → Display Quran data: resolves display data
packages/core/src/recitation/session.ts - Recognition session → Structural checks: checks structure
packages/core/src/recitation/session.ts - Recognition session → Slip detection: uses slip head
packages/core/src/recitation/session.ts - Recognition session → Frame posteriors: processes posteriors
packages/core/src/recitation/session.ts - Recognition session → Zipformer runner: runs Zipformer
README.md - Zipformer runner → ONNX Runtime: runs ONNX
README.md - Recognition session → Feature extraction: extracts features
packages/core/src/recitation/session.ts - Recognition session → FastConformer session: selects alternate engine
README.md - FastConformer session → FastConformer tracker: tracks transcript
- Recognition session → Correction analysis: analyzes corrections
packages/core/src/recitation/session.ts - Microphone chunks → Web session worker: sends chunks
- Web interface → Web session worker: starts session
- Web session worker → Recognition session: creates session
web/frontend/src/worker/zipformer-session.ts - Web interface → Correction view: shows corrections
web/frontend/src/main.ts - Web interface → User reports: opens report
web/frontend/src/main.ts