# rafin14/pockettts architecture

> Architecture diagram of the GitHub repository rafin14/pockettts, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-30). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/rafin14/pockettts
- Repository: https://github.com/rafin14/pockettts

## Overview

Pocket TTS is an offline Android reader and voice-cloning app. The main flow sends Reader text through chunked speech generation to cached audio, then foreground playback and reader controls; Android TTS clients have a separate entry point into the shared engine. Voice creation records or imports audio, optionally extracts it from video, trims and reviews the sample, optionally denoises it, then saves a named voice for synthesis. The README documents these capabilities; unsampled UI and extraction details are shown at subsystem-directory granularity. Edges reflect README statements or the supplied source index and excerpts.

Main entry points: [`app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt`](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt) (Record & trim), [`app/src/main/java/org/pockettts/android/engine/ReaderPlaybackService.kt`](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ReaderPlaybackService.kt) (Reader playback), [`app/src/main/java/org/pockettts/android/engine/MainActivity.kt`](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/MainActivity.kt) (App UI), [`app/src/main/java/org/pockettts/android/engine/PocketEngine.kt`](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/PocketEngine.kt) (Shared engine)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_reader["Reader &amp; playback"]
  node_main["App UI<br/>[MainActivity.kt]"]
  node_chunker["Text chunking"]
  node_reader_service["Reader playback"]
  node_timeline["Audio timeline<br/>[AudioTimeline.kt]"]
  node_highlight["Reading highlight"]
end

subgraph group_speech["Speech runtime"]
  node_tts_service["TTS service"]
  node_engine["Shared engine<br/>[PocketEngine.kt]"]
  node_native_tts["Native Pocket TTS<br/>[NativePocketTts.kt]"]
  node_pocket_jni["Pocket JNI<br/>[jni_bridge.cpp]"]
  node_model_repo[("Model &amp; voice store")]
  node_bundled["Bundled models"]
end

subgraph group_voices["Voice creation"]
  node_recording["Record &amp; trim"]
  node_video_import["Video audio import"]
  node_video_dialog["Video import UI"]
end

subgraph group_audio["Audio processing"]
  node_wav_samples["WAV inspection<br/>[WavSamples.kt]"]
  node_pcm_wav["PCM WAV I/O<br/>[PcmWav.kt]"]
  node_denoiser["DeepFilter denoiser"]
  node_deepfilter_jni["DeepFilter JNI &amp; DSP<br/>[jni.cpp]"]
  node_deepfilter_dsp["DeepFilter DSP<br/>[deepfilter_dsp.cpp]"]
  node_kissfft["KissFFT<br/>[kiss_fft.c]"]
  node_resampler["Audio resampler<br/>[resampler.cpp]"]
  node_sample_preview["Sample preview<br/>[SamplePreview.kt]"]
end

node_reader_user(("Reader user"))
node_android_tts(("Android TTS client"))
node_voice_user(("Voice creator"))

node_reader_user -->|"edits text"| node_main
node_main -->|"starts playback"| node_reader_service
node_reader_service -->|"chunks text"| node_chunker
node_reader_service -->|"generates speech"| node_engine
node_reader_service -->|"tracks audio"| node_timeline
node_reader_service -->|"updates sections"| node_highlight
node_android_tts -->|"requests synthesis"| node_tts_service
node_tts_service -->|"synthesizes text"| node_engine
node_engine -->|"creates instance"| node_native_tts
node_native_tts -.->|"calls JNI"| node_pocket_jni
node_engine -->|"loads settings"| node_model_repo
node_bundled -->|"prepares models"| node_model_repo
node_voice_user -->|"chooses workflow"| node_main
node_main -->|"opens editor"| node_recording
node_video_dialog -.->|"extracts audio"| node_video_import
node_main -->|"opens import"| node_video_dialog
node_recording -->|"inspects sample"| node_wav_samples
node_recording -->|"reads and writes"| node_pcm_wav
node_recording -->|"enhances sample"| node_denoiser
node_recording -->|"previews audio"| node_sample_preview
node_recording -->|"saves voice"| node_model_repo
node_denoiser -.->|"runs enhancement"| node_deepfilter_jni
node_deepfilter_jni -->|"uses DSP"| node_deepfilter_dsp
node_deepfilter_dsp -->|"uses transforms"| node_kissfft
node_deepfilter_jni -.->|"resamples audio"| node_resampler

click node_main "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/MainActivity.kt"
click node_chunker "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ReaderTextChunker.kt"
click node_reader_service "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ReaderPlaybackService.kt"
click node_timeline "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/AudioTimeline.kt"
click node_highlight "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ReadingHighlight.kt"
click node_tts_service "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/PocketTtsService.kt"
click node_engine "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/PocketEngine.kt"
click node_native_tts "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/NativePocketTts.kt"
click node_pocket_jni "https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/jni_bridge.cpp"
click node_model_repo "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ModelPackRepository.kt"
click node_bundled "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/BundledPocketTts.kt"
click node_recording "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt"
click node_video_import "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/VideoAudioExtractor.kt"
click node_video_dialog "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/VideoImportDialog.kt"
click node_wav_samples "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/WavSamples.kt"
click node_pcm_wav "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/PcmWav.kt"
click node_denoiser "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/DeepFilterNet3Denoiser.kt"
click node_deepfilter_jni "https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/jni.cpp"
click node_deepfilter_dsp "https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/deepfilter_dsp.cpp"
click node_kissfft "https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/kissfft/kiss_fft.c"
click node_resampler "https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/resampler.cpp"
click node_sample_preview "https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/SamplePreview.kt"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_main,node_chunker,node_reader_service,node_timeline,node_highlight,node_reader_user,node_android_tts toneBlue
class node_tts_service,node_engine,node_native_tts,node_pocket_jni,node_model_repo,node_bundled toneAmber
class node_recording,node_video_import,node_video_dialog toneMint
class node_wav_samples,node_pcm_wav,node_denoiser,node_deepfilter_jni,node_deepfilter_dsp,node_kissfft,node_resampler,node_sample_preview toneRose
class node_voice_user toneIndigo
```

## Components

### Reader & playback

- [App UI](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/MainActivity.kt): `app/src/main/java/org/pockettts/android/engine/MainActivity.kt`
- [Text chunking](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ReaderTextChunker.kt): `app/src/main/java/org/pockettts/android/engine/ReaderTextChunker.kt`
- [Reader playback](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ReaderPlaybackService.kt): `app/src/main/java/org/pockettts/android/engine/ReaderPlaybackService.kt`
- [Audio timeline](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/AudioTimeline.kt): `app/src/main/java/org/pockettts/android/engine/AudioTimeline.kt`
- [Reading highlight](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ReadingHighlight.kt): `app/src/main/java/org/pockettts/android/engine/ReadingHighlight.kt`

### Speech runtime

- [TTS service](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/PocketTtsService.kt): `app/src/main/java/org/pockettts/android/engine/PocketTtsService.kt`
- [Shared engine](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/PocketEngine.kt): `app/src/main/java/org/pockettts/android/engine/PocketEngine.kt`
- [Native Pocket TTS](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/NativePocketTts.kt): `app/src/main/java/org/pockettts/android/engine/NativePocketTts.kt`
- [Pocket JNI](https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/jni_bridge.cpp): `app/src/main/cpp/jni_bridge.cpp`
- [Model & voice store](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/ModelPackRepository.kt): `app/src/main/java/org/pockettts/android/engine/ModelPackRepository.kt`
- [Bundled models](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/BundledPocketTts.kt): `app/src/main/java/org/pockettts/android/engine/BundledPocketTts.kt`

### Voice creation

- [Record & trim](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt): `app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt`
- [Video audio import](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/VideoAudioExtractor.kt): `app/src/main/java/org/pockettts/android/engine/VideoAudioExtractor.kt`
- [Video import UI](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/VideoImportDialog.kt): `app/src/main/java/org/pockettts/android/engine/VideoImportDialog.kt`

### Audio processing

- [WAV inspection](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/WavSamples.kt): `app/src/main/java/org/pockettts/android/engine/WavSamples.kt`
- [PCM WAV I/O](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/PcmWav.kt): `app/src/main/java/org/pockettts/android/engine/PcmWav.kt`
- [DeepFilter denoiser](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/DeepFilterNet3Denoiser.kt): `app/src/main/java/org/pockettts/android/engine/DeepFilterNet3Denoiser.kt`
- [DeepFilter JNI & DSP](https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/jni.cpp): `app/src/main/cpp/deepfilter/jni.cpp`
- [DeepFilter DSP](https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/deepfilter_dsp.cpp): `app/src/main/cpp/deepfilter/deepfilter_dsp.cpp`
- [KissFFT](https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/kissfft/kiss_fft.c): `app/src/main/cpp/deepfilter/kissfft/kiss_fft.c`
- [Audio resampler](https://github.com/rafin14/pockettts/blob/main/app/src/main/cpp/deepfilter/resampler.cpp): `app/src/main/cpp/deepfilter/resampler.cpp`
- [Sample preview](https://github.com/rafin14/pockettts/blob/main/app/src/main/java/org/pockettts/android/engine/SamplePreview.kt): `app/src/main/java/org/pockettts/android/engine/SamplePreview.kt`

### Other components

- **Reader user**
- **Android TTS client**
- **Voice creator**

## Connections

- Reader user → App UI: edits text (evidence: `README.md`)
- App UI → Reader playback: starts playback (evidence: `app/src/main/java/org/pockettts/android/engine/MainActivity.kt`)
- Reader playback → Text chunking: chunks text (evidence: `README.md`)
- Reader playback → Shared engine: generates speech (evidence: `app/src/main/java/org/pockettts/android/engine/ReaderPlaybackService.kt`)
- Reader playback → Audio timeline: tracks audio (evidence: `app/src/main/java/org/pockettts/android/engine/ReaderPlaybackService.kt`)
- Reader playback → Reading highlight: updates sections (evidence: `README.md`)
- Android TTS client → TTS service: requests synthesis (evidence: `README.md`)
- TTS service → Shared engine: synthesizes text (evidence: `app/src/main/java/org/pockettts/android/engine/PocketTtsService.kt`)
- Shared engine → Native Pocket TTS: creates instance (evidence: `app/src/main/java/org/pockettts/android/engine/PocketEngine.kt`)
- Native Pocket TTS → Pocket JNI: calls JNI
- Shared engine → Model & voice store: loads settings (evidence: `app/src/main/java/org/pockettts/android/engine/PocketEngine.kt`)
- Bundled models → Model & voice store: prepares models (evidence: `app/src/main/java/org/pockettts/android/engine/BundledPocketTts.kt`)
- Voice creator → App UI: chooses workflow (evidence: `app/src/main/java/org/pockettts/android/engine/MainActivity.kt`)
- App UI → Record & trim: opens editor (evidence: `app/src/main/java/org/pockettts/android/engine/MainActivity.kt`)
- Video import UI → Video audio import: extracts audio (evidence: `app/src/main/java/org/pockettts/android/engine/VideoImportDialog.kt`)
- App UI → Video import UI: opens import (evidence: `app/src/main/java/org/pockettts/android/engine/MainActivity.kt`)
- Record & trim → WAV inspection: inspects sample (evidence: `app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt`)
- Record & trim → PCM WAV I/O: reads and writes (evidence: `app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt`)
- Record & trim → DeepFilter denoiser: enhances sample (evidence: `app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt`)
- Record & trim → Sample preview: previews audio (evidence: `app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt`)
- Record & trim → Model & voice store: saves voice (evidence: `app/src/main/java/org/pockettts/android/engine/VoiceRecordingDialog.kt`)
- DeepFilter denoiser → DeepFilter JNI & DSP: runs enhancement
- DeepFilter JNI & DSP → DeepFilter DSP: uses DSP (evidence: `app/src/main/cpp/deepfilter/jni.cpp`)
- DeepFilter DSP → KissFFT: uses transforms (evidence: `app/src/main/cpp/deepfilter/deepfilter_dsp.cpp`)
- DeepFilter JNI & DSP → Audio resampler: resamples audio
