How jamesondh/chimera-vocal-synth works
CHIMERA is a browser-based physical-model voice synthesizer, with a Rust engine compiled to WebAssembly and run in an AudioWorklet. The user workflow runs from interactive controls or speech, song, and beatbox inputs through gesture planning and real-time synthesis to audio playback and live visualizations. The graph also includes the creature catalog, duet display, and native CLI for offline renders and acoustic comparison. Several internal links are supported only by the README or the source index; unsampled implementation details are not inferred.
Main entry points: engine.rs Voice engine · App.tsx App surface · main.rs CLI commands · human_voice.rs Human voice
Components 24
Browser app
- App surface
src/ui/App.tsx - Play controls
src/ui/components - Live displays
src/ui/components - Vector rendering
src/ui/render/vector.ts - Duet display
src/ui/components/DuetPage.tsx
Audio runtime
- Audio engine
src/audio/AudioEngine.ts - AudioWorklet
src/worklet/processor.ts - Wasm bridge
src/wasm/chimera.ts
Synthesis engine
- Voice engine
crates/chimera/src/engine.rs - Human voice
crates/chimera/src/voice/human_voice.rs - Airway network
crates/chimera/src/airway/network.rs - Human anatomy
crates/chimera/src/anatomy/human.rs - Creature voices
crates/chimera/src/creatures/voice.rs
Language and music
- Speech input
src/ui/speech.ts - Singing
src/ui/singing.ts - Tune fitting
src/song/fit.ts - Beatbox
crates/chimera/src/phonetics/beatbox.rs - Gesture planner
crates/chimera/src/phonetics/planner.rs
Offline tools
- CLI commands
crates/chimera-cli/src/main.rs - Offline rendering
crates/chimera-cli/src/render.rs - Voice comparison
crates/chimera-cli/src/compare.rs - Voice diagnostics
crates/chimera-cli/src/diagnose.rs - WAV output
crates/chimera-cli/src/wav.rs
Other components
- Performer
Connections 25
- Performer → App surface: uses
README.md - App surface → Play controls: presents
src/ui/App.tsx - Performer → Speech input: enters text
README.md - Performer → Singing: enters lyrics
README.md - Performer → Beatbox: plays pads
README.md - Singing → Tune fitting: fits phrases
README.md - Speech input → Gesture planner: plans gestures
README.md - Singing → Gesture planner: plans gestures
- App surface → Audio engine: controls playback
src/ui/App.tsx - Audio engine → AudioWorklet: loads worklet
src/audio/AudioEngine.ts - AudioWorklet → Wasm bridge: uses bridge
README.md - Wasm bridge → Voice engine: invokes engine
README.md - Gesture planner → Voice engine: supplies gestures
- Voice engine → Human voice: drives voice
crates/chimera/src/engine.rs - Voice engine → Creature voices: selects creature
crates/chimera/src/engine.rs - Human voice → Airway network: uses network
crates/chimera/src/voice/human_voice.rs - Human voice → Human anatomy: uses geometry
crates/chimera/src/voice/human_voice.rs - App surface → Live displays: shows state
src/ui/App.tsx - Live displays → Vector rendering: draws with
src/ui/components/CreatureView.tsx - Performer → Duet display: opens show
README.md - CLI commands → Offline rendering: dispatches render
crates/chimera-cli/src/main.rs - CLI commands → Voice comparison: dispatches compare
crates/chimera-cli/src/main.rs - CLI commands → Voice diagnostics: dispatches diagnose
crates/chimera-cli/src/main.rs - Offline rendering → Voice engine: renders audio
- Offline rendering → WAV output: writes WAV