How margotmassonresearch/phoneviz works
PhoneViz turns a reference transcript and audio into phonetic alignments, then presents those alignments in an interactive IPA-chart visualizer. Users can run this for one utterance or a dataframe; already-aligned data can be displayed directly. The documented runtime stages are reference-to-IPA conversion, Wav2Vec2 phone recognition, SCTK sclite alignment, and visualization with phonetic annotations. The excerpts show the pipeline’s calls and the visualizer’s mapping-file read; other subsystem links below are supported by README statements, not unsampled implementation details.
Main entry points: show_and_tell_pipeline.py ShowTellPipeline · phoneviz.py PhoneViz · alignment.py SCLiteAlignment · phonetic_transcription.py Wav2Vec2 phones
Components 14
Inputs and orchestration
- Audio recordings
- Reference transcript
- Alignment dataframe
- ShowTellPipeline
source/show_and_tell_pipeline.py
Phone processing
- Text to IPA
source/text.py - Wav2Vec2 phones
source/phonetic_transcription.py
Alignment engine
- SCLiteAlignment
source/alignment.py - SCTK sclite
resources/sctk-2.4.10 - Phone alignments
Visualization
- PhoneViz
source/phoneviz.py - IPA feature mapping
resources/phonemapsat_ipa.csv - Interactive IPA chart
source/phoneviz.py
Other components
- User
- eSpeak
Connections 15
- User → ShowTellPipeline: runs
- Audio recordings → ShowTellPipeline: provides audio
- Reference transcript → ShowTellPipeline: provides reference
- Alignment dataframe → ShowTellPipeline: provides rows
- ShowTellPipeline → Text to IPA: converts reference
source/show_and_tell_pipeline.py - ShowTellPipeline → Wav2Vec2 phones: recognizes phones
source/show_and_tell_pipeline.py - Wav2Vec2 phones → eSpeak: uses phonemizer
- ShowTellPipeline → SCLiteAlignment: requests alignment
source/show_and_tell_pipeline.py - SCLiteAlignment → SCTK sclite: runs scorer
source/alignment.py - SCLiteAlignment → Phone alignments: returns aligned phones
- ShowTellPipeline → Phone alignments: produces dataframe
source/show_and_tell_pipeline.py - User → PhoneViz: opens alignments
- Phone alignments → PhoneViz: supplies aligned phones
- PhoneViz → IPA feature mapping: reads annotations
source/phoneviz.py - PhoneViz → Interactive IPA chart: renders controls
source/phoneviz.py