How juandiegohernandezangarita13-png/neuro-vocal-core works
Neuro-Vocal-Core is a Drosophila-inspired spiking-neural-network system for visual reading, multimodal association, dialogue, and spoken output. In the interactive workflow, a person supplies visual or audio input; main.py runs the unified brain simulation, which can produce character-by-character keyboard output and synthesized speech. The repository also includes connectome preparation, semantic and Spanish-language capabilities, self-supervised imitation, and media-based learning. The graph reflects the documented architecture and shown source references; several runtime call details are unsampled, so uncertain links are omitted.
Main entry points: main.py Brain Runtime · semantic_mind.py Semantic Mind · imitation_drive.py Imitation Drive · retina.py Visual Retina
Components 21
Interaction
- Visual Retina
sensory_motor/retina.py - Gammatone Cochlea
sensory_motor/cochlea.py - Brain Runtime
main.py - Motor Keyboard
sensory_motor/motor_keyboard.py - Vocal Synthesizer
sensory_motor/vocal_tract.py - Visual Chat
chat_visual.py
Neural Simulation
- Unified SNN Graph
core/topology.py - LIF Physics
core/physics.py - GABA Safety
core/safety_gaba.py - Reward Plasticity
core/plasticity.py
Language And Learning
- Semantic Mind
core/semantic_mind.py - Auditory Decoder
core/auditory_decoder.py - Spanish Lexicon
core/lexicon.py - Spanish Knowledge
core/spanish_knowledge.py - Imitation Drive
core/imitation_drive.py - Media Feeder
sensory_motor/media_feeder.py - Syllable Curriculum
sensory_motor/syllable_curriculum.py - Brain Monitor
telemetry/brain_monitor.py
Connectome Data
- Connectome Builder
data/download_connectome.py - Connectome Bundle
data/flywire_drosophila.pt
Other components
- Person
Connections 27
- Person → Visual Chat: starts interaction
README.md - Visual Chat → Brain Runtime: launches
chat_visual.py - Person → Visual Retina: provides images
README.md - Person → Gammatone Cochlea: provides speech
sensory_motor/cochlea.py - Brain Runtime → Visual Retina: uses retina
main.py - Brain Runtime → Gammatone Cochlea: uses cochlea
main.py - Brain Runtime → Unified SNN Graph: builds brain graph
main.py - Brain Runtime → LIF Physics: runs neuron physics
main.py - Brain Runtime → GABA Safety: applies safety
main.py - Brain Runtime → Reward Plasticity: updates synapses
main.py - Brain Runtime → Semantic Mind: uses semantic mind
main.py - Brain Runtime → Auditory Decoder: uses decoder
main.py - Brain Runtime → Vocal Synthesizer: uses synthesizer
main.py - Brain Runtime → Motor Keyboard: uses keyboard
chat_visual.py - Brain Runtime → Brain Monitor: starts monitoring
main.py - Brain Runtime → Connectome Builder: loads or builds
main.py - Connectome Builder → Connectome Bundle: writes bundle
data/download_connectome.py - Connectome Bundle → Unified SNN Graph: supplies connectome
- Semantic Mind → Reward Plasticity: reinforces transitions
core/semantic_mind.py - Semantic Mind → Spanish Lexicon: uses word gestures
core/semantic_mind.py - Brain Runtime → Spanish Knowledge: uses Spanish knowledge
chat_visual.py - Brain Runtime → Imitation Drive: supports imitation
main.py - Imitation Drive → Gammatone Cochlea: listens through
core/imitation_drive.py - Imitation Drive → Vocal Synthesizer: compares vocal output
core/imitation_drive.py - Media Feeder → Brain Runtime: feeds media training
- Syllable Curriculum → Visual Retina: uses visual cues
sensory_motor/syllable_curriculum.py - Syllable Curriculum → Vocal Synthesizer: uses vocal output
sensory_motor/syllable_curriculum.py