# juandiegohernandezangarita13-png/neuro-vocal-core architecture

> Architecture diagram of the GitHub repository juandiegohernandezangarita13-png/neuro-vocal-core, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-20). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/juandiegohernandezangarita13-png/neuro-vocal-core
- Repository: https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core

## Overview

Neuro-Vocal-Core is a Drosophila-inspired spiking-neural-network system for visual reading, multimodal association, dialogue, and spoken output. In the interactive workflow, a person supplies visual or audio input; `main.py` runs the unified brain simulation, which can produce character-by-character keyboard output and synthesized speech. The repository also includes connectome preparation, semantic and Spanish-language capabilities, self-supervised imitation, and media-based learning. The graph reflects the documented architecture and shown source references; several runtime call details are unsampled, so uncertain links are omitted.

Main entry points: [`main.py`](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/main.py) (Brain Runtime), [`core/semantic_mind.py`](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/semantic_mind.py) (Semantic Mind), [`core/imitation_drive.py`](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/imitation_drive.py) (Imitation Drive), [`sensory_motor/retina.py`](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/retina.py) (Visual Retina)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_interaction["Interaction"]
  node_visual["Visual Retina<br/>[retina.py]"]
  node_audio["Gammatone Cochlea<br/>[cochlea.py]"]
  node_runtime["Brain Runtime<br/>[main.py]"]
  node_keyboard["Motor Keyboard<br/>[motor_keyboard.py]"]
  node_voice["Vocal Synthesizer<br/>[vocal_tract.py]"]
  node_chat["Visual Chat<br/>[chat_visual.py]"]
end

subgraph group_snn["Neural Simulation"]
  node_graph["Unified SNN Graph<br/>[topology.py]"]
  node_lif["LIF Physics<br/>[physics.py]"]
  node_safety["GABA Safety<br/>[safety_gaba.py]"]
  node_plasticity["Reward Plasticity<br/>[plasticity.py]"]
end

subgraph group_language["Language And Learning"]
  node_mind["Semantic Mind<br/>[semantic_mind.py]"]
  node_decoder["Auditory Decoder"]
  node_lexicon["Spanish Lexicon<br/>[lexicon.py]"]
  node_spanish["Spanish Knowledge"]
  node_imitation["Imitation Drive<br/>[imitation_drive.py]"]
  node_media["Media Feeder<br/>[media_feeder.py]"]
  node_curriculum["Syllable Curriculum"]
  node_monitor["Brain Monitor<br/>[brain_monitor.py]"]
end

subgraph group_assets["Connectome Data"]
  node_connectome["Connectome Builder"]
  node_bundle[("Connectome Bundle")]
end

node_person(("Person"))

node_person -->|"starts interaction"| node_chat
node_chat -->|"launches"| node_runtime
node_person -.->|"provides images"| node_visual
node_person -.->|"provides speech"| node_audio
node_runtime -->|"uses retina"| node_visual
node_runtime -->|"uses cochlea"| node_audio
node_runtime -->|"builds brain graph"| node_graph
node_runtime -->|"runs neuron physics"| node_lif
node_runtime -->|"applies safety"| node_safety
node_runtime -->|"updates synapses"| node_plasticity
node_runtime -->|"uses semantic mind"| node_mind
node_runtime -->|"uses decoder"| node_decoder
node_runtime -->|"uses synthesizer"| node_voice
node_runtime -->|"uses keyboard"| node_keyboard
node_runtime -->|"starts monitoring"| node_monitor
node_runtime -->|"loads or builds"| node_connectome
node_connectome -->|"writes bundle"| node_bundle
node_bundle -.->|"supplies connectome"| node_graph
node_mind -->|"reinforces transitions"| node_plasticity
node_mind -->|"uses word gestures"| node_lexicon
node_runtime -->|"uses Spanish knowledge"| node_spanish
node_runtime -.->|"supports imitation"| node_imitation
node_imitation -->|"listens through"| node_audio
node_imitation -->|"compares vocal output"| node_voice
node_media -.->|"feeds media training"| node_runtime
node_curriculum -->|"uses visual cues"| node_visual
node_curriculum -->|"uses vocal output"| node_voice

click node_visual "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/retina.py"
click node_audio "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/cochlea.py"
click node_runtime "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/main.py"
click node_keyboard "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/motor_keyboard.py"
click node_voice "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/vocal_tract.py"
click node_chat "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/chat_visual.py"
click node_graph "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/topology.py"
click node_lif "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/physics.py"
click node_safety "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/safety_gaba.py"
click node_plasticity "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/plasticity.py"
click node_mind "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/semantic_mind.py"
click node_decoder "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/auditory_decoder.py"
click node_lexicon "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/lexicon.py"
click node_spanish "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/spanish_knowledge.py"
click node_imitation "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/imitation_drive.py"
click node_media "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/media_feeder.py"
click node_curriculum "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/syllable_curriculum.py"
click node_monitor "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/telemetry/brain_monitor.py"
click node_connectome "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/data/download_connectome.py"
click node_bundle "https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/data/flywire_drosophila.pt"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_visual,node_audio,node_runtime,node_keyboard,node_voice,node_chat toneBlue
class node_graph,node_lif,node_safety,node_plasticity toneAmber
class node_mind,node_decoder,node_lexicon,node_spanish,node_imitation,node_media,node_curriculum,node_monitor toneMint
class node_connectome,node_bundle toneRose
class node_person toneIndigo
```

## Components

### Interaction

- [Visual Retina](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/retina.py): `sensory_motor/retina.py`
- [Gammatone Cochlea](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/cochlea.py): `sensory_motor/cochlea.py`
- [Brain Runtime](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/main.py): `main.py`
- [Motor Keyboard](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/motor_keyboard.py): `sensory_motor/motor_keyboard.py`
- [Vocal Synthesizer](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/vocal_tract.py): `sensory_motor/vocal_tract.py`
- [Visual Chat](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/chat_visual.py): `chat_visual.py`

### Neural Simulation

- [Unified SNN Graph](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/topology.py): `core/topology.py`
- [LIF Physics](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/physics.py): `core/physics.py`
- [GABA Safety](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/safety_gaba.py): `core/safety_gaba.py`
- [Reward Plasticity](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/plasticity.py): `core/plasticity.py`

### Language And Learning

- [Semantic Mind](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/semantic_mind.py): `core/semantic_mind.py`
- [Auditory Decoder](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/auditory_decoder.py): `core/auditory_decoder.py`
- [Spanish Lexicon](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/lexicon.py): `core/lexicon.py`
- [Spanish Knowledge](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/spanish_knowledge.py): `core/spanish_knowledge.py`
- [Imitation Drive](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/core/imitation_drive.py): `core/imitation_drive.py`
- [Media Feeder](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/media_feeder.py): `sensory_motor/media_feeder.py`
- [Syllable Curriculum](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/sensory_motor/syllable_curriculum.py): `sensory_motor/syllable_curriculum.py`
- [Brain Monitor](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/telemetry/brain_monitor.py): `telemetry/brain_monitor.py`

### Connectome Data

- [Connectome Builder](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/data/download_connectome.py): `data/download_connectome.py`
- [Connectome Bundle](https://github.com/juandiegohernandezangarita13-png/neuro-vocal-core/blob/main/data/flywire_drosophila.pt): `data/flywire_drosophila.pt`

### Other components

- **Person**

## Connections

- Person → Visual Chat: starts interaction (evidence: `README.md`)
- Visual Chat → Brain Runtime: launches (evidence: `chat_visual.py`)
- Person → Visual Retina: provides images (evidence: `README.md`)
- Person → Gammatone Cochlea: provides speech (evidence: `sensory_motor/cochlea.py`)
- Brain Runtime → Visual Retina: uses retina (evidence: `main.py`)
- Brain Runtime → Gammatone Cochlea: uses cochlea (evidence: `main.py`)
- Brain Runtime → Unified SNN Graph: builds brain graph (evidence: `main.py`)
- Brain Runtime → LIF Physics: runs neuron physics (evidence: `main.py`)
- Brain Runtime → GABA Safety: applies safety (evidence: `main.py`)
- Brain Runtime → Reward Plasticity: updates synapses (evidence: `main.py`)
- Brain Runtime → Semantic Mind: uses semantic mind (evidence: `main.py`)
- Brain Runtime → Auditory Decoder: uses decoder (evidence: `main.py`)
- Brain Runtime → Vocal Synthesizer: uses synthesizer (evidence: `main.py`)
- Brain Runtime → Motor Keyboard: uses keyboard (evidence: `chat_visual.py`)
- Brain Runtime → Brain Monitor: starts monitoring (evidence: `main.py`)
- Brain Runtime → Connectome Builder: loads or builds (evidence: `main.py`)
- Connectome Builder → Connectome Bundle: writes bundle (evidence: `data/download_connectome.py`)
- Connectome Bundle → Unified SNN Graph: supplies connectome
- Semantic Mind → Reward Plasticity: reinforces transitions (evidence: `core/semantic_mind.py`)
- Semantic Mind → Spanish Lexicon: uses word gestures (evidence: `core/semantic_mind.py`)
- Brain Runtime → Spanish Knowledge: uses Spanish knowledge (evidence: `chat_visual.py`)
- Brain Runtime → Imitation Drive: supports imitation (evidence: `main.py`)
- Imitation Drive → Gammatone Cochlea: listens through (evidence: `core/imitation_drive.py`)
- Imitation Drive → Vocal Synthesizer: compares vocal output (evidence: `core/imitation_drive.py`)
- Media Feeder → Brain Runtime: feeds media training
- Syllable Curriculum → Visual Retina: uses visual cues (evidence: `sensory_motor/syllable_curriculum.py`)
- Syllable Curriculum → Vocal Synthesizer: uses vocal output (evidence: `sensory_motor/syllable_curriculum.py`)
