# venturaeffect/the_consciousness_ai architecture

> Architecture diagram of the GitHub repository venturaeffect/the_consciousness_ai, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-01-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/venturaeffect/the_consciousness_ai
- Repository: https://github.com/venturaeffect/the_consciousness_ai

## Overview

##### Key Relationships to Highlight

- Bidirectional flow between consciousness core and memory systems
- Emotional processing influence on memory formation
- Self-model interactions with all components
- External input processing through vision/speech modules

##### Specific Implementation Details

Technical elements:
- Pinecone v2 for emotional indexing
- DreamerV3 integration
- LLaMA 3.3 for narrative processing
- Temporal Graph Neural Networks
- VR environment integration

##### Component Relationships

Critical flows:
**Input → Consciousness Gating → Emotional Processing → Memory Formation → Self-Model Update**

##### Technical Stack Integration

Technology badges for:
- LLaMA 3.3
- PaLM-E
- Whisper v3
- Unreal Engine 5
- PyTorch/CUDA

##### Detailed Subcomponents

Create expandable sections for:
**models/**
- controller/
- core/
- emotion/
- memory/
- self_model/
- vision-language/

##### Development Pipeline

Flow through:
- Data ingestion
- Preprocessing
- Model training
- Evaluation
- Deployment

##### Monitoring and Evaluation

Metrics tracking for:
- Consciousness development
- Emotional learning
- Memory performance
- Self-awareness evaluation

## Diagram (Mermaid)

```mermaid
flowchart TB
    %% Define styles
    classDef core fill:#b3d1ff,stroke:#333,stroke-width:2px
    classDef memory fill:#90EE90,stroke:#333,stroke-width:2px
    classDef emotion fill:#FFD700,stroke:#333,stroke-width:2px
    classDef io fill:#DDA0DD,stroke:#333,stroke-width:2px
    classDef eval fill:#FF6B6B,stroke:#333,stroke-width:2px
    classDef dev fill:#87CEEB,stroke:#333,stroke-width:2px
    classDef sim fill:#FFA07A,stroke:#333,stroke-width:2px
    classDef config fill:#D3D3D3,stroke:#333,stroke-width:2px

    subgraph CoreProcessing["Core Processing Layer"]
        CC[Consciousness Core]:::core
        CG[Consciousness Gating]:::core
        GF[Gate Fusion]:::core
        SM[Self-Model]:::core
    end

    subgraph MemoryArch["Memory Architecture"]
        MC[Memory Core]:::memory
        MCons[Memory Consolidation]:::memory
        EM[Emotional Memory]:::memory
        TC[Temporal Coherence]:::memory
        MI[Memory Indexing]:::memory
    end

    subgraph EmotionalProc["Emotional Processing"]
        EGNN[Emotional Graph Neural Networks]:::emotion
        RS[Reward Shaping]:::emotion
        EC[Emotional Context]:::emotion
    end

    subgraph IO["Input/Output Processing"]
        PALI[PALI-2 Integration]:::io
        PALME[PALM-E Integration]:::io
        WS[Whisper Speech]:::io
        LN[LLaMA Narrative]:::io
    end

    subgraph Evaluation["Evaluation & Monitoring"]
        CM[Consciousness Metrics]:::eval
        EE[Emotional Evaluation]:::eval
        ME[Memory Evaluation]:::eval
        SAE[Self-Awareness Evaluation]:::eval
    end

    subgraph Development["Development & Integration"]
        ST[Stage Transitions]:::dev
        EI[Experience Integration]:::dev
        ED[Emotional Development]:::dev
    end

    subgraph Simulation["Simulation & Environment"]
        VRE[VR Environment]:::sim
        SC[Simulation Controller]:::sim
        ES[Ethical Scenarios]:::sim
    end

    subgraph Config["Configuration"]
        CDC[Consciousness Development Config]:::config
        CMC[Consciousness Metrics Config]:::config
        RC[Reinforcement Config]:::config
    end

    %% Connections
    CC --> CG
    CG --> GF
    GF --> SM
    SM --> MC
    MC --> MCons
    MCons --> EM
    EM --> TC
    TC --> MI
    EGNN --> RS
    RS --> EC
    EC --> EM
    PALI --> CC
    PALME --> CC
    WS --> CC
    LN --> CC
    CM --> EE
    EE --> ME
    ME --> SAE
    ST --> EI
    EI --> ED
    VRE --> SC
    SC --> ES
    CDC --> CMC
    CMC --> RC

    %% Click events
    click CC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/core/consciousness_core.py"
    click CG "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/core/consciousness_gating.py"
    click GF "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/core/gate_fusion.py"
    click SM "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/self_model/self_representation_core.py"
    click MC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/memory/memory_core.py"
    click MCons "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/memory/consolidation.py"
    click EM "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/memory/emotional_memory_core.py"
    click TC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/memory/temporal_coherence.py"
    click MI "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/memory/emotional_indexing.py"
    click EGNN "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/emotion/tgnn/emotional_graph.py"
    click RS "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/emotion/reward_shaping.py"
    click EC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/memory/emotional_context.py"
    click PALI "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/vision-language/pali-2/pali2_integration.py"
    click PALME "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/vision-language/palm-e/palm_e_integration.py"
    click WS "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/speech/whisper/whisper_integration.py"
    click LN "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/language/llama_narrative.py"
    click CM "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/evaluation/consciousness_metrics.py"
    click EE "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/evaluation/emotional_evaluation.py"
    click ME "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/evaluation/memory_evaluation.py"
    click SAE "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/evaluation/self_awareness_evaluation.py"
    click ST "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/development/stage_transitions.py"
    click EI "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/integration/experience_integrator.py"
    click ED "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/integration/emotional_development_core.py"
    click VRE "https://github.com/venturaEffect/the_consciousness_ai/blob/main/simulations/enviroments/vr_environment.py"
    click SC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/models/controller/simulation_controller.py"
    click ES "https://github.com/venturaEffect/the_consciousness_ai/blob/main/simulations/scenarios/ethical_dilemmas.py"
    click CDC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/configs/consciousness_development.yaml"
    click CMC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/configs/consciousness_metrics.yaml"
    click RC "https://github.com/venturaEffect/the_consciousness_ai/blob/main/configs/reinforcement.yaml"
```
