# issiaxa74/slime architecture

> Architecture diagram of the GitHub repository issiaxa74/slime, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-17). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/issiaxa74/slime
- Repository: https://github.com/issiaxa74/slime

## Overview

Slime is an experimental Julia implementation of a hierarchical sparse AI architecture and its compressed `.ukj` model format, not a chatbot product. The main workflow prepares a small, Wikipedia, or Hugging Face corpus; trains the AJD model; exports it; then runs inference through the chat or terminal UI. The graph preserves those documented data and runtime branches, plus Python dataset preparation and `.ukj` validation. Most Julia implementation files were not sampled, so their internal calls are omitted; documented workflow edges cite the README.

Main entry points: [`julia/src/entrenar.jl`](https://github.com/issiaxa74/slime/blob/main/julia/src/entrenar.jl) (Training), [`julia/wikipedia.jl`](https://github.com/issiaxa74/slime/blob/main/julia/wikipedia.jl) (Wikipedia pipeline), [`julia/huggingface.jl`](https://github.com/issiaxa74/slime/blob/main/julia/huggingface.jl) (HF training driver), [`julia/src/ukj.jl`](https://github.com/issiaxa74/slime/blob/main/julia/src/ukj.jl) (UKJ serialization)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_data["Data preparation"]
  node_wiki_download["Article download<br/>[descargar.jl]"]
  node_wiki_pipeline["Wikipedia pipeline<br/>[wikipedia.jl]"]
  node_wiki_module["Wikipedia processing<br/>[wikipedia.jl]"]
  node_hf_inspect["Dataset download<br/>[inspeccionar_hf.py]"]
  node_hf_export["Dataset export<br/>[exportar_hf.py]"]
  node_hf_driver["HF training driver<br/>[huggingface.jl]"]
end

subgraph group_model["AJD model"]
  node_tokenizer["Tokenization<br/>[tokenizador.jl]"]
  node_tree["Taxonomy tree<br/>[arbol.jl]"]
  node_data_build["Corpus construction<br/>[datos.jl]"]
  node_training["Training<br/>[entrenar.jl]"]
  node_network["Sparse network<br/>[red.jl]"]
  node_adam["Adam optimizer<br/>[adam.jl]"]
  node_small_driver["Demo training<br/>[train.jl]"]
end

subgraph group_runtime["Inference interfaces"]
  node_chat["Interactive chat<br/>[chat.jl]"]
  node_tui["Terminal UI<br/>[tui.jl]"]
end

subgraph group_format["Model format"]
  node_ukj["UKJ serialization<br/>[ukj.jl]"]
  node_model_file["UKJ model file<br/>[modelo.ukj]"]
  node_python_reader["Python UKJ reader<br/>[leer_ukj.py]"]
end

node_user(("User"))
node_wiki_api(("Wikipedia API"))
node_hf(("Hugging Face"))

node_user -->|"requests articles"| node_wiki_download
node_wiki_download -->|"fetches summaries"| node_wiki_api
node_user -->|"starts pipeline"| node_wiki_pipeline
node_wiki_pipeline -->|"uses taxonomy"| node_wiki_module
node_user -->|"starts download"| node_hf_inspect
node_hf_inspect -->|"downloads datasets"| node_hf
node_user -->|"starts export"| node_hf_export
node_hf_export -->|"reads parquet"| node_hf_inspect
node_user -->|"starts training"| node_hf_driver
node_hf_driver -->|"reads JSONL output"| node_hf_export
node_user -->|"starts demo"| node_small_driver
node_small_driver -.->|"trains model"| node_training
node_hf_driver -.->|"trains model"| node_training
node_wiki_pipeline -->|"trains model"| node_training
node_training -.->|"uses vocabulary"| node_tokenizer
node_training -.->|"uses taxonomy"| node_tree
node_training -.->|"uses corpus"| node_data_build
node_training -.->|"updates weights"| node_network
node_training -.->|"optimizes with"| node_adam
node_small_driver -->|"exports model"| node_ukj
node_wiki_pipeline -->|"exports model"| node_ukj
node_hf_driver -->|"exports model"| node_ukj
node_ukj -.->|"writes model"| node_model_file
node_user -->|"queries model"| node_chat
node_user -->|"queries model"| node_tui
node_chat -->|"loads model"| node_model_file
node_tui -->|"loads model"| node_model_file
node_user -->|"validates model"| node_python_reader
node_python_reader -->|"reads format"| node_model_file

click node_wiki_download "https://github.com/issiaxa74/slime/blob/main/julia/descargar.jl"
click node_wiki_pipeline "https://github.com/issiaxa74/slime/blob/main/julia/wikipedia.jl"
click node_wiki_module "https://github.com/issiaxa74/slime/blob/main/julia/src/wikipedia.jl"
click node_hf_inspect "https://github.com/issiaxa74/slime/blob/main/python/inspeccionar_hf.py"
click node_hf_export "https://github.com/issiaxa74/slime/blob/main/python/exportar_hf.py"
click node_hf_driver "https://github.com/issiaxa74/slime/blob/main/julia/huggingface.jl"
click node_tokenizer "https://github.com/issiaxa74/slime/blob/main/julia/src/tokenizador.jl"
click node_tree "https://github.com/issiaxa74/slime/blob/main/julia/src/arbol.jl"
click node_data_build "https://github.com/issiaxa74/slime/blob/main/julia/src/datos.jl"
click node_training "https://github.com/issiaxa74/slime/blob/main/julia/src/entrenar.jl"
click node_network "https://github.com/issiaxa74/slime/blob/main/julia/src/red.jl"
click node_adam "https://github.com/issiaxa74/slime/blob/main/julia/src/adam.jl"
click node_small_driver "https://github.com/issiaxa74/slime/blob/main/julia/train.jl"
click node_chat "https://github.com/issiaxa74/slime/blob/main/julia/chat.jl"
click node_tui "https://github.com/issiaxa74/slime/blob/main/julia/tui.jl"
click node_ukj "https://github.com/issiaxa74/slime/blob/main/julia/src/ukj.jl"
click node_model_file "https://github.com/issiaxa74/slime/blob/main/julia/modelo.ukj"
click node_python_reader "https://github.com/issiaxa74/slime/blob/main/python/leer_ukj.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_wiki_download,node_wiki_pipeline,node_wiki_module,node_hf_inspect,node_hf_export,node_hf_driver,node_user toneBlue
class node_tokenizer,node_tree,node_data_build,node_training,node_network,node_adam,node_small_driver toneAmber
class node_chat,node_tui,node_wiki_api toneMint
class node_ukj,node_model_file,node_python_reader toneRose
class node_hf toneIndigo
```

## Components

### Data preparation

- [Article download](https://github.com/issiaxa74/slime/blob/main/julia/descargar.jl): `julia/descargar.jl`
- [Wikipedia pipeline](https://github.com/issiaxa74/slime/blob/main/julia/wikipedia.jl): `julia/wikipedia.jl`
- [Wikipedia processing](https://github.com/issiaxa74/slime/blob/main/julia/src/wikipedia.jl): `julia/src/wikipedia.jl`
- [Dataset download](https://github.com/issiaxa74/slime/blob/main/python/inspeccionar_hf.py): `python/inspeccionar_hf.py`
- [Dataset export](https://github.com/issiaxa74/slime/blob/main/python/exportar_hf.py): `python/exportar_hf.py`
- [HF training driver](https://github.com/issiaxa74/slime/blob/main/julia/huggingface.jl): `julia/huggingface.jl`

### AJD model

- [Tokenization](https://github.com/issiaxa74/slime/blob/main/julia/src/tokenizador.jl): `julia/src/tokenizador.jl`
- [Taxonomy tree](https://github.com/issiaxa74/slime/blob/main/julia/src/arbol.jl): `julia/src/arbol.jl`
- [Corpus construction](https://github.com/issiaxa74/slime/blob/main/julia/src/datos.jl): `julia/src/datos.jl`
- [Training](https://github.com/issiaxa74/slime/blob/main/julia/src/entrenar.jl): `julia/src/entrenar.jl`
- [Sparse network](https://github.com/issiaxa74/slime/blob/main/julia/src/red.jl): `julia/src/red.jl`
- [Adam optimizer](https://github.com/issiaxa74/slime/blob/main/julia/src/adam.jl): `julia/src/adam.jl`
- [Demo training](https://github.com/issiaxa74/slime/blob/main/julia/train.jl): `julia/train.jl`

### Inference interfaces

- [Interactive chat](https://github.com/issiaxa74/slime/blob/main/julia/chat.jl): `julia/chat.jl`
- [Terminal UI](https://github.com/issiaxa74/slime/blob/main/julia/tui.jl): `julia/tui.jl`

### Model format

- [UKJ serialization](https://github.com/issiaxa74/slime/blob/main/julia/src/ukj.jl): `julia/src/ukj.jl`
- [UKJ model file](https://github.com/issiaxa74/slime/blob/main/julia/modelo.ukj): `julia/modelo.ukj`
- [Python UKJ reader](https://github.com/issiaxa74/slime/blob/main/python/leer_ukj.py): `python/leer_ukj.py`

### Other components

- **User**
- **Wikipedia API**
- **Hugging Face**

## Connections

- User → Article download: requests articles (evidence: `README.md`)
- Article download → Wikipedia API: fetches summaries (evidence: `README.md`)
- User → Wikipedia pipeline: starts pipeline (evidence: `README.md`)
- Wikipedia pipeline → Wikipedia processing: uses taxonomy (evidence: `README.md`)
- User → Dataset download: starts download (evidence: `README.md`)
- Dataset download → Hugging Face: downloads datasets (evidence: `python/inspeccionar_hf.py`)
- User → Dataset export: starts export (evidence: `README.md`)
- Dataset export → Dataset download: reads parquet (evidence: `README.md`)
- User → HF training driver: starts training (evidence: `README.md`)
- HF training driver → Dataset export: reads JSONL output (evidence: `README.md`)
- User → Demo training: starts demo (evidence: `README.md`)
- Demo training → Training: trains model
- HF training driver → Training: trains model
- Wikipedia pipeline → Training: trains model (evidence: `README.md`)
- Training → Tokenization: uses vocabulary
- Training → Taxonomy tree: uses taxonomy
- Training → Corpus construction: uses corpus
- Training → Sparse network: updates weights
- Training → Adam optimizer: optimizes with
- Demo training → UKJ serialization: exports model (evidence: `README.md`)
- Wikipedia pipeline → UKJ serialization: exports model (evidence: `README.md`)
- HF training driver → UKJ serialization: exports model (evidence: `README.md`)
- UKJ serialization → UKJ model file: writes model
- User → Interactive chat: queries model (evidence: `README.md`)
- User → Terminal UI: queries model (evidence: `README.md`)
- Interactive chat → UKJ model file: loads model (evidence: `README.md`)
- Terminal UI → UKJ model file: loads model (evidence: `README.md`)
- User → Python UKJ reader: validates model (evidence: `README.md`)
- Python UKJ reader → UKJ model file: reads format (evidence: `python/leer_ukj.py`)
