# potamides/detikzify architecture

> Architecture diagram of the GitHub repository potamides/detikzify, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-01). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/potamides/detikzify
- Repository: https://github.com/potamides/detikzify

## Overview

DeTi*k*Zify is a multimodal model and application for turning scientific figures or sketches into semantics-preserving TikZ programs. The main user workflow runs through the web UI, which invokes sampling or MCTS inference; generated code is compiled and rasterized, and MCTS can refine and rank candidate outputs using image similarity. The repository also includes model versions and adapters, dataset loaders, training, and evaluation metrics. Edges reflect README statements or the supplied source index and excerpts; unsampled implementation details are not inferred.

Main entry points: [`detikzify/infer/generate.py`](https://github.com/potamides/detikzify/blob/main/detikzify/infer/generate.py) (Generation pipeline), [`detikzify/webui/webui.py`](https://github.com/potamides/detikzify/blob/main/detikzify/webui/webui.py) (Web interface), [`detikzify/model/modeling_detikzify.py`](https://github.com/potamides/detikzify/blob/main/detikzify/model/modeling_detikzify.py) (Current multimodal model), [`detikzify/model/adapter/modeling_adapter.py`](https://github.com/potamides/detikzify/blob/main/detikzify/model/adapter/modeling_adapter.py) (Cross-attention adapter)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_interface["User interface"]
  node_webui["Web interface<br/>[webui.py]"]
  node_ui_helpers["UI helpers<br/>[helpers.py]"]
  node_ui_strings["UI configuration<br/>[strings.py]"]
end

subgraph group_inference["Inference and rendering"]
  node_generation["Generation pipeline<br/>[generate.py]"]
  node_tikz["TikZ compile and render<br/>[tikz.py]"]
  node_mcts["MCTS search<br/>[montecarlo.py]"]
  node_mcts_node["Search nodes<br/>[node.py]"]
  node_utilities["Shared runtime utilities"]
end

subgraph group_models["Models"]
  node_model_config["Current model configuration"]
  node_model["Current multimodal model"]
  node_processor["Current model processor"]
  node_adapter["Cross-attention adapter"]
  node_adapter_processor["Adapter processor"]
  node_v1_model["Version 1 model"]
  node_v1_config["Version 1 configuration"]
  node_v1_processor["Version 1 processor"]
end

subgraph group_research["Data and research"]
  node_imagesim["Image similarity<br/>[imagesim.py]"]
  node_other_metrics["Other evaluation metrics"]
  node_datasets["Figure datasets"]
  node_training["Model training"]
end

node_user(("Figure or sketch user"))

node_user -->|"submits figure"| node_webui
node_webui -->|"invokes inference"| node_generation
node_webui -->|"uses helpers"| node_ui_helpers
node_webui -->|"uses settings"| node_ui_strings
node_generation -->|"compiles output"| node_tikz
node_generation -->|"runs search"| node_mcts
node_generation -->|"scores candidates"| node_imagesim
node_mcts -.->|"manages nodes"| node_mcts_node
node_model -->|"uses configuration"| node_model_config
node_model -->|"uses adapter"| node_adapter
node_imagesim -->|"adapts vision model"| node_adapter
node_v1_model -->|"uses configuration"| node_v1_config
node_v1_model -->|"uses processor"| node_v1_processor
node_adapter -.->|"pairs with processor"| node_adapter_processor
node_generation -.->|"generates with model"| node_model
node_tikz -->|"uses subprocess helpers"| node_utilities

click node_webui "https://github.com/potamides/detikzify/blob/main/detikzify/webui/webui.py"
click node_ui_helpers "https://github.com/potamides/detikzify/blob/main/detikzify/webui/helpers.py"
click node_ui_strings "https://github.com/potamides/detikzify/blob/main/detikzify/webui/strings.py"
click node_generation "https://github.com/potamides/detikzify/blob/main/detikzify/infer/generate.py"
click node_tikz "https://github.com/potamides/detikzify/blob/main/detikzify/infer/tikz.py"
click node_mcts "https://github.com/potamides/detikzify/blob/main/detikzify/mcts/montecarlo.py"
click node_mcts_node "https://github.com/potamides/detikzify/blob/main/detikzify/mcts/node.py"
click node_imagesim "https://github.com/potamides/detikzify/blob/main/detikzify/evaluate/imagesim.py"
click node_other_metrics "https://github.com/potamides/detikzify/tree/main/detikzify/evaluate"
click node_model_config "https://github.com/potamides/detikzify/blob/main/detikzify/model/configuration_detikzify.py"
click node_model "https://github.com/potamides/detikzify/blob/main/detikzify/model/modeling_detikzify.py"
click node_processor "https://github.com/potamides/detikzify/blob/main/detikzify/model/processing_detikzify.py"
click node_adapter "https://github.com/potamides/detikzify/blob/main/detikzify/model/adapter/modeling_adapter.py"
click node_adapter_processor "https://github.com/potamides/detikzify/blob/main/detikzify/model/adapter/processing_adapter.py"
click node_v1_model "https://github.com/potamides/detikzify/blob/main/detikzify/model/v1/modeling_detikzify.py"
click node_v1_config "https://github.com/potamides/detikzify/blob/main/detikzify/model/v1/configuration_detikzify.py"
click node_v1_processor "https://github.com/potamides/detikzify/blob/main/detikzify/model/v1/processing_detikzify.py"
click node_datasets "https://github.com/potamides/detikzify/tree/main/detikzify/dataset"
click node_training "https://github.com/potamides/detikzify/tree/main/detikzify/train"
click node_utilities "https://github.com/potamides/detikzify/tree/main/detikzify/util"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_webui,node_ui_helpers,node_ui_strings,node_user toneBlue
class node_generation,node_tikz,node_mcts,node_mcts_node,node_utilities toneAmber
class node_model_config,node_model,node_processor,node_adapter,node_adapter_processor,node_v1_model,node_v1_config,node_v1_processor toneMint
class node_imagesim,node_other_metrics,node_datasets,node_training toneRose
```

## Components

### User interface

- [Web interface](https://github.com/potamides/detikzify/blob/main/detikzify/webui/webui.py): `detikzify/webui/webui.py`
- [UI helpers](https://github.com/potamides/detikzify/blob/main/detikzify/webui/helpers.py): `detikzify/webui/helpers.py`
- [UI configuration](https://github.com/potamides/detikzify/blob/main/detikzify/webui/strings.py): `detikzify/webui/strings.py`

### Inference and rendering

- [Generation pipeline](https://github.com/potamides/detikzify/blob/main/detikzify/infer/generate.py): `detikzify/infer/generate.py`
- [TikZ compile and render](https://github.com/potamides/detikzify/blob/main/detikzify/infer/tikz.py): `detikzify/infer/tikz.py`
- [MCTS search](https://github.com/potamides/detikzify/blob/main/detikzify/mcts/montecarlo.py): `detikzify/mcts/montecarlo.py`
- [Search nodes](https://github.com/potamides/detikzify/blob/main/detikzify/mcts/node.py): `detikzify/mcts/node.py`
- [Shared runtime utilities](https://github.com/potamides/detikzify/tree/main/detikzify/util): `detikzify/util`

### Models

- [Current model configuration](https://github.com/potamides/detikzify/blob/main/detikzify/model/configuration_detikzify.py): `detikzify/model/configuration_detikzify.py`
- [Current multimodal model](https://github.com/potamides/detikzify/blob/main/detikzify/model/modeling_detikzify.py): `detikzify/model/modeling_detikzify.py`
- [Current model processor](https://github.com/potamides/detikzify/blob/main/detikzify/model/processing_detikzify.py): `detikzify/model/processing_detikzify.py`
- [Cross-attention adapter](https://github.com/potamides/detikzify/blob/main/detikzify/model/adapter/modeling_adapter.py): `detikzify/model/adapter/modeling_adapter.py`
- [Adapter processor](https://github.com/potamides/detikzify/blob/main/detikzify/model/adapter/processing_adapter.py): `detikzify/model/adapter/processing_adapter.py`
- [Version 1 model](https://github.com/potamides/detikzify/blob/main/detikzify/model/v1/modeling_detikzify.py): `detikzify/model/v1/modeling_detikzify.py`
- [Version 1 configuration](https://github.com/potamides/detikzify/blob/main/detikzify/model/v1/configuration_detikzify.py): `detikzify/model/v1/configuration_detikzify.py`
- [Version 1 processor](https://github.com/potamides/detikzify/blob/main/detikzify/model/v1/processing_detikzify.py): `detikzify/model/v1/processing_detikzify.py`

### Data and research

- [Image similarity](https://github.com/potamides/detikzify/blob/main/detikzify/evaluate/imagesim.py): `detikzify/evaluate/imagesim.py`
- [Other evaluation metrics](https://github.com/potamides/detikzify/tree/main/detikzify/evaluate): `detikzify/evaluate`
- [Figure datasets](https://github.com/potamides/detikzify/tree/main/detikzify/dataset): `detikzify/dataset`
- [Model training](https://github.com/potamides/detikzify/tree/main/detikzify/train): `detikzify/train`

### Other components

- **Figure or sketch user**

## Connections

- Figure or sketch user → Web interface: submits figure
- Web interface → Generation pipeline: invokes inference (evidence: `detikzify/webui/webui.py`)
- Web interface → UI helpers: uses helpers (evidence: `detikzify/webui/webui.py`)
- Web interface → UI configuration: uses settings (evidence: `detikzify/webui/webui.py`)
- Generation pipeline → TikZ compile and render: compiles output (evidence: `detikzify/infer/generate.py`)
- Generation pipeline → MCTS search: runs search (evidence: `detikzify/infer/generate.py`)
- Generation pipeline → Image similarity: scores candidates (evidence: `detikzify/infer/generate.py`)
- MCTS search → Search nodes: manages nodes
- Current multimodal model → Current model configuration: uses configuration (evidence: `detikzify/model/modeling_detikzify.py`)
- Current multimodal model → Cross-attention adapter: uses adapter (evidence: `detikzify/model/modeling_detikzify.py`)
- Image similarity → Cross-attention adapter: adapts vision model (evidence: `detikzify/evaluate/imagesim.py`)
- Version 1 model → Version 1 configuration: uses configuration (evidence: `detikzify/model/v1/modeling_detikzify.py`)
- Version 1 model → Version 1 processor: uses processor (evidence: `detikzify/model/v1/modeling_detikzify.py`)
- Cross-attention adapter → Adapter processor: pairs with processor
- Generation pipeline → Current multimodal model: generates with model
- TikZ compile and render → Shared runtime utilities: uses subprocess helpers (evidence: `detikzify/infer/tikz.py`)
