# ibz-04/quaynor architecture

> Architecture diagram of the GitHub repository ibz-04/quaynor, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-07). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/ibz-04/quaynor
- Repository: https://github.com/ibz-04/quaynor

## Overview

Quaynor is a Rust-based local inference engine with language and mobile bindings. The principal workflow loads a GGUF model, builds a chat session, and streams generated output; optional capabilities include embeddings, reranking, grammar-constrained tools, and model downloads. The graph includes the documented binding surfaces and sampled core layers. Binding-to-engine links reflect README documentation; unsampled binding internals and some runtime wiring are not inferred.

Main entry points: [`quaynor/core/src/chat.rs`](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/chat.rs) (Chat session), [`quaynor/core/src/llm.rs`](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/llm.rs) (Model loading), [`quaynor/flutter/rust/src/lib.rs`](https://github.com/ibz-04/quaynor/blob/main/quaynor/flutter/rust/src/lib.rs) (Flutter API), [`quaynor/react-native/src/chat.ts`](https://github.com/ibz-04/quaynor/blob/main/quaynor/react-native/src/chat.ts) (React Native chat)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_engine["Inference engine"]
  node_model_load["Model loading<br/>[llm.rs]"]
  node_chat["Chat session<br/>[chat.rs]"]
  node_context_memory["Context planning<br/>[memory.rs]"]
  node_templates["Chat templates<br/>[template.rs]"]
  node_tokenizer["Tokenization<br/>[tokenizer.rs]"]
end

subgraph group_generation["Generation features"]
  node_sampler["Sampling config<br/>[sampler_config.rs]"]
  node_embeddings["Embeddings<br/>[encoder.rs]"]
  node_reranking["Cross-encoder<br/>[crossencoder.rs]"]
end

subgraph group_grammar["Grammar and tools"]
  node_tool_formats["Tool format handlers"]
  node_gbnf_builder["Grammar builder<br/>[builder.rs]"]
  node_json_schema["Schema conversion<br/>[json.rs]"]
end

subgraph group_python["Python binding"]
  node_python_api["Python API<br/>[lib.rs]"]
end

subgraph group_mobile["Mobile bindings"]
  node_flutter_api["Flutter API<br/>[lib.rs]"]
  node_flutter_bridge["Flutter bridge<br/>[frb_generated.rs]"]
  node_rn_chat["React Native chat<br/>[chat.ts]"]
  node_rn_model["React Native model<br/>[model.ts]"]
end

subgraph group_apple_jvm["Apple and JVM bindings"]
  node_swift_api["Swift API<br/>[Chat.swift]"]
  node_swift_ffi["Swift FFI<br/>[QuaynorFFI.swift]"]
  node_kotlin_api["Kotlin API<br/>[Chat.kt]"]
  node_uniffi["UniFFI interface<br/>[lib.rs]"]
end

node_user(("App developer"))
node_hf(("Model URL or Hugging Face"))

node_user -->|"chooses model"| node_model_load
node_model_load -->|"builds session"| node_chat
node_chat -->|"streams response"| node_user
node_model_load -.->|"downloads model"| node_hf
node_chat -->|"plans context"| node_context_memory
node_chat -->|"renders prompts"| node_templates
node_chat -->|"tokenizes prompt"| node_tokenizer
node_model_load -->|"plans context"| node_context_memory
node_chat -->|"uses configuration"| node_sampler
node_user -->|"requests embeddings"| node_embeddings
node_user -->|"requests reranking"| node_reranking
node_chat -->|"dispatches tool calls"| node_tool_formats
node_chat -.->|"constrains generation"| node_gbnf_builder
node_gbnf_builder -->|"converts schemas"| node_json_schema
node_user -->|"uses binding"| node_python_api
node_python_api -->|"invokes engine"| node_chat
node_user -->|"uses binding"| node_flutter_api
node_flutter_api -->|"invokes engine"| node_chat
node_flutter_api -->|"exposes bridge calls"| node_flutter_bridge
node_user -->|"uses binding"| node_rn_chat
node_rn_chat -->|"loads model"| node_rn_model
node_rn_chat -->|"invokes engine"| node_chat
node_user -->|"uses binding"| node_swift_api
node_swift_api -->|"calls FFI"| node_swift_ffi
node_swift_ffi -->|"invokes engine"| node_chat
node_user -->|"uses binding"| node_kotlin_api
node_kotlin_api -->|"uses UniFFI"| node_uniffi
node_uniffi -->|"invokes engine"| node_chat

click node_model_load "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/llm.rs"
click node_chat "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/chat.rs"
click node_context_memory "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/memory.rs"
click node_templates "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/template.rs"
click node_tokenizer "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/tokenizer.rs"
click node_sampler "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/sampler_config.rs"
click node_embeddings "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/encoder.rs"
click node_reranking "https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/crossencoder.rs"
click node_tool_formats "https://github.com/ibz-04/quaynor/tree/main/quaynor/core/src/tool_calling"
click node_gbnf_builder "https://github.com/ibz-04/quaynor/blob/main/quaynor/grammar/gbnf/src/builder.rs"
click node_json_schema "https://github.com/ibz-04/quaynor/blob/main/quaynor/grammar/gbnf/src/json.rs"
click node_python_api "https://github.com/ibz-04/quaynor/blob/main/quaynor/python/src/lib.rs"
click node_flutter_api "https://github.com/ibz-04/quaynor/blob/main/quaynor/flutter/rust/src/lib.rs"
click node_flutter_bridge "https://github.com/ibz-04/quaynor/blob/main/quaynor/flutter/rust/src/frb_generated.rs"
click node_rn_chat "https://github.com/ibz-04/quaynor/blob/main/quaynor/react-native/src/chat.ts"
click node_rn_model "https://github.com/ibz-04/quaynor/blob/main/quaynor/react-native/src/model.ts"
click node_swift_api "https://github.com/ibz-04/quaynor/blob/main/quaynor/swift/Sources/Quaynor/Chat.swift"
click node_swift_ffi "https://github.com/ibz-04/quaynor/blob/main/quaynor/swift/Sources/QuaynorFFI/QuaynorFFI.swift"
click node_kotlin_api "https://github.com/ibz-04/quaynor/blob/main/quaynor/kotlin/common/src/Chat.kt"
click node_uniffi "https://github.com/ibz-04/quaynor/blob/main/quaynor/uniffi/src/lib.rs"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_model_load,node_chat,node_context_memory,node_templates,node_tokenizer toneBlue
class node_sampler,node_embeddings,node_reranking toneAmber
class node_tool_formats,node_gbnf_builder,node_json_schema toneMint
class node_python_api toneRose
class node_flutter_api,node_flutter_bridge,node_rn_chat,node_rn_model,node_user,node_hf toneIndigo
class node_swift_api,node_swift_ffi,node_kotlin_api,node_uniffi toneTeal
```

## Components

### Inference engine

- [Model loading](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/llm.rs): `quaynor/core/src/llm.rs`
- [Chat session](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/chat.rs): `quaynor/core/src/chat.rs`
- [Context planning](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/memory.rs): `quaynor/core/src/memory.rs`
- [Chat templates](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/template.rs): `quaynor/core/src/template.rs`
- [Tokenization](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/tokenizer.rs): `quaynor/core/src/tokenizer.rs`

### Generation features

- [Sampling config](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/sampler_config.rs): `quaynor/core/src/sampler_config.rs`
- [Embeddings](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/encoder.rs): `quaynor/core/src/encoder.rs`
- [Cross-encoder](https://github.com/ibz-04/quaynor/blob/main/quaynor/core/src/crossencoder.rs): `quaynor/core/src/crossencoder.rs`

### Grammar and tools

- [Tool format handlers](https://github.com/ibz-04/quaynor/tree/main/quaynor/core/src/tool_calling): `quaynor/core/src/tool_calling`
- [Grammar builder](https://github.com/ibz-04/quaynor/blob/main/quaynor/grammar/gbnf/src/builder.rs): `quaynor/grammar/gbnf/src/builder.rs`
- [Schema conversion](https://github.com/ibz-04/quaynor/blob/main/quaynor/grammar/gbnf/src/json.rs): `quaynor/grammar/gbnf/src/json.rs`

### Python binding

- [Python API](https://github.com/ibz-04/quaynor/blob/main/quaynor/python/src/lib.rs): `quaynor/python/src/lib.rs`

### Mobile bindings

- [Flutter API](https://github.com/ibz-04/quaynor/blob/main/quaynor/flutter/rust/src/lib.rs): `quaynor/flutter/rust/src/lib.rs`
- [Flutter bridge](https://github.com/ibz-04/quaynor/blob/main/quaynor/flutter/rust/src/frb_generated.rs): `quaynor/flutter/rust/src/frb_generated.rs`
- [React Native chat](https://github.com/ibz-04/quaynor/blob/main/quaynor/react-native/src/chat.ts): `quaynor/react-native/src/chat.ts`
- [React Native model](https://github.com/ibz-04/quaynor/blob/main/quaynor/react-native/src/model.ts): `quaynor/react-native/src/model.ts`

### Apple and JVM bindings

- [Swift API](https://github.com/ibz-04/quaynor/blob/main/quaynor/swift/Sources/Quaynor/Chat.swift): `quaynor/swift/Sources/Quaynor/Chat.swift`
- [Swift FFI](https://github.com/ibz-04/quaynor/blob/main/quaynor/swift/Sources/QuaynorFFI/QuaynorFFI.swift): `quaynor/swift/Sources/QuaynorFFI/QuaynorFFI.swift`
- [Kotlin API](https://github.com/ibz-04/quaynor/blob/main/quaynor/kotlin/common/src/Chat.kt): `quaynor/kotlin/common/src/Chat.kt`
- [UniFFI interface](https://github.com/ibz-04/quaynor/blob/main/quaynor/uniffi/src/lib.rs): `quaynor/uniffi/src/lib.rs`

### Other components

- **App developer**
- **Model URL or Hugging Face**

## Connections

- App developer → Model loading: chooses model (evidence: `README.md`)
- Model loading → Chat session: builds session (evidence: `README.md`)
- Chat session → App developer: streams response (evidence: `README.md`)
- Model loading → Model URL or Hugging Face: downloads model (evidence: `README.md`)
- Chat session → Context planning: plans context (evidence: `quaynor/core/src/chat.rs`)
- Chat session → Chat templates: renders prompts (evidence: `quaynor/core/src/chat.rs`)
- Chat session → Tokenization: tokenizes prompt (evidence: `quaynor/core/src/chat.rs`)
- Model loading → Context planning: plans context (evidence: `quaynor/core/src/llm.rs`)
- Chat session → Sampling config: uses configuration (evidence: `quaynor/core/src/chat.rs`)
- App developer → Embeddings: requests embeddings (evidence: `README.md`)
- App developer → Cross-encoder: requests reranking (evidence: `README.md`)
- Chat session → Tool format handlers: dispatches tool calls (evidence: `quaynor/core/src/chat.rs`)
- Chat session → Grammar builder: constrains generation (evidence: `README.md`)
- Grammar builder → Schema conversion: converts schemas (evidence: `quaynor/grammar/gbnf/src/json.rs`)
- App developer → Python API: uses binding (evidence: `README.md`)
- Python API → Chat session: invokes engine (evidence: `README.md`)
- App developer → Flutter API: uses binding (evidence: `README.md`)
- Flutter API → Chat session: invokes engine (evidence: `README.md`)
- Flutter API → Flutter bridge: exposes bridge calls (evidence: `quaynor/flutter/rust/src/lib.rs`)
- App developer → React Native chat: uses binding (evidence: `README.md`)
- React Native chat → React Native model: loads model (evidence: `quaynor/react-native/src/chat.ts`)
- React Native chat → Chat session: invokes engine (evidence: `README.md`)
- App developer → Swift API: uses binding (evidence: `README.md`)
- Swift API → Swift FFI: calls FFI (evidence: `quaynor/swift/Sources/QuaynorFFI/QuaynorFFI.swift`)
- Swift FFI → Chat session: invokes engine (evidence: `README.md`)
- App developer → Kotlin API: uses binding (evidence: `README.md`)
- Kotlin API → UniFFI interface: uses UniFFI (evidence: `README.md`)
- UniFFI interface → Chat session: invokes engine (evidence: `README.md`)
