# huggingface/peft architecture

> Architecture diagram of the GitHub repository huggingface/peft, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-24). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/huggingface/peft
- Repository: https://github.com/huggingface/peft

## Overview

PEFT is a Python library for adapting pretrained models by training small adapter parameters rather than the full model. The main workflow is: a user supplies a pretrained model and PEFT configuration, the library wraps the model with a selected tuner, an external training loop updates adapter parameters, and the resulting adapter can be saved and later loaded for inference. The README also highlights quantization and integration with Transformers, Diffusers, and Accelerate. The graph captures those documented capabilities; sampled source is partial, so uncertain internal call wiring is omitted.

Main entry points: [`src/peft/peft_model.py`](https://github.com/huggingface/peft/blob/main/src/peft/peft_model.py) (PEFT model), [`src/peft/mapping.py`](https://github.com/huggingface/peft/blob/main/src/peft/mapping.py) (Tuner mapping), [`src/peft/mapping_func.py`](https://github.com/huggingface/peft/blob/main/src/peft/mapping_func.py) (Model factory), [`src/peft/__init__.py`](https://github.com/huggingface/peft/blob/main/src/peft/__init__.py) (PEFT exports)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_api["Public API"]
  node_public_api["PEFT exports<br/>[__init__.py]"]
  node_config["Adapter config<br/>[config.py]"]
  node_mapping["Tuner mapping<br/>[mapping.py]"]
  node_mapping_func["Model factory<br/>[mapping_func.py]"]
end

subgraph group_adapter["Adapter Methods"]
  node_lora["LoRA tuner<br/>[model.py]"]
  node_prompt["Prompt tuners<br/>[model.py]"]
  node_other_tuners["Other tuners"]
  node_mixed["Mixed adapters<br/>[mixed_model.py]"]
  node_optimizers["PEFT optimizers"]
end

subgraph group_runtime["Model Runtime"]
  node_model_wrapper["PEFT model<br/>[peft_model.py]"]
  node_auto["Auto loading<br/>[auto.py]"]
  node_tuner_utils["Tuner base utilities<br/>[tuners_utils.py]"]
end

subgraph group_persistence["Persistence And Integrations"]
  node_save_load["Adapter save/load<br/>[save_and_load.py]"]
  node_integrations["Ecosystem integrations<br/>[integrations.py]"]
  node_quantization["Quantization helpers"]
end

node_user(("Library user"))
node_base_model["Pretrained model"]
node_training["Training loop"]
node_transformers["Transformers"]
node_diffusers["Diffusers"]
node_accelerate["Accelerate"]

node_user -->|"uses"| node_public_api
node_public_api -->|"configures"| node_config
node_user -->|"provides"| node_base_model
node_user -->|"calls factory"| node_mapping_func
node_mapping_func -->|"selects tuner"| node_mapping
node_mapping_func -->|"wraps model"| node_model_wrapper
node_mapping -->|"maps method"| node_lora
node_mapping -->|"maps method"| node_prompt
node_mapping -->|"maps methods"| node_other_tuners
node_model_wrapper -->|"wraps"| node_base_model
node_model_wrapper -->|"uses"| node_tuner_utils
node_training -->|"trains adapters"| node_model_wrapper
node_user -->|"runs"| node_training
node_user -->|"saves adapter"| node_save_load
node_save_load -->|"loads weights"| node_model_wrapper
node_user -->|"loads for inference"| node_auto
node_auto -->|"constructs"| node_model_wrapper
node_model_wrapper -->|"runs inference"| node_base_model
node_model_wrapper -->|"supports mixing"| node_mixed
node_user -.->|"may use"| node_optimizers
node_model_wrapper -.->|"supports quantized models"| node_quantization
node_transformers -.->|"provides models"| node_base_model
node_diffusers -.->|"integrates adapters"| node_model_wrapper
node_accelerate -.->|"distributes training"| node_training
node_model_wrapper -.->|"uses integrations"| node_integrations

click node_public_api "https://github.com/huggingface/peft/blob/main/src/peft/__init__.py"
click node_config "https://github.com/huggingface/peft/blob/main/src/peft/config.py"
click node_mapping "https://github.com/huggingface/peft/blob/main/src/peft/mapping.py"
click node_mapping_func "https://github.com/huggingface/peft/blob/main/src/peft/mapping_func.py"
click node_model_wrapper "https://github.com/huggingface/peft/blob/main/src/peft/peft_model.py"
click node_auto "https://github.com/huggingface/peft/blob/main/src/peft/auto.py"
click node_tuner_utils "https://github.com/huggingface/peft/blob/main/src/peft/tuners/tuners_utils.py"
click node_lora "https://github.com/huggingface/peft/blob/main/src/peft/tuners/lora/model.py"
click node_prompt "https://github.com/huggingface/peft/blob/main/src/peft/tuners/prompt_tuning/model.py"
click node_other_tuners "https://github.com/huggingface/peft/tree/main/src/peft/tuners"
click node_mixed "https://github.com/huggingface/peft/blob/main/src/peft/mixed_model.py"
click node_optimizers "https://github.com/huggingface/peft/tree/main/src/peft/optimizers"
click node_save_load "https://github.com/huggingface/peft/blob/main/src/peft/utils/save_and_load.py"
click node_integrations "https://github.com/huggingface/peft/blob/main/src/peft/utils/integrations.py"
click node_quantization "https://github.com/huggingface/peft/blob/main/src/peft/utils/quantization_utils.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_public_api,node_config,node_mapping,node_mapping_func,node_user,node_diffusers toneBlue
class node_lora,node_prompt,node_other_tuners,node_mixed,node_optimizers toneAmber
class node_model_wrapper,node_auto,node_tuner_utils toneMint
class node_save_load,node_integrations,node_quantization toneRose
class node_base_model,node_training,node_transformers,node_accelerate toneIndigo
```

## Components

### Public API

- [PEFT exports](https://github.com/huggingface/peft/blob/main/src/peft/__init__.py): `src/peft/__init__.py`
- [Adapter config](https://github.com/huggingface/peft/blob/main/src/peft/config.py): `src/peft/config.py`
- [Tuner mapping](https://github.com/huggingface/peft/blob/main/src/peft/mapping.py): `src/peft/mapping.py`
- [Model factory](https://github.com/huggingface/peft/blob/main/src/peft/mapping_func.py): `src/peft/mapping_func.py`

### Adapter Methods

- [LoRA tuner](https://github.com/huggingface/peft/blob/main/src/peft/tuners/lora/model.py): `src/peft/tuners/lora/model.py`
- [Prompt tuners](https://github.com/huggingface/peft/blob/main/src/peft/tuners/prompt_tuning/model.py): `src/peft/tuners/prompt_tuning/model.py`
- [Other tuners](https://github.com/huggingface/peft/tree/main/src/peft/tuners): `src/peft/tuners`
- [Mixed adapters](https://github.com/huggingface/peft/blob/main/src/peft/mixed_model.py): `src/peft/mixed_model.py`
- [PEFT optimizers](https://github.com/huggingface/peft/tree/main/src/peft/optimizers): `src/peft/optimizers`

### Model Runtime

- [PEFT model](https://github.com/huggingface/peft/blob/main/src/peft/peft_model.py): `src/peft/peft_model.py`
- [Auto loading](https://github.com/huggingface/peft/blob/main/src/peft/auto.py): `src/peft/auto.py`
- [Tuner base utilities](https://github.com/huggingface/peft/blob/main/src/peft/tuners/tuners_utils.py): `src/peft/tuners/tuners_utils.py`

### Persistence And Integrations

- [Adapter save/load](https://github.com/huggingface/peft/blob/main/src/peft/utils/save_and_load.py): `src/peft/utils/save_and_load.py`
- [Ecosystem integrations](https://github.com/huggingface/peft/blob/main/src/peft/utils/integrations.py): `src/peft/utils/integrations.py`
- [Quantization helpers](https://github.com/huggingface/peft/blob/main/src/peft/utils/quantization_utils.py): `src/peft/utils/quantization_utils.py`

### Other components

- **Library user**
- **Pretrained model**
- **Training loop**
- **Transformers**
- **Diffusers**
- **Accelerate**

## Connections

- Library user → PEFT exports: uses
- PEFT exports → Adapter config: configures
- Library user → Pretrained model: provides
- Library user → Model factory: calls factory
- Model factory → Tuner mapping: selects tuner
- Model factory → PEFT model: wraps model
- Tuner mapping → LoRA tuner: maps method
- Tuner mapping → Prompt tuners: maps method
- Tuner mapping → Other tuners: maps methods
- PEFT model → Pretrained model: wraps
- PEFT model → Tuner base utilities: uses
- Training loop → PEFT model: trains adapters
- Library user → Training loop: runs
- Library user → Adapter save/load: saves adapter
- Adapter save/load → PEFT model: loads weights
- Library user → Auto loading: loads for inference
- Auto loading → PEFT model: constructs
- PEFT model → Pretrained model: runs inference
- PEFT model → Mixed adapters: supports mixing
- Library user → PEFT optimizers: may use
- PEFT model → Quantization helpers: supports quantized models
- Transformers → Pretrained model: provides models
- Diffusers → PEFT model: integrates adapters
- Accelerate → Training loop: distributes training
- PEFT model → Ecosystem integrations: uses integrations
