# apache/doris architecture

> Architecture diagram of the GitHub repository apache/doris, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-30). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/apache/doris
- Repository: https://github.com/apache/doris

## Overview

Apache Doris is an MPP analytics and search database. A user submits SQL to the Frontend; query execution is distributed through Backend pipeline fragments, while storage and ingestion support real-time analytics and lakehouse access. Hybrid search extends SQL over structured, JSON, text, and vector data. The tree and excerpts show portions of Backend execution, cloud storage, authentication, and query-profile handling; other capability links are documented in the README, not verified in sampled implementation. Dashed links mark those documented but unsampled paths.

Main entry points: [`fe/fe-core`](https://github.com/apache/doris/tree/master/fe/fe-core) (SQL Frontend), [`be/src/cloud/cloud_storage_engine.cpp`](https://github.com/apache/doris/blob/master/be/src/cloud/cloud_storage_engine.cpp) (Cloud storage engine), [`be/src/agent/agent_server.cpp`](https://github.com/apache/doris/blob/master/be/src/agent/agent_server.cpp) (Backend nodes), [`be/src/exec/pipeline/pipeline_fragment_context.cpp`](https://github.com/apache/doris/blob/master/be/src/exec/pipeline/pipeline_fragment_context.cpp) (Pipeline fragments)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_frontend["Frontend services"]
  node_fe["SQL Frontend"]
  node_auth["Authentication"]
  node_authorization["Authorization context"]
  node_cancel["Query cancellation"]
  node_profiles["Query profiles"]
end

subgraph group_execution["Backend execution"]
  node_backend["Backend nodes<br/>[agent_server.cpp]"]
  node_fragment["Pipeline fragments"]
  node_taskcontrol["Task memory control"]
  node_columnar["Columnar data model<br/>[block.cpp]"]
end

subgraph group_data["Storage and ingestion"]
  node_storage[("Storage engine<br/>[storage_engine.cpp]")]
  node_cloudengine[("Cloud storage engine")]
  node_cloudmeta["Cloud metadata<br/>[cloud_meta_mgr.cpp]"]
  node_compaction["Cloud compaction"]
  node_load["Stream loading"]
  node_objstore[("Object storage")]
end

subgraph group_capabilities["Analytics capabilities"]
  node_realtime["Real-time analytics"]
  node_lakehouse["Lakehouse analytics"]
  node_search["Hybrid search"]
end

node_users(("SQL users and tools"))
node_externaldata[("Lake and object data")]

node_users -.->|"submit SQL"| node_fe
node_fe -.->|"authenticates"| node_auth
node_fe -.->|"checks access"| node_authorization
node_fe -.->|"dispatches queries"| node_backend
node_cancel -->|"checks backends"| node_backend
node_profiles -.->|"serves profile views"| node_fe
node_fragment -->|"exposes task state"| node_taskcontrol
node_fragment -.->|"processes data"| node_columnar
node_backend -.->|"executes fragments"| node_fragment
node_cloudengine -->|"uses metadata"| node_cloudmeta
node_cloudengine -->|"starts compaction"| node_compaction
node_cloudengine -.->|"uses storage"| node_objstore
node_load -.->|"writes data"| node_storage
node_realtime -.->|"supports ingestion"| node_load
node_lakehouse -->|"reads table data"| node_externaldata
node_search -.->|"supports SQL search"| node_fe
node_externaldata -.->|"stores data"| node_cloudengine
node_storage -.->|"serves queries"| node_backend

click node_fe "https://github.com/apache/doris/tree/master/fe/fe-core"
click node_auth "https://github.com/apache/doris/blob/master/fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/AuthenticationService.java"
click node_authorization "https://github.com/apache/doris/blob/master/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/EngineAuthorizationContext.java"
click node_cancel "https://github.com/apache/doris/blob/master/fe/fe-core/src/main/java/org/apache/doris/qe/QueryCancelWorker.java"
click node_profiles "https://github.com/apache/doris/blob/master/fe/fe-core/src/main/java/org/apache/doris/httpv2/controller/QueryProfileController.java"
click node_backend "https://github.com/apache/doris/blob/master/be/src/agent/agent_server.cpp"
click node_fragment "https://github.com/apache/doris/blob/master/be/src/exec/pipeline/pipeline_fragment_context.cpp"
click node_taskcontrol "https://github.com/apache/doris/blob/master/be/src/runtime/workload_management/query_task_controller.cpp"
click node_columnar "https://github.com/apache/doris/blob/master/be/src/core/block/block.cpp"
click node_storage "https://github.com/apache/doris/blob/master/be/src/storage/storage_engine.cpp"
click node_cloudengine "https://github.com/apache/doris/blob/master/be/src/cloud/cloud_storage_engine.cpp"
click node_cloudmeta "https://github.com/apache/doris/blob/master/be/src/cloud/cloud_meta_mgr.cpp"
click node_compaction "https://github.com/apache/doris/blob/master/be/src/cloud/cloud_base_compaction.cpp"
click node_load "https://github.com/apache/doris/blob/master/be/src/cloud/cloud_stream_load_executor.cpp"
click node_objstore "https://github.com/apache/doris/blob/master/common/cpp/obj-client/obj_storage_client.cpp"
click node_realtime "https://github.com/apache/doris/blob/master/be/src/cloud/cloud_delta_writer.cpp"
click node_lakehouse "https://github.com/apache/doris/blob/master/fe/fe-connector/fe-connector-spi/src/main/java/org/apache/doris/connector/spi/ConnectorStorageContext.java"
click node_search "https://github.com/apache/doris/blob/master/be/src/core/column/variant_v2/column_variant_v2.cpp"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_fe,node_auth,node_authorization,node_cancel,node_profiles,node_users toneBlue
class node_backend,node_fragment,node_taskcontrol,node_columnar,node_externaldata toneAmber
class node_storage,node_cloudengine,node_cloudmeta,node_compaction,node_load,node_objstore toneMint
class node_realtime,node_lakehouse,node_search toneRose
```

## Components

### Frontend services

- [SQL Frontend](https://github.com/apache/doris/tree/master/fe/fe-core): `fe/fe-core`
- [Authentication](https://github.com/apache/doris/blob/master/fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/AuthenticationService.java): `fe/fe-authentication/fe-authentication-handler/src/main/java/org/apache/doris/authentication/handler/AuthenticationService.java`
- [Authorization context](https://github.com/apache/doris/blob/master/fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/EngineAuthorizationContext.java): `fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/EngineAuthorizationContext.java`
- [Query cancellation](https://github.com/apache/doris/blob/master/fe/fe-core/src/main/java/org/apache/doris/qe/QueryCancelWorker.java): `fe/fe-core/src/main/java/org/apache/doris/qe/QueryCancelWorker.java`
- [Query profiles](https://github.com/apache/doris/blob/master/fe/fe-core/src/main/java/org/apache/doris/httpv2/controller/QueryProfileController.java): `fe/fe-core/src/main/java/org/apache/doris/httpv2/controller/QueryProfileController.java`

### Backend execution

- [Backend nodes](https://github.com/apache/doris/blob/master/be/src/agent/agent_server.cpp): `be/src/agent/agent_server.cpp`
- [Pipeline fragments](https://github.com/apache/doris/blob/master/be/src/exec/pipeline/pipeline_fragment_context.cpp): `be/src/exec/pipeline/pipeline_fragment_context.cpp`
- [Task memory control](https://github.com/apache/doris/blob/master/be/src/runtime/workload_management/query_task_controller.cpp): `be/src/runtime/workload_management/query_task_controller.cpp`
- [Columnar data model](https://github.com/apache/doris/blob/master/be/src/core/block/block.cpp): `be/src/core/block/block.cpp`

### Storage and ingestion

- [Storage engine](https://github.com/apache/doris/blob/master/be/src/storage/storage_engine.cpp): `be/src/storage/storage_engine.cpp`
- [Cloud storage engine](https://github.com/apache/doris/blob/master/be/src/cloud/cloud_storage_engine.cpp): `be/src/cloud/cloud_storage_engine.cpp`
- [Cloud metadata](https://github.com/apache/doris/blob/master/be/src/cloud/cloud_meta_mgr.cpp): `be/src/cloud/cloud_meta_mgr.cpp`
- [Cloud compaction](https://github.com/apache/doris/blob/master/be/src/cloud/cloud_base_compaction.cpp): `be/src/cloud/cloud_base_compaction.cpp`
- [Stream loading](https://github.com/apache/doris/blob/master/be/src/cloud/cloud_stream_load_executor.cpp): `be/src/cloud/cloud_stream_load_executor.cpp`
- [Object storage](https://github.com/apache/doris/blob/master/common/cpp/obj-client/obj_storage_client.cpp): `common/cpp/obj-client/obj_storage_client.cpp`

### Analytics capabilities

- [Real-time analytics](https://github.com/apache/doris/blob/master/be/src/cloud/cloud_delta_writer.cpp): `be/src/cloud/cloud_delta_writer.cpp`
- [Lakehouse analytics](https://github.com/apache/doris/blob/master/fe/fe-connector/fe-connector-spi/src/main/java/org/apache/doris/connector/spi/ConnectorStorageContext.java): `fe/fe-connector/fe-connector-spi/src/main/java/org/apache/doris/connector/spi/ConnectorStorageContext.java`
- [Hybrid search](https://github.com/apache/doris/blob/master/be/src/core/column/variant_v2/column_variant_v2.cpp): `be/src/core/column/variant_v2/column_variant_v2.cpp`

### Other components

- **SQL users and tools**
- **Lake and object data**

## Connections

- SQL users and tools → SQL Frontend: submit SQL (evidence: `README.md`)
- SQL Frontend → Authentication: authenticates
- SQL Frontend → Authorization context: checks access (evidence: `fe/fe-core/src/main/java/org/apache/doris/mysql/privilege/EngineAuthorizationContext.java`)
- SQL Frontend → Backend nodes: dispatches queries (evidence: `README.md`)
- Query cancellation → Backend nodes: checks backends (evidence: `fe/fe-core/src/main/java/org/apache/doris/qe/QueryCancelWorker.java`)
- Query profiles → SQL Frontend: serves profile views (evidence: `fe/fe-core/src/main/java/org/apache/doris/httpv2/controller/QueryProfileController.java`)
- Pipeline fragments → Task memory control: exposes task state (evidence: `be/src/runtime/workload_management/query_task_controller.cpp`)
- Pipeline fragments → Columnar data model: processes data
- Backend nodes → Pipeline fragments: executes fragments (evidence: `README.md`)
- Cloud storage engine → Cloud metadata: uses metadata (evidence: `be/src/cloud/cloud_storage_engine.cpp`)
- Cloud storage engine → Cloud compaction: starts compaction (evidence: `be/src/cloud/cloud_storage_engine.cpp`)
- Cloud storage engine → Object storage: uses storage
- Stream loading → Storage engine: writes data
- Real-time analytics → Stream loading: supports ingestion (evidence: `README.md`)
- Lakehouse analytics → Lake and object data: reads table data (evidence: `fe/fe-connector/fe-connector-spi/src/main/java/org/apache/doris/connector/spi/ConnectorStorageContext.java`)
- Hybrid search → SQL Frontend: supports SQL search (evidence: `README.md`)
- Lake and object data → Cloud storage engine: stores data (evidence: `README.md`)
- Storage engine → Backend nodes: serves queries (evidence: `README.md`)
