# apache/nifi architecture

> Architecture diagram of the GitHub repository apache/nifi, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/apache/nifi
- Repository: https://github.com/apache/nifi

## Overview

Apache NiFi is a data-processing and distribution platform; this source selection also exposes its MiNiFi C2 client and protocol. The documented user journey is to design and manage pipelines through the browser or REST API, then process and distribute data with delivery guarantees and provenance. The graph includes those documented product capabilities alongside the more specific C2 heartbeat, command, and transport components visible in the tree. Source excerpts are sparse, so several application-level relationships are documented or explicitly unverified rather than inferred from module names.

Main entry points: [`c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatManager.java`](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatManager.java) (Heartbeat Manager), [`c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/C2HttpClient.java`](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/C2HttpClient.java) (HTTP Client), [`nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/connectable/Connection.java`](https://github.com/apache/nifi/blob/main/nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/connectable/Connection.java) (Pipeline Runtime), [`c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2OperationManager.java`](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2OperationManager.java) (Operation Manager)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_product["NiFi Platform"]
  node_browser["Browser UI"]
  node_rest["REST API"]
  node_pipeline["Pipeline Runtime<br/>[Connection.java]"]
  node_provenance[("Provenance")]
end

subgraph group_c2["C2 Client"]
  node_c2service["MiNiFi C2 Service"]
  node_heartbeat["Heartbeat Manager"]
  node_heartbeatfactory["Heartbeat Factory"]
  node_manifest["Manifest Hash"]
  node_identity[("Persistent Identity")]
end

subgraph group_protocol["C2 Protocol"]
  node_protocolmodels["Heartbeat And Operations<br/>[C2Heartbeat.java]"]
  node_componentmanifest["Component Manifest"]
end

subgraph group_operations["C2 Operations"]
  node_operationmanager["Operation Manager"]
  node_operationhandlers["Operation Handlers"]
  node_operationqueue["Operation Queue"]
end

subgraph group_transport["C2 Transport"]
  node_httpclient["HTTP Client<br/>[C2HttpClient.java]"]
  node_urlprovider["C2 URL Provider"]
  node_serializer["C2 Serializer"]
end

node_operator(("Operator"))
node_externaldata(("External Data Systems"))
node_c2server(("C2 Server"))

node_operator -->|"designs and monitors"| node_browser
node_operator -->|"orchestrates"| node_rest
node_browser -.->|"controls"| node_pipeline
node_rest -->|"orchestrates"| node_pipeline
node_pipeline -->|"distributes data"| node_externaldata
node_pipeline -->|"records lineage"| node_provenance
node_c2service -.->|"manages heartbeats"| node_heartbeat
node_heartbeat -.->|"creates heartbeats"| node_heartbeatfactory
node_heartbeat -.->|"includes manifest hash"| node_manifest
node_heartbeat -.->|"uses identity"| node_identity
node_heartbeat -.->|"exchanges messages"| node_protocolmodels
node_heartbeat -.->|"sends heartbeat"| node_httpclient
node_httpclient -.->|"resolves endpoint"| node_urlprovider
node_httpclient -.->|"serializes messages"| node_serializer
node_httpclient -.->|"communicates with"| node_c2server
node_c2server -.->|"returns operations"| node_httpclient
node_protocolmodels -.->|"carries commands"| node_operationmanager
node_operationmanager -.->|"queues operations"| node_operationqueue
node_operationmanager -.->|"dispatches operations"| node_operationhandlers
node_operationhandlers -.->|"controls runtime"| node_pipeline
node_componentmanifest -.->|"describes components"| node_c2server

click node_pipeline "https://github.com/apache/nifi/blob/main/nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/connectable/Connection.java"
click node_provenance "https://github.com/apache/nifi/blob/main/nifi-framework-bundle/nifi-framework-extensions/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/util/StorageSummaryEvent.java"
click node_c2service "https://github.com/apache/nifi/blob/main/minifi/minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-framework-core/src/main/java/org/apache/nifi/minifi/c2/C2NifiClientService.java"
click node_heartbeat "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatManager.java"
click node_heartbeatfactory "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatFactory.java"
click node_manifest "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/ManifestHashProvider.java"
click node_identity "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-base/src/main/java/org/apache/nifi/c2/client/PersistentUuidGenerator.java"
click node_protocolmodels "https://github.com/apache/nifi/blob/main/c2/c2-protocol/c2-protocol-api/src/main/java/org/apache/nifi/c2/protocol/api/C2Heartbeat.java"
click node_componentmanifest "https://github.com/apache/nifi/blob/main/c2/c2-protocol/c2-protocol-component-api/src/main/java/org/apache/nifi/c2/protocol/component/api/PropertyDescriptor.java"
click node_operationmanager "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2OperationManager.java"
click node_operationhandlers "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/operation/C2OperationHandlerProvider.java"
click node_operationqueue "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/operation/OperationQueue.java"
click node_httpclient "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/C2HttpClient.java"
click node_urlprovider "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/url/C2UrlProviderFactory.java"
click node_serializer "https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-base/src/main/java/org/apache/nifi/c2/serializer/C2JacksonSerializer.java"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_browser,node_rest,node_pipeline,node_provenance toneBlue
class node_c2service,node_heartbeat,node_heartbeatfactory,node_manifest,node_identity toneAmber
class node_protocolmodels,node_componentmanifest,node_c2server toneMint
class node_operationmanager,node_operationhandlers,node_operationqueue toneRose
class node_httpclient,node_urlprovider,node_serializer,node_operator,node_externaldata toneIndigo
```

## Components

### NiFi Platform

- **Browser UI**
- **REST API**
- [Pipeline Runtime](https://github.com/apache/nifi/blob/main/nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/connectable/Connection.java): `nifi-framework-bundle/nifi-framework/nifi-framework-core-api/src/main/java/org/apache/nifi/connectable/Connection.java`
- [Provenance](https://github.com/apache/nifi/blob/main/nifi-framework-bundle/nifi-framework-extensions/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/util/StorageSummaryEvent.java): `nifi-framework-bundle/nifi-framework-extensions/nifi-provenance-repository-bundle/nifi-persistent-provenance-repository/src/main/java/org/apache/nifi/provenance/util/StorageSummaryEvent.java`

### C2 Client

- [MiNiFi C2 Service](https://github.com/apache/nifi/blob/main/minifi/minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-framework-core/src/main/java/org/apache/nifi/minifi/c2/C2NifiClientService.java): `minifi/minifi-nar-bundles/minifi-framework-bundle/minifi-framework/minifi-framework-core/src/main/java/org/apache/nifi/minifi/c2/C2NifiClientService.java`
- [Heartbeat Manager](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatManager.java): `c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatManager.java`
- [Heartbeat Factory](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatFactory.java): `c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2HeartbeatFactory.java`
- [Manifest Hash](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/ManifestHashProvider.java): `c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/ManifestHashProvider.java`
- [Persistent Identity](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-base/src/main/java/org/apache/nifi/c2/client/PersistentUuidGenerator.java): `c2/c2-client-bundle/c2-client-base/src/main/java/org/apache/nifi/c2/client/PersistentUuidGenerator.java`

### C2 Protocol

- [Heartbeat And Operations](https://github.com/apache/nifi/blob/main/c2/c2-protocol/c2-protocol-api/src/main/java/org/apache/nifi/c2/protocol/api/C2Heartbeat.java): `c2/c2-protocol/c2-protocol-api/src/main/java/org/apache/nifi/c2/protocol/api/C2Heartbeat.java`
- [Component Manifest](https://github.com/apache/nifi/blob/main/c2/c2-protocol/c2-protocol-component-api/src/main/java/org/apache/nifi/c2/protocol/component/api/PropertyDescriptor.java): `c2/c2-protocol/c2-protocol-component-api/src/main/java/org/apache/nifi/c2/protocol/component/api/PropertyDescriptor.java`

### C2 Operations

- [Operation Manager](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2OperationManager.java): `c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/C2OperationManager.java`
- [Operation Handlers](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/operation/C2OperationHandlerProvider.java): `c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/operation/C2OperationHandlerProvider.java`
- [Operation Queue](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/operation/OperationQueue.java): `c2/c2-client-bundle/c2-client-service/src/main/java/org/apache/nifi/c2/client/service/operation/OperationQueue.java`

### C2 Transport

- [HTTP Client](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/C2HttpClient.java): `c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/C2HttpClient.java`
- [C2 URL Provider](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/url/C2UrlProviderFactory.java): `c2/c2-client-bundle/c2-client-http/src/main/java/org/apache/nifi/c2/client/http/url/C2UrlProviderFactory.java`
- [C2 Serializer](https://github.com/apache/nifi/blob/main/c2/c2-client-bundle/c2-client-base/src/main/java/org/apache/nifi/c2/serializer/C2JacksonSerializer.java): `c2/c2-client-bundle/c2-client-base/src/main/java/org/apache/nifi/c2/serializer/C2JacksonSerializer.java`

### Other components

- **Operator**
- **External Data Systems**
- **C2 Server**

## Connections

- Operator → Browser UI: designs and monitors
- Operator → REST API: orchestrates
- Browser UI → Pipeline Runtime: controls
- REST API → Pipeline Runtime: orchestrates
- Pipeline Runtime → External Data Systems: distributes data
- Pipeline Runtime → Provenance: records lineage
- MiNiFi C2 Service → Heartbeat Manager: manages heartbeats
- Heartbeat Manager → Heartbeat Factory: creates heartbeats
- Heartbeat Manager → Manifest Hash: includes manifest hash
- Heartbeat Manager → Persistent Identity: uses identity
- Heartbeat Manager → Heartbeat And Operations: exchanges messages
- Heartbeat Manager → HTTP Client: sends heartbeat
- HTTP Client → C2 URL Provider: resolves endpoint
- HTTP Client → C2 Serializer: serializes messages
- HTTP Client → C2 Server: communicates with
- C2 Server → HTTP Client: returns operations
- Heartbeat And Operations → Operation Manager: carries commands
- Operation Manager → Operation Queue: queues operations
- Operation Manager → Operation Handlers: dispatches operations
- Operation Handlers → Pipeline Runtime: controls runtime
- Component Manifest → C2 Server: describes components
