# pentaho/pentaho-kettle architecture

> Architecture diagram of the GitHub repository pentaho/pentaho-kettle, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/pentaho/pentaho-kettle
- Repository: https://github.com/pentaho/pentaho-kettle

## Overview

Pentaho Data Integration (Kettle) is an ETL platform. Its principal workflow is to define a transformation, execute it in the engine, move typed rows through processing steps, and connect to databases or other services. Repository access supports saving and retrieving jobs and transformations; plugins add extensible engine and data-source capabilities. The README describes the project’s core, engine, UI, database dialog, extensions, and plugins, but the supplied excerpts do not show the main transformation execution path, so those links are omitted rather than inferred.

Main entry points: [`engine/src/main/java/org/pentaho/di/trans`](https://github.com/pentaho/pentaho-kettle/tree/master/engine/src/main/java/org/pentaho/di/trans) (Transformation runtime), [`core/src/main/java/org/pentaho/di/core/database/Database.java`](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/Database.java) (Database access), [`core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java`](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java) (Database definitions), [`core/src/main/java/org/pentaho/di/core/plugins`](https://github.com/pentaho/pentaho-kettle/tree/master/core/src/main/java/org/pentaho/di/core/plugins) (Plugin registry)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_engine["ETL engine"]
  node_design["Transformation design"]
  node_runtime["Transformation runtime"]
  node_webservice["Web service step<br/>[WebService.java]"]
  node_typedrows["Typed row data<br/>[Row.java]"]
end

subgraph group_connectivity["Data connectivity"]
  node_database["Database access<br/>[Database.java]"]
  node_dbmetadata["Database definitions<br/>[DatabaseMeta.java]"]
  node_dbdrivers["Database dialects"]
  node_connections["Connection management"]
  node_vfs["Virtual file access"]
end

subgraph group_platform["Platform services"]
  node_repository["Repository operations<br/>[Repository.java]"]
  node_bowl["Bowl context<br/>[Bowl.java]"]
  node_logging["Logging"]
end

subgraph group_extensions["Extensions"]
  node_pluginregistry["Plugin registry"]
  node_engineplugins["Engine plugins"]
  node_databaseplugins["Database plugins"]
end

node_user(("ETL author"))

node_user -.->|"defines"| node_design
node_design -.->|"executes in"| node_runtime
node_runtime -.->|"runs step"| node_webservice
node_runtime -.->|"processes rows"| node_typedrows
node_runtime -.->|"uses"| node_database
node_database -.->|"uses definition"| node_dbmetadata
node_dbmetadata -->|"selects dialect"| node_dbdrivers
node_connections -.->|"provides VFS"| node_vfs
node_design -.->|"persists through"| node_repository
node_runtime -.->|"uses context"| node_bowl
node_engineplugins -->|"registers with"| node_pluginregistry
node_databaseplugins -.->|"discovered by"| node_pluginregistry

click node_design "https://github.com/pentaho/pentaho-kettle/tree/master/engine/src/main/java/org/pentaho/di/trans"
click node_runtime "https://github.com/pentaho/pentaho-kettle/tree/master/engine/src/main/java/org/pentaho/di/trans"
click node_webservice "https://github.com/pentaho/pentaho-kettle/blob/master/engine/src/main/java/org/pentaho/di/trans/steps/webservices/WebService.java"
click node_typedrows "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/compatibility/Row.java"
click node_database "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/Database.java"
click node_dbmetadata "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java"
click node_dbdrivers "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/DatabaseInterface.java"
click node_connections "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/connections/ConnectionManager.java"
click node_vfs "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/connections/vfs/VFSConnectionProvider.java"
click node_repository "https://github.com/pentaho/pentaho-kettle/blob/master/engine/src/main/java/org/pentaho/di/repository/Repository.java"
click node_bowl "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/bowl/Bowl.java"
click node_logging "https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/logging/LogChannelInterface.java"
click node_pluginregistry "https://github.com/pentaho/pentaho-kettle/tree/master/core/src/main/java/org/pentaho/di/core/plugins"
click node_engineplugins "https://github.com/pentaho/pentaho-kettle/blob/master/engine-ext/api/src/main/java/org/pentaho/di/core/plugins/EnginePluginType.java"
click node_databaseplugins "https://github.com/pentaho/pentaho-kettle/tree/master/core/src/main/java/org/pentaho/di/core/database"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_design,node_runtime,node_webservice,node_typedrows toneBlue
class node_database,node_dbmetadata,node_dbdrivers,node_connections,node_vfs toneAmber
class node_repository,node_bowl,node_logging toneMint
class node_pluginregistry,node_engineplugins,node_databaseplugins toneRose
class node_user toneIndigo
```

## Components

### ETL engine

- [Transformation design](https://github.com/pentaho/pentaho-kettle/tree/master/engine/src/main/java/org/pentaho/di/trans): `engine/src/main/java/org/pentaho/di/trans`
- [Transformation runtime](https://github.com/pentaho/pentaho-kettle/tree/master/engine/src/main/java/org/pentaho/di/trans): `engine/src/main/java/org/pentaho/di/trans`
- [Web service step](https://github.com/pentaho/pentaho-kettle/blob/master/engine/src/main/java/org/pentaho/di/trans/steps/webservices/WebService.java): `engine/src/main/java/org/pentaho/di/trans/steps/webservices/WebService.java`
- [Typed row data](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/compatibility/Row.java): `core/src/main/java/org/pentaho/di/compatibility/Row.java`

### Data connectivity

- [Database access](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/Database.java): `core/src/main/java/org/pentaho/di/core/database/Database.java`
- [Database definitions](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java): `core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java`
- [Database dialects](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/database/DatabaseInterface.java): `core/src/main/java/org/pentaho/di/core/database/DatabaseInterface.java`
- [Connection management](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/connections/ConnectionManager.java): `core/src/main/java/org/pentaho/di/connections/ConnectionManager.java`
- [Virtual file access](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/connections/vfs/VFSConnectionProvider.java): `core/src/main/java/org/pentaho/di/connections/vfs/VFSConnectionProvider.java`

### Platform services

- [Repository operations](https://github.com/pentaho/pentaho-kettle/blob/master/engine/src/main/java/org/pentaho/di/repository/Repository.java): `engine/src/main/java/org/pentaho/di/repository/Repository.java`
- [Bowl context](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/bowl/Bowl.java): `core/src/main/java/org/pentaho/di/core/bowl/Bowl.java`
- [Logging](https://github.com/pentaho/pentaho-kettle/blob/master/core/src/main/java/org/pentaho/di/core/logging/LogChannelInterface.java): `core/src/main/java/org/pentaho/di/core/logging/LogChannelInterface.java`

### Extensions

- [Plugin registry](https://github.com/pentaho/pentaho-kettle/tree/master/core/src/main/java/org/pentaho/di/core/plugins): `core/src/main/java/org/pentaho/di/core/plugins`
- [Engine plugins](https://github.com/pentaho/pentaho-kettle/blob/master/engine-ext/api/src/main/java/org/pentaho/di/core/plugins/EnginePluginType.java): `engine-ext/api/src/main/java/org/pentaho/di/core/plugins/EnginePluginType.java`
- [Database plugins](https://github.com/pentaho/pentaho-kettle/tree/master/core/src/main/java/org/pentaho/di/core/database): `core/src/main/java/org/pentaho/di/core/database`

### Other components

- **ETL author**

## Connections

- ETL author → Transformation design: defines
- Transformation design → Transformation runtime: executes in
- Transformation runtime → Web service step: runs step (evidence: `engine/src/main/java/org/pentaho/di/trans/steps/webservices/WebService.java`)
- Transformation runtime → Typed row data: processes rows
- Transformation runtime → Database access: uses (evidence: `engine/src/main/java/org/pentaho/di/trans/TransMeta.java`)
- Database access → Database definitions: uses definition (evidence: `core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java`)
- Database definitions → Database dialects: selects dialect (evidence: `core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java`)
- Connection management → Virtual file access: provides VFS (evidence: `core/src/main/java/org/pentaho/di/connections/ConnectionManager.java`)
- Transformation design → Repository operations: persists through (evidence: `README.md`)
- Transformation runtime → Bowl context: uses context (evidence: `engine/src/main/java/org/pentaho/di/trans/TransMeta.java`)
- Engine plugins → Plugin registry: registers with (evidence: `engine-ext/api/src/main/java/org/pentaho/di/core/plugins/EnginePluginType.java`)
- Database plugins → Plugin registry: discovered by (evidence: `core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java`)
