How pentaho/pentaho-kettle works
Pentaho Data Integration (Kettle) is an ETL platform. Its principal workflow is to define a transformation, execute it in the engine, move typed rows through processing steps, and connect to databases or other services. Repository access supports saving and retrieving jobs and transformations; plugins add extensible engine and data-source capabilities. The README describes the project’s core, engine, UI, database dialog, extensions, and plugins, but the supplied excerpts do not show the main transformation execution path, so those links are omitted rather than inferred.
Main entry points: trans Transformation runtime · Database.java Database access · DatabaseMeta.java Database definitions · plugins Plugin registry
Components 16
ETL engine
- Transformation design
engine/src/main/java/org/pentaho/di/trans - Transformation runtime
engine/src/main/java/org/pentaho/di/trans - Web service step
engine/src/main/java/org/pentaho/di/trans/steps/webservices/WebService.java - Typed row data
core/src/main/java/org/pentaho/di/compatibility/Row.java
Data connectivity
- Database access
core/src/main/java/org/pentaho/di/core/database/Database.java - Database definitions
core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java - Database dialects
core/src/main/java/org/pentaho/di/core/database/DatabaseInterface.java - Connection management
core/src/main/java/org/pentaho/di/connections/ConnectionManager.java - Virtual file access
core/src/main/java/org/pentaho/di/connections/vfs/VFSConnectionProvider.java
Platform services
- Repository operations
engine/src/main/java/org/pentaho/di/repository/Repository.java - Bowl context
core/src/main/java/org/pentaho/di/core/bowl/Bowl.java - Logging
core/src/main/java/org/pentaho/di/core/logging/LogChannelInterface.java
Extensions
- Plugin registry
core/src/main/java/org/pentaho/di/core/plugins - Engine plugins
engine-ext/api/src/main/java/org/pentaho/di/core/plugins/EnginePluginType.java - Database plugins
core/src/main/java/org/pentaho/di/core/database
Other components
- ETL author
Connections 12
- ETL author → Transformation design: defines
- Transformation design → Transformation runtime: executes in
- Transformation runtime → Web service step: runs step
engine/src/main/java/org/pentaho/di/trans/steps/webservices/WebService.java - Transformation runtime → Typed row data: processes rows
- Transformation runtime → Database access: uses
engine/src/main/java/org/pentaho/di/trans/TransMeta.java - Database access → Database definitions: uses definition
core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java - Database definitions → Database dialects: selects dialect
core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java - Connection management → Virtual file access: provides VFS
core/src/main/java/org/pentaho/di/connections/ConnectionManager.java - Transformation design → Repository operations: persists through
README.md - Transformation runtime → Bowl context: uses context
engine/src/main/java/org/pentaho/di/trans/TransMeta.java - Engine plugins → Plugin registry: registers with
engine-ext/api/src/main/java/org/pentaho/di/core/plugins/EnginePluginType.java - Database plugins → Plugin registry: discovered by
core/src/main/java/org/pentaho/di/core/database/DatabaseMeta.java