How flyteorg/flyte works
Flyte 2 is presented as an ML workflow and model-serving platform; this repository is its emerging Kubernetes-native backend, not the Python SDK. The principal visible runtime path is a Kubernetes TaskAction being reconciled and dispatched to a task plugin, whose state and result are reflected in the action status. Separate backend services expose cache, data proxy, app, action, event, and auth capabilities. The README says the open-source backend is still coming; the graph therefore shows documented subsystems but only asserts links supported by sampled source or explicit documentation.
Main entry points: taskaction_controller.go Action reconciler · dataproxy_service.go Data proxy · plugin_manager.go Kubernetes plugin manager · taskaction_types.go TaskAction API
Components 23
Task execution
- TaskAction API
executor/api/v1/taskaction_types.go - Action reconciler
executor/pkg/controller/taskaction_controller.go - Plugin registry
executor/pkg/plugin/registry.go - Kubernetes plugin manager
executor/pkg/plugin/k8s/plugin_manager.go - Task plugins
flyteplugins/go/tasks/plugins - Plugin state
executor/pkg/plugin/state_manager.go
Data services
- Cache service
cache_service/service/service.go - Cache manager
cache_service/manager/manager.go - Cache repositories
cache_service/repository/repository.go - Cache metadata
cache_service/repository/impl/cached_output.go - Data proxy
dataproxy/service/dataproxy_service.go - Literal translation
dataproxy/translator.go - Copilot transfer
flytecopilot/data/upload.go
Platform APIs
- Events proxy
events/service/events_proxy_service.go - Auth metadata
runs/service/auth_metadata_service.go
Apps and actions
- App service
app/service/app_service.go - App logs
app/service/app_logs_service.go - Actions service
actions/service/actions_service.go
Other components
- Task client
- Kubernetes API
- Blob storage
- Backend client
- External auth server
Connections 21
- Task client → TaskAction API: creates
- TaskAction API → Action reconciler: reconciles
- Action reconciler → Plugin registry: dispatches via
- Action reconciler → Plugin state: persists state
- Action reconciler → Kubernetes API: reads and updates
- Kubernetes plugin manager → Kubernetes API: manages resources
- Kubernetes plugin manager → Task plugins: checks plugin phase
- Backend client → Cache service: requests cache
- Cache service → Cache manager: handles requests
- Cache manager → Cache repositories: reads and writes
- Cache repositories → Cache metadata: stores metadata
- Backend client → Data proxy: requests data
- Data proxy → Literal translation: translates literals
- Data proxy → Blob storage: accesses data
- Copilot transfer → Blob storage: uploads data
- Backend client → App service: manages apps
- Backend client → App logs: requests logs
- Backend client → Actions service: invokes actions
- Backend client → Events proxy: sends events
- Backend client → Auth metadata: requests metadata
- Auth metadata → External auth server: fetches metadata