How apache/airflow works
Apache Airflow is a platform for authoring, scheduling, executing, and monitoring code-defined workflows (DAGs). The main path is workflow authoring through task scheduling and worker execution, followed by status inspection and troubleshooting in the UI or CLI. The tree also exposes public and execution APIs, authentication, provider discovery, and task-runtime serialization. README statements support the broad workflow links; sampled source and the limited index do not establish detailed scheduler-to-database or API routing, so those links are omitted or marked unverified.
Main entry points: app.py API application · airflow Task workers · sdk Task SDK · ui Airflow UI
Components 14
Workflow authoring
- Task SDK
task-sdk/src/airflow/sdk - DAG processing
airflow-core/src/airflow
Scheduling and execution
- Scheduler
airflow-core/src/airflow - Task workers
airflow-core/src/airflow - Execution API
airflow-core/src/airflow/api_fastapi/execution_api - Task serialization
task-sdk/src/airflow/sdk/serde/serializers/datetime.py
User interfaces
- Airflow UI
airflow-core/src/airflow/ui - Command-line tools
airflow-core/src/airflow/cli/cli_config.py
API and platform services
- API application
airflow-core/src/airflow/api_fastapi/app.py - Core API
airflow-core/src/airflow/api_fastapi/core_api - Authentication
airflow-core/src/airflow/api_fastapi/auth/managers/base_auth_manager.py - Provider runtime
task-sdk/src/airflow/sdk/providers_manager_runtime.py - Metadata database
Other components
- Workflow author
Connections 14
- Workflow author → Task SDK: authors DAGs
- Task SDK → DAG processing: defines workflows
airflow-core/src/airflow/exceptions.py - DAG processing → Scheduler: provides DAGs
- Scheduler → Task workers: dispatches tasks
- Task workers → Execution API: uses task endpoints
airflow-core/src/airflow/api_fastapi/app.py - Task workers → Task serialization: serializes values
airflow-core/src/airflow/api_fastapi/common/types.py - Workflow author → Airflow UI: monitors workflows
- Workflow author → Command-line tools: manages DAGs
- Airflow UI → API application: requests data
- Command-line tools → API application: invokes API
- API application → Core API: routes requests
airflow-core/src/airflow/api_fastapi/app.py - API application → Authentication: registers auth
airflow-core/src/airflow/api_fastapi/app.py - Core API → Metadata database: reads workflow state
- Provider runtime → Task SDK: loads SDK interfaces
task-sdk/src/airflow/sdk/providers_manager_runtime.py