How deepflowio/deepflow works
DeepFlow is a zero-code observability platform for cloud-native and AI applications. Host agents collect network, application, tracing, metric, and profiling signals; the server manages agents and metadata, ingests telemetry, and exposes query services. The agent workflow is represented through capture, flow/protocol processing, and forwarding; server management, ingestion, and querying remain distinct stages. README statements establish the product-level links; sampled source additionally confirms agent startup and server component startup. Unsampled subsystems are shown only where README capabilities and the repository tree support them.
Main entry points: ebpf_dispatcher.rs eBPF collection · flow_map.rs Flow generation · protocol_logs.rs Protocol parsers · trident.rs Agent runtime
Components 27
Host agent
- Agent runtime
agent/src/trident.rs - Agent configuration
agent/src/config/config.rs - Config handler
agent/src/config/handler.rs - eBPF collection
agent/src/ebpf_dispatcher.rs - Packet capture
agent/src/dispatcher/recv_engine/mod.rs - Telemetry sender
agent/src/sender/mod.rs
Telemetry processing
- Packet and flow model
agent/src/common/meta_packet.rs - Flow model
agent/src/common/flow.rs - Endpoint metadata
agent/src/common/endpoint.rs - Flow generation
agent/src/flow_generator/flow_map.rs - Protocol registry
agent/src/common/l7_protocol_log.rs - Protocol parsers
agent/src/flow_generator/protocol_logs.rs - HTTP parser
agent/src/flow_generator/protocol_logs/http.rs - L7 protocol data
agent/src/common/l7_protocol_info.rs
Server platform
- Server runtime
server/cmd/server/main.go - Agent management
server/controller/controller/controller.go - Cloud inventory
server/controller/manager/manager.go - Telemetry ingestion
server/ingester/ingester/ingester.go - Query API
server/querier/router/query.go - Query service
server/querier/service/query.go - ClickHouse storage
server/ingester/ingester/ingester.go
Observability capabilities
- Service map
agent/src/flow_generator/service_table.rs - Distributed tracing
agent/src/flow_generator - Continuous profiling
agent/src/ebpf/user/profile/perf_profiler.c - Telemetry integrations
agent/plugins - Prometheus interface
server/querier/app/prometheus/service/queryable_offload.go
Other components
- Host processes
Connections 28
- Host processes → eBPF collection: observes
README.md - Host processes → Packet capture: sends traffic
README.md - Agent runtime → Agent configuration: uses configuration
agent/src/config/config.rs - Agent runtime → eBPF collection: starts collection
agent/src/trident.rs - Packet capture → Packet and flow model: produces packets
- eBPF collection → Packet and flow model: collects signals
README.md - Packet and flow model → Flow generation: builds flows
- Flow generation → Protocol registry: selects protocol
agent/src/common/l7_protocol_log.rs - Protocol registry → Protocol parsers: dispatches parsing
agent/src/common/l7_protocol_log.rs - Protocol parsers → HTTP parser: includes parser
agent/src/flow_generator/protocol_logs.rs - Protocol parsers → L7 protocol data: produces protocol data
- Flow generation → Flow model: aggregates flows
- Flow model → Endpoint metadata: enriches metadata
agent/src/flow_generator/service_table.rs - Agent runtime → Telemetry sender: forwards telemetry
- Telemetry sender → Telemetry ingestion: sends telemetry
README.md - Server runtime → Agent management: starts
server/cmd/server/main.go - Server runtime → Telemetry ingestion: starts
server/cmd/server/main.go - Server runtime → Query service: starts
server/cmd/server/main.go - Agent management → Agent runtime: manages agents
README.md - Agent management → Cloud inventory: coordinates inventory
- Telemetry ingestion → ClickHouse storage: writes telemetry
server/ingester/ingester/ingester.go - Query API → Query service: routes queries
server/querier/router/query.go - Query service → ClickHouse storage: queries data
- Flow generation → Service map: supports service mapping
README.md - eBPF collection → Distributed tracing: collects spans
README.md - eBPF collection → Continuous profiling: collects profiles
README.md - Protocol parsers → Telemetry integrations: supports plugins
README.md - Query API → Prometheus interface: exposes queries