How apache/iggy works
Apache Iggy is a persistent, multi-transport message-streaming platform. The main workflow is a producer or consumer using an SDK to send or poll messages through a server transport, with partition storage providing persistence; management, consumer coordination, and integrations are additional product branches. The tree and README support these capabilities, but most server, shard, and connector implementation files were not sampled, so those links are shown as unverified rather than asserted calls.
Main entry points: main.rs Iggy server · partition_storage.rs Partition storage · tcp_client.rs Rust SDK · router.rs Shard routing
Components 19
Clients and management
- Rust SDK
core/sdk/src/tcp/tcp_client.rs
Server and transports
- Iggy server
core/server/src/main.rs - HTTP API handlers
core/server/src/http/handlers.rs - Session management
core/server/src/session_manager.rs - Binary protocol
core/binary_protocol/src/dispatch.rs - Server configuration
core/configs/src/server_config/server.rs
Streaming and persistence
- Shard routing
core/shard/src/router.rs - Partition storage
core/partitions/src/partition_storage.rs - Consumer offsets
core/partitions/src/offset_storage.rs - Durable journal
core/journal/src/durable_storage.rs
Product integrations
- Kafka gateway
gateways/kafka/src/server.rs - Connector runtime
core/connectors/runtime/src/main.rs - HTTP source
core/connectors/sources/http_source/src/routes.rs - Delta sink
core/connectors/sinks/delta_sink/src/storage.rs - MCP service
core/ai/mcp/src/service/mod.rs - MCP configuration
core/ai/mcp/src/configs.rs
Administration and UI
- CLI commands
core/cli/src/main.rs - Web permissions UI
web/src/lib/components/PermissionsManager.svelte
Other components
- Producer or consumer
Connections 16
- Producer or consumer → Rust SDK: uses SDK
- Rust SDK → Iggy server: connects to
- CLI commands → Rust SDK: issues commands
- Web permissions UI → HTTP API handlers: calls API
- Iggy server → HTTP API handlers: serves API
- Iggy server → Binary protocol: handles protocol
- Iggy server → Session management: tracks sessions
- Iggy server → Server configuration: loads settings
- Kafka gateway → Shard routing: bridges messages
- Iggy server → Shard routing: routes traffic
- Shard routing → Partition storage: dispatches requests
- Partition storage → Durable journal: persists log
- Partition storage → Consumer offsets: recovers offsets
core/partitions/src/partition_storage.rs - Connector runtime → HTTP source: hosts source
- Connector runtime → Delta sink: runs sink
- MCP service → MCP configuration: uses settings
core/ai/mcp/src/main.rs