How robustmq/robustmq works
RobustMQ is a unified, multi-protocol messaging broker: clients publish or send messages through MQTT, Kafka, NATS, AMQP, or mq9, and protocol consumers can read shared message storage. The README also describes mq9 agent discovery and persistent mailboxes, tenant isolation, connectors, multiple storage modes, and Raft-backed clustering. The tree and excerpts support the major subsystems, but not all protocol-handler internals; edges therefore rely on the documented shared-storage and capability relationships rather than inferred calls between unsampled modules.
Main entry points: cache.rs Storage engine · manager.rs Tenant and permissions · mqtt-broker MQTT broker · kafka-broker Kafka broker
Components 16
Messaging protocols
- MQTT broker
src/mqtt-broker - Kafka broker
src/kafka-broker - NATS broker
src/nats-broker - AMQP broker
src/amqp-broker - mq9 agent messaging
src/mq9-core
Shared data plane
- Storage engine
src/storage-engine/src/core/cache.rs - Memory storage
src/storage-engine/src/commitlog/memory/engine.rs - RocksDB storage
src/storage-engine/src/commitlog/rocksdb/engine.rs - Shard offsets
src/storage-engine/src/core/offset.rs
Cluster management
- Metadata service
src/meta-service/src/core/cache.rs - Raft coordination
src/meta-service/src/raft/manager.rs - Metadata gRPC
src/meta-service/src/server/service_engine.rs
Extensions and management
- Data connectors
src/connector/src/core.rs - Admin and MCP
src/admin-server/src/server.rs - Tenant and permissions
src/common/security/src/manager.rs
Other components
- Clients and agents
Connections 22
- Clients and agents → MQTT broker: publishes and subscribes
- Clients and agents → Kafka broker: produces and consumes
- Clients and agents → NATS broker: publishes and subscribes
- Clients and agents → AMQP broker: publishes and consumes
- Clients and agents → mq9 agent messaging: discovers and messages
- MQTT broker → Storage engine: shares message storage
- Kafka broker → Storage engine: shares message storage
- NATS broker → Storage engine: shares message storage
- AMQP broker → Storage engine: shares message storage
- mq9 agent messaging → Storage engine: shares message storage
- Storage engine → Memory storage: uses storage mode
src/storage-engine/src/commitlog/memory/engine.rs - Storage engine → RocksDB storage: uses storage mode
src/storage-engine/src/commitlog/rocksdb/engine.rs - Storage engine → Shard offsets: tracks shard offsets
src/storage-engine/src/commitlog/memory/engine.rs - Metadata service → Raft coordination: coordinates cluster state
- Metadata gRPC → Metadata service: serves metadata operations
src/meta-service/src/server/service_engine.rs - Data connectors → Storage engine: exports messages
- Admin and MCP → Metadata service: manages cluster
- Tenant and permissions → MQTT broker: isolates tenant access
- Tenant and permissions → Kafka broker: isolates tenant access
- Tenant and permissions → NATS broker: isolates tenant access
- Tenant and permissions → AMQP broker: isolates tenant access
- Tenant and permissions → mq9 agent messaging: isolates tenant access