How iamd3vil/blobasaur works
Blobasaur is a Redis-protocol-compatible sharded blob store. Redis clients send commands to the TCP server, which parses and handles requests, routes storage work across shard state and SQLite, and returns RESP replies. The product also includes cluster discovery and redirects, shard migration and vacuum operations, configurable compression, TTL cleanup, and Prometheus-compatible monitoring. Edges follow explicit README statements or the shown source references; several internal details are unsampled, so uncertain links are omitted.
Main entry points: server.rs TCP command server · mod.rs Compression selection · app_state.rs Application state · shard_manager.rs Shard write workers
Components 21
Redis request serving
- Configuration
src/config.rs - RESP protocol
src/redis/protocol.rs - TCP command server
src/server.rs
Sharded storage
- Application state
src/app_state.rs - Shard selection
src/app_state.rs - Shard write workers
src/shard_manager.rs - SQLite shard databases
src/app_state.rs - Compression selection
src/compression/mod.rs - Brotli
src/compression/brotli.rs - Gzip
src/compression/gzip.rs - LZ4
src/compression/lz4.rs - No compression
src/compression/none.rs - Zstandard
src/compression/zstd.rs
Cluster operations
- Cluster discovery
src/cluster.rs
Maintenance
- Shard migration
src/migration.rs - Vacuum orchestration
src/main.rs - Shard vacuum
src/shard_manager.rs
Monitoring
- Metrics collection
src/metrics.rs - Metrics and health HTTP
src/http_server.rs
Other components
- Redis clients
- Prometheus scraper
Connections 24
- Redis clients → TCP command server: sends commands
README.md - TCP command server → RESP protocol: parses and encodes
src/server.rs - TCP command server → Application state: uses state
src/server.rs - TCP command server → Shard selection: routes requests
- Application state → Shard selection: creates hash ring
src/app_state.rs - Application state → SQLite shard databases: opens shard pools
src/app_state.rs - Shard write workers → SQLite shard databases: writes batches
src/shard_manager.rs - TCP command server → Shard write workers: dispatches storage work
src/server.rs - Application state → Compression selection: initializes compressor
src/app_state.rs - Compression selection → Brotli: selects algorithm
src/compression/mod.rs - Compression selection → Gzip: selects algorithm
src/compression/mod.rs - Compression selection → LZ4: selects algorithm
src/compression/mod.rs - Compression selection → No compression: selects algorithm
src/compression/mod.rs - Compression selection → Zstandard: selects algorithm
src/compression/mod.rs - Configuration → Compression selection: validates settings
src/config.rs - TCP command server → Cluster discovery: requests redirects
src/server.rs - Application state → Cluster discovery: initializes cluster
src/app_state.rs - Vacuum orchestration → TCP command server: connects to nodes
src/main.rs - TCP command server → Shard vacuum: dispatches vacuum
src/server.rs - Vacuum orchestration → Shard migration: runs migration command
src/main.rs - TCP command server → Metrics collection: records operations
src/server.rs - Shard write workers → Metrics collection: records shard activity
src/shard_manager.rs - Metrics and health HTTP → Metrics collection: exports metrics
src/http_server.rs - Prometheus scraper → Metrics and health HTTP: scrapes endpoint
README.md