How benahmed-adam/zestdb works
ZestDB is a disk-persistent, sharded key-value database. Its main workflow is TCP client commands through session framing/authentication, command parsing and validation, hash-based shard dispatch, and durable indexed storage; bulk pattern operations fan out across shards. Separate documented capabilities include HTTP metrics, configuration control, WAL recovery, background flush/compaction, archiving, and logging. Edges reflect README statements or indexed source references; unsampled internals are represented at their exact source paths, and uncertain wiring is omitted.
Main entry points: ZestDB.cpp Database facade · Shard.cpp Shard engine · ShardManager.cpp Shard routing · Server.cpp Session framing
Components 18
Client access
- Session framing
src/Server.cpp - TCP server
src/Server.cpp
Command and control
- Database facade
src/ZestDB.cpp - Config management
src/ZestDB.cpp
Sharded execution
- Shard routing
src/ShardManager.cpp - Parallel bulk ops
src/ShardManager.cpp - Shard engine
src/Shard.cpp - Worker pool
src/ThreadPool.cpp
Durable storage
- In-memory index
src/IndexManager.cpp - Segment storage
src/StorageManager.cpp - LRU cache
src/LRUCache.cpp - Write-ahead log
src/WAL.cpp
Operations and observability
- Performance counters
src/PerfMonitoring.cpp - HTTP metrics
src/ZestDB.cpp - Flush and compaction
src/Shard.cpp - Database archiving
src/ZestDB.cpp - Logging
src/Logger.cpp
Other components
- TCP client
Connections 20
- TCP client → TCP server: sends commands
README.md - TCP server → Session framing: accepts sessions
src/Server.cpp - Session framing → Database facade: dispatches commands
src/Server.cpp - Database facade → Shard routing: routes operations
README.md - Database facade → Config management: loads and updates
src/ZestDB.cpp - Shard routing → Shard engine: hash routes keys
src/ShardManager.cpp - Shard routing → Parallel bulk ops: dispatches bulk work
src/ShardManager.cpp - Parallel bulk ops → Worker pool: enqueues shard tasks
src/ShardManager.cpp - Shard engine → In-memory index: looks up and updates
- Shard engine → Segment storage: reads and appends values
src/StorageManager.cpp - Shard engine → LRU cache: uses hot entries
- Shard engine → Write-ahead log: records mutations
README.md - Shard engine → Performance counters: records operation metrics
README.md - HTTP metrics → Performance counters: exposes statistics
README.md - Flush and compaction → In-memory index: compacts index
README.md - Flush and compaction → Segment storage: removes obsolete segments
README.md - Database facade → Flush and compaction: flushes periodically
README.md - Database facade → Database archiving: creates archives
README.md - Database facade → Write-ahead log: replays on startup
- Database facade → Logging: logs activity
src/ZestDB.cpp