How georgeslks/java_lowlatency_eventmessaging_engine works
This Java low-latency event messaging engine accepts framed events over TCP, decodes them, queues them through a bounded ring buffer, and persists them to ClickHouse over HTTP. Main wires the runtime; client handlers own decoding and publication, while the consumer owns dequeueing and processing. Configuration comes from environment variables. The README documents the broker and ring-buffer/network pipeline; unsampled internals are represented only where the source index or documentation supports them.
Main entry points: Main.java Engine Main · ClickHouseHttpWriter.java HTTP Writer · Partition.java Partition · ClickHouseConfig.java ClickHouse Config
Components 17
TCP Ingress
- Network Server
src/main/java/engine/network/NetworkServer.java - Client Handler
src/main/java/engine/network/ClientHandler.java - Event Decoder
src/main/java/engine/network/EventDecoder.java - Event Type
src/main/java/engine/EventType.java
Event Queue
- Event Model
src/main/java/engine/Event.java - Event Bus
src/main/java/engine/EventBus.java - Partition
src/main/java/engine/Partition.java - Ring Buffer
src/main/java/engine/RingBuffer.java - Event Consumer
src/main/java/engine/EventConsumer.java
ClickHouse Persistence
- Event Processor
src/main/java/engine/EventProcessor.java - HTTP Writer
src/main/java/engine/clickhouseConnectors/http/ClickHouseHttpWriter.java - HTTP Client
src/main/java/engine/clickhouseConnectors/http/ClickHouseHttpClient.java - ClickHouse Config
src/main/java/engine/clickhouseConnectors/config/ClickHouseConfig.java
Runtime Setup
- Engine Main
src/main/java/engine/Main.java
Other components
- TCP Clients
- ClickHouse
- Environment
Connections 26
- TCP Clients → Network Server: opens TCP
src/main/java/engine/network/NetworkServer.java - Network Server → Client Handler: dispatches clients
src/main/java/engine/network/NetworkServer.java - Client Handler → Event Decoder: decodes payload
src/main/java/engine/network/ClientHandler.java - Event Decoder → Event Model: creates events
src/main/java/engine/network/EventDecoder.java - Event Decoder → Event Type: uses event types
src/main/java/engine/network/EventDecoder.java - Event Model → Event Type: has type
src/main/java/engine/Event.java - Client Handler → Event Bus: publishes events
src/main/java/engine/network/ClientHandler.java - Event Bus → Partition: publishes to
src/main/java/engine/EventBus.java - Partition → Ring Buffer: adds and polls
src/main/java/engine/Partition.java - Event Consumer → Partition: consumes from
src/main/java/engine/EventConsumer.java - Event Consumer → Event Processor: processes event
src/main/java/engine/EventConsumer.java - Event Processor → HTTP Writer: writes event
src/main/java/engine/EventProcessor.java - HTTP Writer → HTTP Client: sends insert
src/main/java/engine/clickhouseConnectors/http/ClickHouseHttpWriter.java - HTTP Writer → ClickHouse Config: reads settings
src/main/java/engine/clickhouseConnectors/http/ClickHouseHttpWriter.java - HTTP Client → ClickHouse Config: builds endpoint
src/main/java/engine/clickhouseConnectors/http/ClickHouseHttpClient.java - HTTP Writer → ClickHouse: inserts over HTTP
src/main/java/engine/clickhouseConnectors/http/ClickHouseHttpWriter.java - Environment → ClickHouse Config: provides settings
src/main/java/engine/clickhouseConnectors/config/ClickHouseConfig.java - Engine Main → ClickHouse Config: initializes
src/main/java/engine/Main.java - Engine Main → HTTP Client: initializes
src/main/java/engine/Main.java - Engine Main → HTTP Writer: initializes
src/main/java/engine/Main.java - Engine Main → Ring Buffer: initializes
src/main/java/engine/Main.java - Engine Main → Partition: initializes
src/main/java/engine/Main.java - Engine Main → Event Bus: initializes
src/main/java/engine/Main.java - Engine Main → Event Processor: initializes
src/main/java/engine/Main.java - Engine Main → Event Consumer: starts consumer
src/main/java/engine/Main.java - Engine Main → Network Server: starts server
src/main/java/engine/Main.java