How monish-k-s/log_analytics_platform works
This is a real-time log observability platform. A scheduled producer generates log events, publishes them to Kafka, and the processing engine consumes them for in-memory analytics, PostgreSQL persistence, and Lucene indexing. REST endpoints expose log queries, analytics, and search. The README also documents Grafana dashboards; their precise data connection is not established by the sampled source, so no runtime link is asserted. Processing and producer paths are sampled; other integrations reflect documented capabilities where noted.
Main entry points: LogAnalyticsService.java Analytics service · LogController.java REST controller · LogRepository.java Log repository · LogGenerator.java Log generator
Components 13
Log ingestion
- Log generator
producer-service/src/main/java/com/monish/producer/generator/LogGenerator.java - Log event
producer-service/src/main/java/com/monish/common/model/LogEvent.java - Kafka publisher
producer-service/src/main/java/com/monish/producer/service/KafkaProducerService.java - Kafka topic
Processing and storage
- Log consumer
processing-engine/src/main/java/com/monish/processing/consumer/LogConsumer.java - Analytics service
processing-engine/src/main/java/com/monish/processing/analytics/LogAnalyticsService.java - Log entity
processing-engine/src/main/java/com/monish/processing/entity/LogEntity.java - Log repository
processing-engine/src/main/java/com/monish/processing/repository/LogRepository.java - PostgreSQL
- Lucene index
processing-engine/src/main/java/com/monish/processing/service/LuceneIndexService.java
Queries and analytics
- REST controller
processing-engine/src/main/java/com/monish/processing/controller/LogController.java
Observability
- Grafana dashboards
Other components
- API client
Connections 14
- Log generator → Log event: creates
- Log generator → Kafka publisher: publishes via
- Kafka publisher → Kafka topic: sends events
- Kafka topic → Log consumer: delivers events
- Log consumer → Analytics service: processes event
- Analytics service → Log entity: maps event
- Analytics service → Log repository: persists log
- Log repository → PostgreSQL: reads and writes
- Analytics service → Lucene index: indexes log
- API client → REST controller: requests
- REST controller → Log repository: queries logs
- Log repository → REST controller: returns logs
- REST controller → Analytics service: requests metrics
- REST controller → Lucene index: searches index