How atillatan/kafka-microservices-and-transactions works
This is a Spring Boot trade-ingestion system: clients submit trades to a REST producer, which validates and asynchronously publishes them to Kafka; a consumer validates received trades and persists valid ones to PostgreSQL. Invalid consumer messages are routed to a dead-letter topic for separate listening. Producer-side exception advice formats rejected requests. The README documents a three-broker, three-partition scenario and transaction management. Some runtime wiring is documented rather than shown in sampled source, so those relationships cite the README; unsampled internals are not inferred.
Main entry points: TradeConsumerServiceImpl.java Consume and validate · TradeController.java Trade REST API · TradeProducerService.java Validate and send · KafkaConsumerConfig.java Consumer configuration
Components 16
Trade producer
- Trade REST API
src/producer/src/main/java/com/tradingcorp/producer/controller/TradeController.java - Validate and send
src/producer/src/main/java/com/tradingcorp/producer/service/TradeProducerService.java - Trade payload
src/producer/src/main/java/com/tradingcorp/model/Trade.java - REST error advice
src/producer/src/main/java/com/tradingcorp/producer/controller/TradeControllerAdvice.java
Kafka messaging
- Kafka transaction config
src/producer/src/main/java/com/tradingcorp/producer/KafkaProducerConfig.java - Kafka brokers and topics
- Consumer configuration
src/consumer/src/main/java/com/tradingcorp/consumer/service/KafkaConsumerConfig.java
Trade consumer
- Consume and validate
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java - Consumer contract
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerService.java - Persistent trade entity
src/consumer/src/main/java/com/tradingcorp/model/Trade.java - Invalid trade exception
src/consumer/src/main/java/com/tradingcorp/model/InvalidTradeException.java - Dead-letter error handler
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeErrorHandler.java - Dead-letter listener
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java
Persistence
- Trade repository
src/consumer/src/main/java/com/tradingcorp/consumer/repository/TradeRepository.java - PostgreSQL
Other components
- Trade client
Connections 17
- Trade client → Trade REST API: submits trade
README.md - Trade REST API → Validate and send: validates and sends
src/producer/src/main/java/com/tradingcorp/producer/controller/TradeController.java - Trade REST API → Trade payload: builds payload
src/producer/src/main/java/com/tradingcorp/producer/controller/TradeController.java - Trade REST API → REST error advice: raises invalid trade
src/producer/src/main/java/com/tradingcorp/producer/controller/TradeController.java - Validate and send → Trade payload: validates payload
src/producer/src/main/java/com/tradingcorp/producer/service/TradeProducerService.java - Validate and send → Kafka brokers and topics: publishes asynchronously
README.md - Kafka transaction config → Kafka brokers and topics: configures producer
src/producer/src/main/java/com/tradingcorp/producer/KafkaProducerConfig.java - Kafka brokers and topics → Consume and validate: delivers trade records
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java - Consumer configuration → Consume and validate: configures listeners
src/consumer/src/main/java/com/tradingcorp/consumer/service/KafkaConsumerConfig.java - Consumer configuration → Dead-letter error handler: registers handler
src/consumer/src/main/java/com/tradingcorp/consumer/service/KafkaConsumerConfig.java - Consume and validate → Consumer contract: implements contract
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java - Consume and validate → Persistent trade entity: validates and persists
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java - Consume and validate → Invalid trade exception: rejects invalid trade
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java - Consume and validate → Trade repository: saves valid trade
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java - Trade repository → PostgreSQL: persists trades
README.md - Dead-letter error handler → Kafka brokers and topics: publishes failed record
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeErrorHandler.java - Kafka brokers and topics → Dead-letter listener: delivers dead letters
src/consumer/src/main/java/com/tradingcorp/consumer/service/TradeConsumerServiceImpl.java