How yosefshoval/digital_hunter works
Digital Hunter consumes intel, attack, and damage events, validates them, updates target-related records, and routes malformed messages to a dead-letter topic. Its simulator generates ordinary and deliberately faulty events for Kafka. The graph shows the sampled consumer flow and documented logging integration; README provides no additional product detail, and simulator and deployment wiring beyond the sampled excerpts is not inferred.
Main entry points: main.py Consumer workflow · mongo_connection.py MongoDB adapter · config.py Consumer config · kafka_tracker.py Kafka tracker
Components 12
Event generation
- Event simulator
messages_generator/simulator.py
Kafka ingestion
- Kafka tracker
consumer/kafka_tracker.py
Event processing
- Consumer workflow
consumer/main.py - Consumer config
consumer/config.py - Message validation
consumer/models.py - Distance calculation
consumer/haversine.py - DLQ producer
consumer/producer.py
Persistence and observability
- MongoDB adapter
consumer/mongo_connection.py - Structured logger
consumer/logger.py
Other components
- Kafka broker
- MongoDB
- Elasticsearch
Connections 16
- Event simulator → Kafka broker: publishes events
messages_generator/simulator.py - Kafka broker → Kafka tracker: supplies events
consumer/kafka_tracker.py - Kafka tracker → Consumer workflow: returns events
consumer/main.py - Consumer workflow → Consumer config: uses settings
consumer/main.py - Consumer workflow → Message validation: validates events
consumer/main.py - Consumer workflow → Distance calculation: calculates movement
consumer/main.py - Consumer workflow → MongoDB adapter: checks and updates
consumer/main.py - Consumer workflow → DLQ producer: routes invalid events
consumer/main.py - Consumer workflow → Structured logger: logs events
consumer/main.py - Kafka tracker → Consumer config: loads settings
consumer/kafka_tracker.py - DLQ producer → Consumer config: loads settings
consumer/producer.py - MongoDB adapter → Consumer config: loads settings
consumer/mongo_connection.py - MongoDB adapter → Message validation: imports schemas
consumer/mongo_connection.py - MongoDB adapter → MongoDB: reads and writes
consumer/mongo_connection.py - MongoDB adapter → Structured logger: logs operations
consumer/mongo_connection.py - Structured logger → Elasticsearch: indexes logs
consumer/logger.py