How aswina1636/iot-factory_monitoring-and-streaming_analytics works
This repository implements a simulated smart-factory sensor pipeline: ESP32 readings travel through MQTT and Kafka, are transformed by Spark, stored in PostgreSQL, and visualized in Power BI. The README also documents Kafka UI and pgAdmin as operational tools. Edges reflect the README’s stated workflow and the sampled consumer and Spark code; unsampled service wiring is not inferred.
Main entry points: docker-compose.yml Kafka stream · init.sql PostgreSQL · consumer.py MQTT bridge · stream_processor.py Spark processor
Components 11
Sensor Ingestion
- ESP32 simulator
esp32/factory/sketch.ino - HiveMQ broker
Streaming Pipeline
- MQTT bridge
mqtt_consumer/consumer.py - Kafka stream
docker-compose.yml - Spark processor
spark/stream_processor.py
Storage and Analytics
- PostgreSQL
postgres/init.sql - Power BI dashboard
dashboard.pbix
Operations
- Docker Compose
docker-compose.yml - Kafka UI
docker-compose.yml - pgAdmin
docker-compose.yml
Other components
- Factory operator
Connections 11
- ESP32 simulator → HiveMQ broker: publishes readings
README.md - HiveMQ broker → MQTT bridge: delivers messages
README.md - MQTT bridge → Kafka stream: produces events
mqtt_consumer/consumer.py - Kafka stream → Spark processor: streams events
spark/stream_processor.py - Spark processor → PostgreSQL: writes batches
spark/stream_processor.py - Factory operator → Power BI dashboard: views analytics
README.md - Power BI dashboard → PostgreSQL: reads data
README.md - Docker Compose → Kafka UI: runs service
README.md - Docker Compose → pgAdmin: runs service
README.md - Kafka UI → Kafka stream: monitors
README.md - pgAdmin → PostgreSQL: manages
README.md