# aswina1636/iot-factory_monitoring-and-streaming_analytics architecture

> Architecture diagram of the GitHub repository aswina1636/iot-factory_monitoring-and-streaming_analytics, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-03). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/aswina1636/iot-factory_monitoring-and-streaming_analytics
- Repository: https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics

## Overview

This repository implements a simulated smart-factory sensor pipeline: ESP32 readings travel through MQTT and Kafka, are transformed by Spark, stored in PostgreSQL, and visualized in Power BI. The README also documents Kafka UI and pgAdmin as operational tools. Edges reflect the README’s stated workflow and the sampled consumer and Spark code; unsampled service wiring is not inferred.

Main entry points: [`docker-compose.yml`](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml) (Kafka stream), [`postgres/init.sql`](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/postgres/init.sql) (PostgreSQL), [`mqtt_consumer/consumer.py`](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/mqtt_consumer/consumer.py) (MQTT bridge), [`spark/stream_processor.py`](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/spark/stream_processor.py) (Spark processor)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_sensing["Sensor Ingestion"]
  node_esp32["ESP32 simulator<br/>[sketch.ino]"]
  node_mqtt{{"HiveMQ broker"}}
end

subgraph group_streaming["Streaming Pipeline"]
  node_consumer["MQTT bridge<br/>[consumer.py]"]
  node_kafka["Kafka stream<br/>[docker-compose.yml]"]
  node_spark["Spark processor"]
end

subgraph group_storage["Storage and Analytics"]
  node_postgres[("PostgreSQL<br/>[init.sql]")]
  node_dashboard["Power BI dashboard<br/>[dashboard.pbix]"]
end

subgraph group_operations["Operations"]
  node_compose["Docker Compose<br/>[docker-compose.yml]"]
  node_kafka_ui["Kafka UI<br/>[docker-compose.yml]"]
  node_pgadmin["pgAdmin<br/>[docker-compose.yml]"]
end

node_operator(("Factory operator"))

node_esp32 -->|"publishes readings"| node_mqtt
node_mqtt -->|"delivers messages"| node_consumer
node_consumer -->|"produces events"| node_kafka
node_kafka -->|"streams events"| node_spark
node_spark -->|"writes batches"| node_postgres
node_operator -->|"views analytics"| node_dashboard
node_dashboard -->|"reads data"| node_postgres
node_compose -->|"runs service"| node_kafka_ui
node_compose -->|"runs service"| node_pgadmin
node_kafka_ui -->|"monitors"| node_kafka
node_pgadmin -->|"manages"| node_postgres

click node_esp32 "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/esp32/factory/sketch.ino"
click node_consumer "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/mqtt_consumer/consumer.py"
click node_kafka "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml"
click node_spark "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/spark/stream_processor.py"
click node_postgres "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/postgres/init.sql"
click node_dashboard "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/dashboard.pbix"
click node_compose "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml"
click node_kafka_ui "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml"
click node_pgadmin "https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_esp32,node_mqtt toneBlue
class node_consumer,node_kafka,node_spark toneAmber
class node_postgres,node_dashboard toneMint
class node_compose,node_kafka_ui,node_pgadmin toneRose
class node_operator toneIndigo
```

## Components

### Sensor Ingestion

- [ESP32 simulator](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/esp32/factory/sketch.ino): `esp32/factory/sketch.ino`
- **HiveMQ broker**

### Streaming Pipeline

- [MQTT bridge](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/mqtt_consumer/consumer.py): `mqtt_consumer/consumer.py`
- [Kafka stream](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml): `docker-compose.yml`
- [Spark processor](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/spark/stream_processor.py): `spark/stream_processor.py`

### Storage and Analytics

- [PostgreSQL](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/postgres/init.sql): `postgres/init.sql`
- [Power BI dashboard](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/dashboard.pbix): `dashboard.pbix`

### Operations

- [Docker Compose](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml): `docker-compose.yml`
- [Kafka UI](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml): `docker-compose.yml`
- [pgAdmin](https://github.com/aswina1636/iot-factory_monitoring-and-streaming_analytics/blob/main/docker-compose.yml): `docker-compose.yml`

### Other components

- **Factory operator**

## Connections

- ESP32 simulator → HiveMQ broker: publishes readings (evidence: `README.md`)
- HiveMQ broker → MQTT bridge: delivers messages (evidence: `README.md`)
- MQTT bridge → Kafka stream: produces events (evidence: `mqtt_consumer/consumer.py`)
- Kafka stream → Spark processor: streams events (evidence: `spark/stream_processor.py`)
- Spark processor → PostgreSQL: writes batches (evidence: `spark/stream_processor.py`)
- Factory operator → Power BI dashboard: views analytics (evidence: `README.md`)
- Power BI dashboard → PostgreSQL: reads data (evidence: `README.md`)
- Docker Compose → Kafka UI: runs service (evidence: `README.md`)
- Docker Compose → pgAdmin: runs service (evidence: `README.md`)
- Kafka UI → Kafka stream: monitors (evidence: `README.md`)
- pgAdmin → PostgreSQL: manages (evidence: `README.md`)
