# ayyanarjayabalan/kafkapubsub architecture

> Architecture diagram of the GitHub repository ayyanarjayabalan/kafkapubsub, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-04). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/ayyanarjayabalan/kafkapubsub
- Repository: https://github.com/ayyanarjayabalan/kafkapubsub

## Overview

This repository demonstrates two ASP.NET Core services exchanging video events through Kafka: PubSubA publishes video-created events and consumes video-deleted events; PubSubB does the reverse. Each service’s Program.cs configures its HTTP controllers, MassTransit producers, Kafka topic endpoints, and consumers. The README also describes running Kafka and ZooKeeper via Docker Compose. RabbitMQ is configured in both services, though the excerpts show no application message flow through it. The graph focuses on event messaging; unsampled configuration and consumer behavior are not inferred.

Main entry points: [`Kafka.PubSubA/Program.cs`](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Program.cs) (A service setup), [`Kafka.PubSubB/Program.cs`](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Program.cs) (B service setup), [`Kafka.PubSubA/Controllers/HomeController.cs`](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Controllers/HomeController.cs) (A video API), [`Kafka.PubSubB/Controllers/HomeController.cs`](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Controllers/HomeController.cs) (B video API)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_service_a["PubSubA service"]
  node_a_setup["A service setup<br/>[Program.cs]"]
  node_a_api["A video API<br/>[HomeController.cs]"]
  node_a_created["Created event"]
  node_a_deleted["Deleted event"]
  node_a_consumer["Deleted consumer"]
end

subgraph group_service_b["PubSubB service"]
  node_b_setup["B service setup<br/>[Program.cs]"]
  node_b_api["B video API<br/>[HomeController.cs]"]
  node_b_created["Created event"]
  node_b_deleted["Deleted event"]
  node_b_consumer["Created consumer"]
end

subgraph group_messaging["Messaging infrastructure"]
  node_kafka["Kafka broker"]
  node_compose["Compose services"]
  node_rabbit["RabbitMQ"]
end

node_client(("API client"))

node_client -->|"posts title"| node_a_api
node_a_api -->|"creates event"| node_a_created
node_a_api -->|"produces event"| node_kafka
node_a_setup -->|"maps controllers"| node_a_api
node_a_setup -->|"configures consumer"| node_a_consumer
node_a_setup -->|"sets Kafka host"| node_kafka
node_kafka -->|"delivers deleted events"| node_a_consumer
node_client -->|"posts title"| node_b_api
node_b_api -->|"creates event"| node_b_deleted
node_b_api -->|"produces event"| node_kafka
node_b_setup -->|"maps controllers"| node_b_api
node_b_setup -->|"configures consumer"| node_b_consumer
node_b_setup -->|"sets Kafka host"| node_kafka
node_kafka -->|"delivers created events"| node_b_consumer
node_compose -->|"runs broker"| node_kafka
node_compose -->|"runs service"| node_rabbit
node_a_setup -->|"configures transport"| node_rabbit
node_b_setup -->|"configures transport"| node_rabbit

click node_a_setup "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Program.cs"
click node_a_api "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Controllers/HomeController.cs"
click node_a_created "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Events/VideoCreatedEvent.cs"
click node_a_deleted "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Events/VideoDeletedEvent.cs"
click node_a_consumer "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Consumer/VideoCreatedEventConsumer.cs"
click node_b_setup "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Program.cs"
click node_b_api "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Controllers/HomeController.cs"
click node_b_created "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Events/VideoCreatedEvent.cs"
click node_b_deleted "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Events/VideoDeletedEvent.cs"
click node_b_consumer "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Consumer/VideoCreatedEventConsumer.cs"
click node_compose "https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/docker-compose.yaml"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_a_setup,node_a_api,node_a_created,node_a_deleted,node_a_consumer,node_client toneBlue
class node_b_setup,node_b_api,node_b_created,node_b_deleted,node_b_consumer toneAmber
class node_kafka,node_compose,node_rabbit toneMint
```

## Components

### PubSubA service

- [A service setup](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Program.cs): `Kafka.PubSubA/Program.cs`
- [A video API](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Controllers/HomeController.cs): `Kafka.PubSubA/Controllers/HomeController.cs`
- [Created event](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Events/VideoCreatedEvent.cs): `Kafka.PubSubA/Events/VideoCreatedEvent.cs`
- [Deleted event](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Events/VideoDeletedEvent.cs): `Kafka.PubSubA/Events/VideoDeletedEvent.cs`
- [Deleted consumer](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubA/Consumer/VideoCreatedEventConsumer.cs): `Kafka.PubSubA/Consumer/VideoCreatedEventConsumer.cs`

### PubSubB service

- [B service setup](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Program.cs): `Kafka.PubSubB/Program.cs`
- [B video API](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Controllers/HomeController.cs): `Kafka.PubSubB/Controllers/HomeController.cs`
- [Created event](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Events/VideoCreatedEvent.cs): `Kafka.PubSubB/Events/VideoCreatedEvent.cs`
- [Deleted event](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Events/VideoDeletedEvent.cs): `Kafka.PubSubB/Events/VideoDeletedEvent.cs`
- [Created consumer](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/Kafka.PubSubB/Consumer/VideoCreatedEventConsumer.cs): `Kafka.PubSubB/Consumer/VideoCreatedEventConsumer.cs`

### Messaging infrastructure

- **Kafka broker**
- [Compose services](https://github.com/ayyanarjayabalan/kafkapubsub/blob/master/docker-compose.yaml): `docker-compose.yaml`
- **RabbitMQ**

### Other components

- **API client**

## Connections

- API client → A video API: posts title (evidence: `Kafka.PubSubA/Controllers/HomeController.cs`)
- A video API → Created event: creates event (evidence: `Kafka.PubSubA/Controllers/HomeController.cs`)
- A video API → Kafka broker: produces event (evidence: `Kafka.PubSubA/Controllers/HomeController.cs`)
- A service setup → A video API: maps controllers (evidence: `Kafka.PubSubA/Program.cs`)
- A service setup → Deleted consumer: configures consumer (evidence: `Kafka.PubSubA/Program.cs`)
- A service setup → Kafka broker: sets Kafka host (evidence: `Kafka.PubSubA/Program.cs`)
- Kafka broker → Deleted consumer: delivers deleted events
- API client → B video API: posts title (evidence: `Kafka.PubSubB/Controllers/HomeController.cs`)
- B video API → Deleted event: creates event (evidence: `Kafka.PubSubB/Controllers/HomeController.cs`)
- B video API → Kafka broker: produces event (evidence: `Kafka.PubSubB/Controllers/HomeController.cs`)
- B service setup → B video API: maps controllers (evidence: `Kafka.PubSubB/Program.cs`)
- B service setup → Created consumer: configures consumer (evidence: `Kafka.PubSubB/Program.cs`)
- B service setup → Kafka broker: sets Kafka host (evidence: `Kafka.PubSubB/Program.cs`)
- Kafka broker → Created consumer: delivers created events
- Compose services → Kafka broker: runs broker (evidence: `README.md`)
- Compose services → RabbitMQ: runs service (evidence: `README.md`)
- A service setup → RabbitMQ: configures transport (evidence: `Kafka.PubSubA/Program.cs`)
- B service setup → RabbitMQ: configures transport (evidence: `Kafka.PubSubB/Program.cs`)
