# redis-field-engineering/redis-streams-java-dist architecture

> Architecture diagram of the GitHub repository redis-field-engineering/redis-streams-java-dist, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-06-19). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/redis-field-engineering/redis-streams-java-dist
- Repository: https://github.com/redis-field-engineering/redis-streams-java-dist

## Overview

##### Project type and purpose
- This is a full-stack sample application ("bluesky-sentiment-analysis") built on top of the “redis-streams-java” library.
- Purpose: ingest posts from the Bluesky API (producer), stream them into Redis, process for sentiment (consumer), expose results via a Java Spring API, display in a React frontend, and provide metrics dashboards (Prometheus/Grafana).

##### File structure
- Top-level “samples/bluesky-sentiment-analysis” contains:
- producer/ – Java service using BskyClientEndpoint to fetch posts
- consumer/ – Java service that reads raw posts, applies sentiment via core library
- core/ – shared domain model (Post.java) used by producer, consumer, and API
- api/ – Spring Boot application exposing REST endpoints and persisting to Redis via redis-streams-java
- frontend/ – React app built with Tailwind/CSS served by nginx
- docker-compose.yml – orchestrates producer, consumer, api, redis, grafana, prometheus
- prometheus.yml, grafana/ – monitoring configuration
- terraform/ – infrastructure as code for AWS/GCP Redis clusters

##### README for additional insights
- The library breaks down into TopicManager, TopicProducer, ConsumerGroup – all backed by Redis Streams.
- The sample app uses TopicProducer to push messages, ConsumerGroup to read and classify sentiment, and TopicManager for consumer-group stats.

## Diagram (Mermaid)

```mermaid
flowchart TD
    %% Backend Services
    subgraph "Backend Services"
        direction TB
        Producer["Producer Service<br/>(Java)"]:::microservice
        Consumer["Consumer Service<br/>(Java)"]:::microservice
        API["API Service<br/>(Spring Boot)"]:::microservice
        Core["Shared Core Library<br/>(Domain Model)"]:::library
    end

    %% Data Store
    Redis["Redis Streams Cluster"]:::database

    %% Frontend
    subgraph "Frontend"
        direction TB
        FrontendApp["React Frontend<br/>(nginx)"]:::frontend
    end

    %% Monitoring
    subgraph "Monitoring"
        direction TB
        Prometheus["Prometheus"]:::monitoring
        Grafana["Grafana"]:::monitoring
    end

    %% Infrastructure as Code
    IaC["Terraform (AWS/GCP)"]:::infra

    %% Relationships
    Producer -->|"publish via TopicProducer<br/>XADD stream"| Redis
    Consumer -->|"consume via ConsumerGroup<br/>XREADGROUP"| Redis
    Consumer -->|"write sentiment results"| Redis
    API -->|"query TopicManager stats<br/>read sentiment"| Redis
    FrontendApp -->|"HTTP REST calls"| API
    Prometheus -->|"scrape /metrics"| API
    Prometheus -->|"scrape /metrics"| Consumer
    Grafana -->|"visualize dashboards"| Prometheus
    IaC -->|"provision Redis clusters"| Redis

    %% Click Events - Producer
    click Producer "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/producer/producer"
    click ProducerDocker "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/producer/Dockerfile"
    click ProducerMain "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/producer/producer/src/main/java/com/redis/Main.java"
    click BskyClient "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/producer/producer/src/main/java/com/redis/BskyClientEndpoint.java"

    %% Click Events - Consumer
    click Consumer "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/consumer/consumer"
    click ConsumerDocker "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/consumer/Dockerfile"
    click ConsumerMain "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/consumer/consumer/src/main/java/com/redis/Main.java"

    %% Click Events - Core
    click Core "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/core/core"
    click CoreGradle "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/core/core/core.gradle"
    click PostModel "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/core/core/src/main/java/com/redis/Post.java"

    %% Click Events - API
    click API "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api"
    click APIDocker "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/api/Dockerfile"
    click Bootstrap "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/Bootstrap.java"
    click AppClass "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/BskySentimentApiApplication.java"
    click PostController "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/controllers/PostController.java"
    click SentimentService "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/services/SentimentService.java"
    click MetricsService "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/services/MetricsService.java"
    click TopicMonitor "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/TopicMonitor.java"
    click SentimentGatherer "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/SentimentGatherer.java"
    click PostDoc "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/documents/Post.java"
    click PostRepo "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/api/bsky-sentiment-api/src/main/java/com/redis/bskysentimentapi/repositories/PostRepository.java"

    %% Click Events - Frontend
    click FrontendApp "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/frontend/frontend"
    click FrontendDocker "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/frontend/frontend/Dockerfile"
    click NginxConf "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/frontend/frontend/nginx.conf"
    click IndexJS "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/frontend/frontend/src/index.js"
    click HomeComp "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/frontend/frontend/src/components/Home.js"
    click TopicMonitorComp "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/frontend/frontend/src/components/TopicMonitor.js"
    click TopicSentimentsComp "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/frontend/frontend/src/components/TopicSentiments.js"
    click TrackedHashtagsComp "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/frontend/frontend/src/components/TrackedHashtags.js"
    click TrackedKeywordsComp "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/frontend/frontend/src/components/TrackedKeywords.js"

    %% Click Events - Data Store
    click Redis "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/docker-compose.yml"

    %% Click Events - Monitoring
    click Prometheus "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/prometheus.yml"
    click SentimentDashboard "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/grafana/dashboards/sentiments/sentiment-dashboard.json"
    click TopicStatsDashboard "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/grafana/dashboards/topic-stats/topic-stats.json"
    click GrafanaDashboards "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/grafana/provisioning/dashboards/dashboards.yml"
    click GrafanaDatasource "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/grafana/provisioning/datasources/datasource.yml"

    %% Click Events - IaC
    click IaC "https://github.com/redis-field-engineering/redis-streams-java-dist/tree/main/samples/bluesky-sentiment-analysis/terraform"
    click AWSTerraform "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/terraform/aws/main.tf"
    click AWSVars "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/terraform/aws/variables.tf"
    click AWSExample "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/terraform/aws/.tfvars.example"
    click GCPTerraform "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/terraform/gcp/main.tf"
    click GCPVars "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/terraform/gcp/variables.tf"
    click GCPExample "https://github.com/redis-field-engineering/redis-streams-java-dist/blob/main/samples/bluesky-sentiment-analysis/terraform/gcp/.tfvars.example"

    %% Styles
    classDef microservice fill:#FFD700,stroke:#333,stroke-width:1px
    classDef database fill:#8FBC8F,stroke:#333,stroke-width:1px
    classDef frontend fill:#87CEEB,stroke:#333,stroke-width:1px
    classDef monitoring fill:#FFA07A,stroke:#333,stroke-width:1px
    classDef infra fill:#DDA0DD,stroke:#333,stroke-width:1px
    classDef library fill:#ADD8E6,stroke:#333,stroke-width:1px
```
