# availproject/turbo-da architecture

> Architecture diagram of the GitHub repository availproject/turbo-da, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-05-14). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/availproject/turbo-da
- Repository: https://github.com/availproject/turbo-da

## Overview

##### Project type and purpose
- This is a full-stack, microservice-based Data Availability service (“TurboDA”) for the Avail DA chain.
- It exposes a Next.js dashboard (frontend) and a Rust-based REST API core service plus several background workers (data submission, funds monitor, fallback monitor).
- It integrates with PostgreSQL, Redis, multiple blockchain RPC endpoints (Avail, Ethereum, Base), plus external third-party APIs (CoinGecko).

##### File structure
- Top-level microservices/crates:
- dashboard/          → Next.js + React UI
- turbo-da-core/     → Core REST API service (Rust + Actix or Warp)
- db/                → Shared Diesel/Postgres database crate & migrations
- data_submission/   → Workload scheduler & data‐posting worker
- funds_monitor/     → Chain deposit/withdrawal indexing service
- fallback_monitor/  → Failed‐tx resubmission service
- contracts/         → Solidity/Foundry smart contracts for on-chain fee payments
- observability/     → OTEL collector & Prometheus config
- Shared config and Docker compose files orchestrate all these services locally or in production.
- Each Rust crate has its own Cargo.toml, src/, and env/config examples.

##### Key insights from README
- Core features: data submission to Avail, multi-token fee payment, user balance, rate limits, monitoring/resubmission.
- Each background service has its own environment variables, RPC endpoints, DB URL, and integration points.
- Observability is provided via OpenTelemetry + Prometheus.

## Diagram (Mermaid)

```mermaid
flowchart TD
    %% Frontend Layer
    subgraph "Frontend Layer"
        Dashboard["Next.js Dashboard"]:::frontend
    end

    %% API & Workers
    subgraph "API & Workers"
        CoreAPI["turbo-da-core API"]:::service
        DataSub["Data Submission Worker"]:::service
        FundsMon["Funds Monitor Worker"]:::service
        FallbackMon["Fallback Monitor Worker"]:::service
    end

    %% Data Stores
    subgraph "Data Stores"
        Postgres[(PostgreSQL)]:::datastore
        Redis[(Redis)]:::datastore
    end

    %% Blockchain Networks
    subgraph "Blockchain Networks"
        AvailRPC["Avail RPC Endpoint"]:::blockchain
        EthRPC["Ethereum RPC Endpoint"]:::blockchain
        BaseRPC["Base RPC Endpoint"]:::blockchain
        Contracts["Smart Contracts"]:::blockchain
    end

    %% External APIs
    subgraph "External APIs"
        CoinGecko["CoinGecko API"]:::external
    end

    %% Observability
    subgraph "Observability"
        OTEL["OTEL Collector"]:::obs
        Prom["Prometheus"]:::obs
    end

    %% Connections
    User["User/Browser"] -->|"HTTPS"| Dashboard
    Dashboard -->|"REST API"| CoreAPI

    CoreAPI -->|"SQL Queries"| Postgres
    CoreAPI -->|"Cache|RateLimit"| Redis
    CoreAPI -->|"Publish Task"| DataSub

    DataSub -->|"Submit Payload"| AvailRPC
    DataSub -->|"Update Status"| Postgres

    FundsMon -->|"Index Deposits"| EthRPC
    FundsMon -->|"Index Deposits"| BaseRPC
    FundsMon -->|"Update Balances"| Postgres

    FallbackMon -->|"Poll Failed TXs"| Postgres
    FallbackMon -->|"Resubmit"| AvailRPC

    CoreAPI -->|"Fee Estimation"| CoinGecko
    DataSub -->|"Price Data"| CoinGecko
    FundsMon -->|"Price Data"| CoinGecko
    FallbackMon -->|"Price Data"| CoinGecko

    CoreAPI -->|"OTEL Metrics"| OTEL
    DataSub -->|"OTEL Metrics"| OTEL
    FundsMon -->|"OTEL Metrics"| OTEL
    FallbackMon -->|"OTEL Metrics"| OTEL
    OTEL -->|"Expose Metrics"| Prom

    %% Click Events
    click Dashboard "https://github.com/availproject/turbo-da/tree/main/dashboard/"
    click CoreAPI "https://github.com/availproject/turbo-da/tree/main/turbo-da-core/"
    click Postgres "https://github.com/availproject/turbo-da/tree/main/db/"
    click DataSub "https://github.com/availproject/turbo-da/tree/main/data_submission/"
    click FundsMon "https://github.com/availproject/turbo-da/tree/main/funds_monitor/"
    click FallbackMon "https://github.com/availproject/turbo-da/tree/main/fallback_monitor/"
    click Contracts "https://github.com/availproject/turbo-da/tree/main/contracts/"
    click OTEL "https://github.com/availproject/turbo-da/tree/main/observability/"
    click Prom "https://github.com/availproject/turbo-da/tree/main/observability/"
    click RootConfig "https://github.com/availproject/turbo-da/blob/main/.env.example"
    click CoreEnv "https://github.com/availproject/turbo-da/blob/main/turbo-da-core/.env.example"
    click DataEnv "https://github.com/availproject/turbo-da/blob/main/data_submission/.env.example"
    click FallbackEnv "https://github.com/availproject/turbo-da/blob/main/fallback_monitor/.env.example"
    click FundsConfig "https://github.com/availproject/turbo-da/blob/main/funds_monitor/config.example.toml"
    click DockerCompose "https://github.com/availproject/turbo-da/blob/main/docker-compose.yml"

    %% Styles
    classDef frontend fill:#blue,stroke:#000,color:#fff
    classDef service fill:#8f8,stroke:#000,color:#000
    classDef datastore fill:#f96,stroke:#000,color:#000
    classDef blockchain fill:#c9f,stroke:#000,color:#000
    classDef external fill:#ccc,stroke:#000,color:#000
    classDef obs fill:#ffeb3b,stroke:#000,color:#000
```
