# shrutimokhashi34/banking_data_platform architecture

> Architecture diagram of the GitHub repository shrutimokhashi34/banking_data_platform, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-07). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/shrutimokhashi34/banking_data_platform
- Repository: https://github.com/shrutimokhashi34/banking_data_platform

## Overview

This is an end-to-end synthetic banking data platform: it generates domain datasets, ingests daily Azure batches, transforms them through Databricks’ medallion layers, publishes aggregates, and serves analytics through dashboards and a role-aware multi-agent assistant. The graph preserves the documented data stages and the app’s API, authorization, agent, and query layers. Some implementation files were not sampled, so those subsystem relationships are shown only where the README documents them; app internals are otherwise limited to indexed references.

Main entry points: [`google adk agent chain and app/app/api/main.py`](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/api/main.py) (Application API), [`google adk agent chain and app/app/tools/pipeline_tools.py`](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/tools/pipeline_tools.py) (Pipeline audit tools), [`airflow/dags/daily_ingestion_dag.py`](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/airflow/dags/daily_ingestion_dag.py) (Daily orchestration), [`databricks/silver/silver architechture scripts`](https://github.com/shrutimokhashi34/banking_data_platform/tree/main/databricks/silver/silver%20architechture%20scripts) (Silver domain checks)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_generation["Synthetic data"]
  node_generators["Domain generators"]
  node_models["Banking models"]
end

subgraph group_pipeline["Data processing"]
  node_azure[("Azure raw data")]
  node_airflow["Daily orchestration"]
  node_ingest_validation["Load validation<br/>[validation.py]"]
  node_snowflake_stage[("Snowflake staging")]
  node_silver["Silver domain checks"]
  node_gold[("Gold model")]
  node_snowflake_agg[("Snowflake aggregates")]
  node_migration["Aggregate migration"]
end

subgraph group_assistant["Assistant and analytics"]
  node_bigquery[("BigQuery analytics")]
  node_dashboards["Data Studio dashboards"]
  node_agent_chain["ADK agent chain<br/>[agent.py]"]
  node_tools["Analytics tools"]
  node_pipeline_agent["Pipeline agent"]
  node_pipeline_tools["Pipeline audit tools<br/>[pipeline_tools.py]"]
end

subgraph group_app["Application access"]
  node_frontend["Chat interface"]
  node_api["Application API<br/>[main.py]"]
  node_authentication["Authentication<br/>[authentication.py]"]
  node_authorization["Authorization<br/>[authorization.py]"]
end

node_source_systems(("Source systems"))
node_user(("Banking user"))

node_source_systems -->|"land raw data"| node_azure
node_azure -->|"schedule loads"| node_airflow
node_airflow -->|"load staging"| node_snowflake_stage
node_snowflake_stage -->|"process layers"| node_silver
node_silver -->|"curate data"| node_gold
node_gold -->|"read tables"| node_migration
node_migration -->|"publish aggregates"| node_snowflake_agg
node_snowflake_agg -->|"serve analytics"| node_bigquery
node_bigquery -->|"serve insights"| node_dashboards
node_user -.->|"ask questions"| node_frontend
node_frontend -.->|"send requests"| node_api
node_api -->|"authenticate identity"| node_authentication
node_api -->|"run conversation"| node_agent_chain
node_api -->|"execute dashboard queries"| node_tools
node_agent_chain -.->|"delegate pipeline questions"| node_pipeline_agent
node_pipeline_agent -->|"call audit tools"| node_pipeline_tools
node_pipeline_tools -->|"check access"| node_authorization
node_pipeline_tools -->|"query audit data"| node_bigquery
node_generators -->|"create records"| node_models

click node_generators "https://github.com/shrutimokhashi34/banking_data_platform/tree/main/python/generators"
click node_models "https://github.com/shrutimokhashi34/banking_data_platform/tree/main/python/models"
click node_airflow "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/airflow/dags/daily_ingestion_dag.py"
click node_ingest_validation "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/airflow/ingestion%20scripts/validation.py"
click node_silver "https://github.com/shrutimokhashi34/banking_data_platform/tree/main/databricks/silver/silver%20architechture%20scripts"
click node_gold "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/databricks/gold/Gold%20Schema%20-%20dim%20fact%20tables%20creation.py"
click node_migration "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/databricks/Databricks%20Gold%20to%20Snowflake%20AGG%20Migration.py"
click node_frontend "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/frontend/src/BankingChatbotApp.jsx"
click node_api "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/api/main.py"
click node_authentication "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/auth/authentication.py"
click node_authorization "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/auth/authorization.py"
click node_agent_chain "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/agent.py"
click node_tools "https://github.com/shrutimokhashi34/banking_data_platform/tree/main/google%20adk%20agent%20chain%20and%20app/app/tools"
click node_pipeline_agent "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/agents/data_engineer_agent.py"
click node_pipeline_tools "https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/tools/pipeline_tools.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_generators,node_models,node_user toneBlue
class node_azure,node_airflow,node_ingest_validation,node_snowflake_stage,node_silver,node_gold,node_snowflake_agg,node_migration toneAmber
class node_bigquery,node_dashboards,node_agent_chain,node_tools,node_pipeline_agent,node_pipeline_tools toneMint
class node_frontend,node_api,node_authentication,node_authorization toneRose
class node_source_systems toneIndigo
```

## Components

### Synthetic data

- [Domain generators](https://github.com/shrutimokhashi34/banking_data_platform/tree/main/python/generators): `python/generators`
- [Banking models](https://github.com/shrutimokhashi34/banking_data_platform/tree/main/python/models): `python/models`

### Data processing

- **Azure raw data**
- [Daily orchestration](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/airflow/dags/daily_ingestion_dag.py): `airflow/dags/daily_ingestion_dag.py`
- [Load validation](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/airflow/ingestion%20scripts/validation.py): `airflow/ingestion scripts/validation.py`
- **Snowflake staging**
- [Silver domain checks](https://github.com/shrutimokhashi34/banking_data_platform/tree/main/databricks/silver/silver%20architechture%20scripts): `databricks/silver/silver architechture scripts`
- [Gold model](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/databricks/gold/Gold%20Schema%20-%20dim%20fact%20tables%20creation.py): `databricks/gold/Gold Schema - dim fact tables creation.py`
- **Snowflake aggregates**
- [Aggregate migration](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/databricks/Databricks%20Gold%20to%20Snowflake%20AGG%20Migration.py): `databricks/Databricks Gold to Snowflake AGG Migration.py`

### Assistant and analytics

- **BigQuery analytics**
- **Data Studio dashboards**
- [ADK agent chain](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/agent.py): `google adk agent chain and app/app/agent.py`
- [Analytics tools](https://github.com/shrutimokhashi34/banking_data_platform/tree/main/google%20adk%20agent%20chain%20and%20app/app/tools): `google adk agent chain and app/app/tools`
- [Pipeline agent](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/agents/data_engineer_agent.py): `google adk agent chain and app/app/agents/data_engineer_agent.py`
- [Pipeline audit tools](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/tools/pipeline_tools.py): `google adk agent chain and app/app/tools/pipeline_tools.py`

### Application access

- [Chat interface](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/frontend/src/BankingChatbotApp.jsx): `google adk agent chain and app/app/frontend/src/BankingChatbotApp.jsx`
- [Application API](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/api/main.py): `google adk agent chain and app/app/api/main.py`
- [Authentication](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/auth/authentication.py): `google adk agent chain and app/app/auth/authentication.py`
- [Authorization](https://github.com/shrutimokhashi34/banking_data_platform/blob/main/google%20adk%20agent%20chain%20and%20app/app/auth/authorization.py): `google adk agent chain and app/app/auth/authorization.py`

### Other components

- **Source systems**
- **Banking user**

## Connections

- Source systems → Azure raw data: land raw data
- Azure raw data → Daily orchestration: schedule loads
- Daily orchestration → Snowflake staging: load staging
- Snowflake staging → Silver domain checks: process layers
- Silver domain checks → Gold model: curate data
- Gold model → Aggregate migration: read tables (evidence: `databricks/Databricks Gold to Snowflake AGG Migration.py`)
- Aggregate migration → Snowflake aggregates: publish aggregates (evidence: `databricks/Databricks Gold to Snowflake AGG Migration.py`)
- Snowflake aggregates → BigQuery analytics: serve analytics
- BigQuery analytics → Data Studio dashboards: serve insights
- Banking user → Chat interface: ask questions
- Chat interface → Application API: send requests
- Application API → Authentication: authenticate identity (evidence: `google adk agent chain and app/app/api/main.py`)
- Application API → ADK agent chain: run conversation (evidence: `google adk agent chain and app/app/api/main.py`)
- Application API → Analytics tools: execute dashboard queries (evidence: `google adk agent chain and app/app/api/main.py`)
- ADK agent chain → Pipeline agent: delegate pipeline questions
- Pipeline agent → Pipeline audit tools: call audit tools (evidence: `google adk agent chain and app/app/agents/data_engineer_agent.py`)
- Pipeline audit tools → Authorization: check access (evidence: `google adk agent chain and app/app/tools/pipeline_tools.py`)
- Pipeline audit tools → BigQuery analytics: query audit data (evidence: `google adk agent chain and app/app/tools/pipeline_tools.py`)
- Domain generators → Banking models: create records (evidence: `python/generators/copy/banking_generator.py`)
