# jadhavgaurav/kidney_disease_classification_cnn architecture

> Architecture diagram of the GitHub repository jadhavgaurav/kidney_disease_classification_cnn, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-08-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jadhavgaurav/kidney_disease_classification_cnn
- Repository: https://github.com/jadhavgaurav/kidney_disease_classification_cnn

## Overview

##### Project type and purpose
- This is a full-stack, end-to-end machine-learning application for Kidney Disease Classification.
- It provides a data versioning pipeline (DVC + GCS), experiment tracking (MLflow + DagsHub), a model‐training pipeline (VGG16-based CNN), and a Flask-based web UI, all containerized and deployed on AWS EC2 with Docker, Gunicorn, and Nginx.

##### File structure
- Top-level scripts:
- split_dataset.py (data prep)
- train_with_mlflow.py, mlflow_multi_run.py (model training + logging)
- app.py + static/, templates/ (Flask web app for inference)
- docker_infer/ (alternate Docker build with its own app.py, Dockerfile, templates/static)
- Hidden/config dirs:
- .dvc/ + dvc.yaml (data versioning)
- mlruns/, mlflowruns/ (local experiment logs)
- Support files: requirements.txt, EC2_Flask_App_Deployment_Guide.md
- External data: data/ (images tracked via DVC, remote GCS)

##### Key README insights
- Uses VGG16 transfer learning, Adam optimizer, binary_crossentropy.
- MLflow is configured to log to DagsHub remote server.
- DVC pushes data to Google Cloud Storage.
- Dockerfile (root or docker_infer) builds a container exposing port 5000.
- AWS EC2 runs Docker container, fronted by Nginx + Gunicorn.

##### Main components & interactions
a. Data & versioning
- Raw CT scans in data/ → tracked by DVC → pushed to GCS.
- split_dataset.py reads data/ and outputs train/test sets.
b. Training pipeline
- train_with_mlflow.py / mlflow_multi_run.py load preprocessed data → build & train VGG16-based CNN → log metrics, params, artifacts to local mlruns/ and remote DagsHub.
- Model artifacts can also be versioned via DVC if desired.
c. Model registry & storage
- MLflow remote tracking URI (DagsHub) holds model registry “KidneyDiseaseVGG16.”
d. Inference service
- Flask app (app.py) loads the registered model → exposes upload & predict endpoints → renders templates (templates/, static/).
e. Containerization & deployment
- Dockerfile builds image with Python 3.10, installs requirements, copies code, and runs “gunicorn --bind 0.0.0.0:5000 app:app.”
- AWS EC2 instance runs Docker container → Nginx proxies port 80 → port 5000 on container.

##### Architectural patterns & design principles
- Pipeline pattern: clear stages (data ingestion → preprocessing → training → logging → deployment).
- MVC for Flask UI:
- Model: loaded ML model
- View: HTML templates
- Controller: Flask routes in app.py
- Infrastructure-as-Code mindset for AWS (installation steps scripted in EC2 guide).
- Separation of concerns: data versioning (DVC), experiment tracking (MLflow), inference (Flask), deployment (Docker+Nginx).

## Diagram (Mermaid)

```mermaid
flowchart TD
    %% Data & Versioning
    subgraph "Data & Versioning"
        RawData["data/ (CT scans)"]:::data
        DVCLocal[".dvc/"]:::data
        DVCIgnore[".dvcignore"]:::data
        SplitDVC["data/kidney_split.dvc"]:::data
        SplitDataset["split_dataset.py"]:::compute
        GCS["Google Cloud Storage"]:::external
    end

    RawData -->|track with DVC| DVCLocal
    DVCLocal -->|push data| GCS
    RawData -->|define splits| SplitDataset
    SplitDataset -->|outputs splits| SplitDVC

    %% Training & Tracking
    subgraph "Training & Tracking"
        TrainScript["train_with_mlflow.py"]:::compute
        MultiRun["mlflow_multi_run.py"]:::compute
        MLFlowTest["mlflowtest.py"]:::compute
        MLRunsLocal["mlruns/"]:::data
        MLFlowRunsAlt["mlflowruns/"]:::data
        DagsHub["DagsHub (MLflow remote)"]:::external
        MLFlowRegistry["MLflow Registry\nKidneyDiseaseVGG16"]:::service
    end

    SplitDVC --> TrainScript
    TrainScript -->|logs metrics & artifacts| MLRunsLocal
    TrainScript -->|logs to remote| DagsHub
    MultiRun -->|runs experiments| DagsHub
    MLFlowTest -->|validates config| DagsHub
    MLRunsLocal --> MLFlowRegistry
    DagsHub --> MLFlowRegistry

    %% Inference & UI
    subgraph "Inference & UI"
        FlaskApp["app.py"]:::compute
        Templates["templates/"]:::ui
        Static["static/"]:::ui
        RegistryLoad["load model from registry"]:::compute
        User["User"]:::user
    end

    MLFlowRegistry -->|fetch model| RegistryLoad
    RegistryLoad --> FlaskApp
    FlaskApp --> Templates
    FlaskApp --> Static
    User -->|uploads image| FlaskApp
    FlaskApp -->|returns prediction| User

    %% Alternate Docker Inference Context
    subgraph "Alternate Docker Inference Context"
        DInfDockerfile["docker_infer/Dockerfile"]:::compute
        DInfApp["docker_infer/app.py"]:::compute
        DInfTemplates["docker_infer/templates/"]:::ui
        DInfStatic["docker_infer/static/"]:::ui
        DInfReq["docker_infer/requirements.txt"]:::data
        DInfIgnore["docker_infer/.dockerignore"]:::data
    end

    %% Deployment
    subgraph "Deployment"
        Dockerfile["Dockerfile"]:::compute
        Requirements["requirements.txt"]:::data
        EC2Guide["EC2_Flask_App_Deployment_Guide.md"]:::docs
        EC2["AWS EC2"]:::cloud
        Nginx["Nginx"]:::service
        Gunicorn["Gunicorn"]:::service
    end

    Dockerfile -->|build image| EC2
    EC2 -->|run container| Nginx
    Nginx -->|proxy to| Gunicorn
    Gunicorn -->|serves| FlaskApp

    %% Click Events
    click DVCLocal "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/.dvc/"
    click DVCIgnore "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/.dvcignore"
    click SplitDVC "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/data/kidney_split.dvc"
    click SplitDataset "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/split_dataset.py"
    click TrainScript "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/train_with_mlflow.py"
    click MultiRun "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/mlflow_multi_run.py"
    click MLFlowTest "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/mlflowtest.py"
    click MLRunsLocal "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/mlruns/"
    click MLFlowRunsAlt "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/mlflowruns/"
    click FlaskApp "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/app.py"
    click Templates "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/templates/"
    click Static "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/static/"
    click DInfDockerfile "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/docker_infer/Dockerfile"
    click DInfApp "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/docker_infer/app.py"
    click DInfTemplates "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/docker_infer/templates/"
    click DInfStatic "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/tree/main/docker_infer/static/"
    click DInfReq "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/docker_infer/requirements.txt"
    click DInfIgnore "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/docker_infer/.dockerignore"
    click EC2Guide "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/EC2_Flask_App_Deployment_Guide.md"
    click Requirements "https://github.com/jadhavgaurav/kidney_disease_classification_cnn/blob/main/requirements.txt"

    %% Styles
    classDef data fill:#f9f,stroke:#333,stroke-width:1px
    classDef compute fill:#bbf,stroke:#333,stroke-width:1px
    classDef service fill:#bfb,stroke:#333,stroke-width:1px
    classDef external fill:#ffb,stroke:#333,stroke-width:1px
    classDef cloud fill:#fcf,stroke:#333,stroke-width:1px
    classDef ui fill:#ffb,stroke:#333,stroke-width:1px
    classDef user fill:#fdd,stroke:#333,stroke-width:1px
    classDef docs fill:#ddd,stroke:#333,stroke-width:1px
```
