# apodwikat/nato-sps-programme architecture

> Architecture diagram of the GitHub repository apodwikat/nato-sps-programme, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-06-07). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/apodwikat/nato-sps-programme
- Repository: https://github.com/apodwikat/nato-sps-programme

## Overview

##### Project type and purpose
- This is a data-science/ML research repository built under the NATO SPS program. Its goal is to ingest Mediterranean SST and weather data, explore and engineer features (DS-Practice), fit classical time-series and regression models (ClassicalModels), then package results into a final NATO report (NATO-Report).

##### File structure
- Top-level directories:
- ClassicalModels – Jupyter notebooks implementing decision trees, AR/ARMA, linear regression on SST and related features
- DS-Practice – notebooks for raw data ingestion (.nc → CSV), factor analysis, Prophet forecasts, early data exploration
- NATO-Report – the clean dataset, the final report notebooks, PDF and PPT deliverables
- Config files: .gitignore, LICENSE, README.md
- No microservices or web frontend—this is a single‐machine data-pipeline/research process.

##### README
- Confirms: “DataScience and Machine Learning models on SST and weather forecasts in the Mediterranean region.”
- No additional architectural details; everything lives as Jupyter notebooks operating over CSV inputs.

a. Main components
1. Data Sources
– Raw CSV files (e.g. SST-Antalya-2007-2023-Cleaned.csv, Adana_Data(csv).csv)
– Raw netCDF data (ingested by Open(.nc into csv).ipynb)
2. Data Preprocessing & Feature Engineering
– DS-Practice notebooks: conversion, cleaning, factor analysis
3. Modeling Engines
– ClassicalModels notebooks: decision trees, AR, ARMA, linear regression
4. Model Outputs & Artifacts
– Generated CSV results (e.g. NATO-RESULTS.csv)
5. Reporting & Delivery
– NATO-Report folder: final report notebook, PDF, PPT

b. Relationships & interactions
- DS-Practice → ClassicalModels (cleaned data feeds modeling)
- Both DS-Practice and ClassicalModels feed into Model Outputs
- Model Outputs → NATO-Report (final analysis, notebook → PDF/PPT)

c. Architectural patterns/design principles
– Linear pipeline: Ingestion → Cleaning → Modeling → Reporting
– Clear separation of concerns by folder: exploratory vs. classical models vs. final deliverables
– Reproducibility via Jupyter notebooks

d. Key technologies & libraries
– Python & Jupyter Notebooks
– pandas, numpy for data manipulation
– statsmodels, Prophet for time-series modeling
– CSV and netCDF data formats
– Output formats: CSV, PDF, PPT

## Diagram (Mermaid)

```mermaid
graph TD
    subgraph "Data Sources"
        RawCSV1["Adana_Data(csv).csv"]:::data
        RawCSV2["SST-Antalya-2007-2023-Cleaned.csv"]:::data
        ncIngest["Open(.nc into csv).ipynb"]:::compute
    end

    subgraph "Preprocessing & Feature Engineering"
        factor["Factor Analyses.ipynb"]:::compute
        prophet["Prophet.ipynb"]:::compute
        sstDS["SST-DS-NATO(SPS)-ANT.ipynb"]:::compute
        weatherDS["Weather-DS-NATO(SPS)-ANT.ipynb"]:::compute
    end

    subgraph "Modeling Engines"
        dt1["1.1 DT-SST-(NoTimeFeatures).ipynb"]:::compute
        dt2["1.2 DT-Improved-SST-(TimeFeaturesAdded).ipynb"]:::compute
        ar["AR.ipynb"]:::compute
        arma["ARMA(8,0,0)-Antalya.ipynb"]:::compute
        lr["Linear Regression - 365.ipynb"]:::compute
    end

    modelOut["NATO-RESULTS.csv"]:::data

    subgraph "Reporting & Delivery"
        reportNB["REPORT.ipynb"]:::compute
        antDone["ANTALYA-20072023-DONE.csv"]:::data
        pres["NATO (SPS) - A. DWIKAT - Presentation.pdf"]:::output
        finalRep["NATO_SPS_FinalReport.pdf"]:::output
    end

    RawCSV1 -->|feeds| sstDS
    RawCSV2 -->|feeds| weatherDS
    ncIngest -->|generates CSV| sstDS

    sstDS -->|provides data| factor
    weatherDS -->|provides data| factor
    factor -->|features| dt1
    factor -->|features| dt2
    factor -->|features| ar
    factor -->|features| arma
    factor -->|features| lr
    prophet -->|forecasts| dt1
    prophet -->|forecasts| dt2
    prophet -->|forecasts| ar
    prophet -->|forecasts| arma
    prophet -->|forecasts| lr

    dt1 -->|results| modelOut
    dt2 -->|results| modelOut
    ar -->|results| modelOut
    arma -->|results| modelOut
    lr -->|results| modelOut

    modelOut -->|input| reportNB
    reportNB -->|exports CSV| antDone
    reportNB -->|exports PDF| finalRep
    reportNB -->|exports PPT| pres

    click RawCSV1 "https://github.com/apodwikat/nato-sps-programme/blob/main/DS-Practice/Adana_Data(csv).csv"
    click RawCSV2 "https://github.com/apodwikat/nato-sps-programme/blob/main/ClassicalModels/SST-Antalya-2007-2023-Cleaned.csv"
    click ncIngest "https://github.com/apodwikat/nato-sps-programme/blob/main/DS-Practice/Open(.nc into csv).ipynb"
    click factor "https://github.com/apodwikat/nato-sps-programme/blob/main/DS-Practice/Factor Analyses.ipynb"
    click prophet "https://github.com/apodwikat/nato-sps-programme/blob/main/DS-Practice/Prophet.ipynb"
    click sstDS "https://github.com/apodwikat/nato-sps-programme/blob/main/DS-Practice/SST-DS-NATO(SPS)-ANT.ipynb"
    click weatherDS "https://github.com/apodwikat/nato-sps-programme/blob/main/DS-Practice/Weather-DS-NATO(SPS)-ANT.ipynb"
    click dt1 "https://github.com/apodwikat/nato-sps-programme/blob/main/ClassicalModels/1.1 DT-SST-(NoTimeFeatures).ipynb"
    click dt2 "https://github.com/apodwikat/nato-sps-programme/blob/main/ClassicalModels/1.2 DT-Improved-SST-(TimeFeaturesAdded).ipynb"
    click ar "https://github.com/apodwikat/nato-sps-programme/blob/main/ClassicalModels/AR.ipynb"
    click arma "https://github.com/apodwikat/nato-sps-programme/blob/main/ClassicalModels/ARMA(8,0,0)-Antalya.ipynb"
    click lr "https://github.com/apodwikat/nato-sps-programme/blob/main/ClassicalModels/Linear Regression - 365.ipynb"
    click modelOut "https://github.com/apodwikat/nato-sps-programme/blob/main/ClassicalModels/NATO-RESULTS.csv"
    click reportNB "https://github.com/apodwikat/nato-sps-programme/blob/main/NATO-Report/REPORT.ipynb"
    click antDone "https://github.com/apodwikat/nato-sps-programme/blob/main/NATO-Report/ANTALYA-20072023-DONE.csv"
    click pres "https://github.com/apodwikat/nato-sps-programme/blob/main/NATO-Report/NATO (SPS) - A. DWIKAT - Presentation.pdf"
    click finalRep "https://github.com/apodwikat/nato-sps-programme/blob/main/NATO-Report/NATO_SPS_FinalReport.pdf"

    classDef data fill:#bbdefb,stroke:#0d47a1,color:#0d47a1;
    classDef compute fill:#c8e6c9,stroke:#1b5e20,color:#1b5e20;
    classDef output fill:#ffe0b2,stroke:#e65100,color:#e65100;
```
