# oucailab/hsi-x-classify-backbone architecture

> Architecture diagram of the GitHub repository oucailab/hsi-x-classify-backbone, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-04). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/oucailab/hsi-x-classify-backbone
- Repository: https://github.com/oucailab/hsi-x-classify-backbone

## Overview

HSI-X-Classify-Backbone is a multimodal remote-sensing classification experiment framework. Its principal workflow configures a dataset and model, loads and preprocesses HSI plus auxiliary-modality data, trains a registered backbone, evaluates it, and saves metrics and visualizations. The README documents the end-to-end flow and supported model and analysis capabilities; unsampled implementation details are represented only where documented, so some links cite the README.

Main entry points: [`src/model_registry.py`](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/model_registry.py) (Model registry), [`src/runner.py`](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/runner.py) (Experiment runner), [`src/evaluator.py`](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/evaluator.py) (Evaluator), [`src/trainer.py`](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/trainer.py) (Training loop)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_orchestration["Experiment orchestration"]
  node_runner["Experiment runner<br/>[runner.py]"]
  node_config["Experiment config<br/>[config.py]"]
  node_trainer["Training loop<br/>[trainer.py]"]
  node_email["Email notifier<br/>[email_notifier.py]"]
end

subgraph group_data["Data preparation"]
  node_data_loader["Multimodal data<br/>[data.py]"]
end

subgraph group_models["Model backbones"]
  node_registry["Model registry<br/>[model_registry.py]"]
  node_fusatnet["FusAtNet<br/>[model.py]"]
  node_exvit["ExViT<br/>[model.py]"]
  node_hybridsn["HybridSN<br/>[model.py]"]
  node_micf["MICF-Net<br/>[model.py]"]
  node_cnn["CNN<br/>[model.py]"]
  node_fdnet["FDNet<br/>[model.py]"]
  node_s2enet["S2ENet<br/>[model.py]"]
  node_asyffnet["AsyFFNet<br/>[model.py]"]
  node_hctnet["HCTNet<br/>[model.py]"]
  node_macn["MACN<br/>[model.py]"]
  node_rscnet["RSCNet<br/>[model.py]"]
end

subgraph group_results["Evaluation and outputs"]
  node_evaluator["Evaluator<br/>[evaluator.py]"]
  node_metrics["Classification metrics<br/>[metrics.py]"]
  node_analysis["Classification maps<br/>[analysis.py]"]
  node_tsne["t-SNE analysis<br/>[tsne.py]"]
  node_erf["ERF visualization<br/>[visualize_erf.py]"]
  node_artifacts["Experiment artifacts"]
end

node_user(("Researcher"))

node_user -->|"starts experiment"| node_runner
node_runner -->|"uses settings"| node_config
node_runner -->|"runs training"| node_trainer
node_runner -->|"runs testing"| node_evaluator
node_trainer -->|"loads batches"| node_data_loader
node_trainer -->|"gets adapter"| node_registry
node_registry -->|"selects model"| node_fusatnet
node_registry -->|"selects model"| node_exvit
node_registry -->|"selects model"| node_hybridsn
node_registry -->|"selects model"| node_micf
node_registry -->|"selects model"| node_cnn
node_registry -->|"selects model"| node_fdnet
node_registry -->|"selects model"| node_s2enet
node_registry -->|"selects model"| node_asyffnet
node_registry -->|"selects model"| node_hctnet
node_registry -->|"selects model"| node_macn
node_registry -->|"selects model"| node_rscnet
node_evaluator -->|"loads test data"| node_data_loader
node_evaluator -->|"gets adapter"| node_registry
node_evaluator -->|"computes metrics"| node_metrics
node_evaluator -->|"creates maps"| node_analysis
node_evaluator -->|"runs analysis"| node_tsne
node_runner -->|"sends notification"| node_email
node_runner -.->|"enables ERF"| node_erf
node_metrics -->|"writes reports"| node_artifacts
node_analysis -->|"saves maps"| node_artifacts
node_tsne -->|"saves plots"| node_artifacts

click node_runner "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/runner.py"
click node_config "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/config.py"
click node_trainer "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/trainer.py"
click node_data_loader "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/data.py"
click node_registry "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/model_registry.py"
click node_fusatnet "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/fusatnet/model.py"
click node_exvit "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/exvit/model.py"
click node_hybridsn "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/hybridsn/model.py"
click node_micf "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/micf_net/model.py"
click node_cnn "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/cnn/model.py"
click node_fdnet "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/fdnet/model.py"
click node_s2enet "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/s2enet/model.py"
click node_asyffnet "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/asyffnet/model.py"
click node_hctnet "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/hctnet/model.py"
click node_macn "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/macn/model.py"
click node_rscnet "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/rscnet/model.py"
click node_evaluator "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/evaluator.py"
click node_metrics "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/metrics.py"
click node_analysis "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/analysis.py"
click node_tsne "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/tsne.py"
click node_erf "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/visualize_erf.py"
click node_email "https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/email_notifier.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_runner,node_config,node_trainer,node_email toneBlue
class node_data_loader toneAmber
class node_registry,node_fusatnet,node_exvit,node_hybridsn,node_micf,node_cnn,node_fdnet,node_s2enet,node_asyffnet,node_hctnet,node_macn,node_rscnet toneMint
class node_evaluator,node_metrics,node_analysis,node_tsne,node_erf,node_artifacts toneRose
class node_user toneIndigo
```

## Components

### Experiment orchestration

- [Experiment runner](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/runner.py): `src/runner.py`
- [Experiment config](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/config.py): `src/config.py`
- [Training loop](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/trainer.py): `src/trainer.py`
- [Email notifier](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/email_notifier.py): `src/email_notifier.py`

### Data preparation

- [Multimodal data](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/data.py): `src/data.py`

### Model backbones

- [Model registry](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/model_registry.py): `src/model_registry.py`
- [FusAtNet](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/fusatnet/model.py): `src/models/fusatnet/model.py`
- [ExViT](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/exvit/model.py): `src/models/exvit/model.py`
- [HybridSN](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/hybridsn/model.py): `src/models/hybridsn/model.py`
- [MICF-Net](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/micf_net/model.py): `src/models/micf_net/model.py`
- [CNN](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/cnn/model.py): `src/models/cnn/model.py`
- [FDNet](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/fdnet/model.py): `src/models/fdnet/model.py`
- [S2ENet](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/s2enet/model.py): `src/models/s2enet/model.py`
- [AsyFFNet](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/asyffnet/model.py): `src/models/asyffnet/model.py`
- [HCTNet](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/hctnet/model.py): `src/models/hctnet/model.py`
- [MACN](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/macn/model.py): `src/models/macn/model.py`
- [RSCNet](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/models/rscnet/model.py): `src/models/rscnet/model.py`

### Evaluation and outputs

- [Evaluator](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/evaluator.py): `src/evaluator.py`
- [Classification metrics](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/metrics.py): `src/metrics.py`
- [Classification maps](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/analysis.py): `src/analysis.py`
- [t-SNE analysis](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/tsne.py): `src/tsne.py`
- [ERF visualization](https://github.com/oucailab/hsi-x-classify-backbone/blob/main/src/visualize_erf.py): `src/visualize_erf.py`
- **Experiment artifacts**

### Other components

- **Researcher**

## Connections

- Researcher → Experiment runner: starts experiment (evidence: `README.md`)
- Experiment runner → Experiment config: uses settings (evidence: `src/runner.py`)
- Experiment runner → Training loop: runs training (evidence: `src/runner.py`)
- Experiment runner → Evaluator: runs testing (evidence: `src/runner.py`)
- Training loop → Multimodal data: loads batches (evidence: `src/trainer.py`)
- Training loop → Model registry: gets adapter (evidence: `src/trainer.py`)
- Model registry → FusAtNet: selects model (evidence: `README.md`)
- Model registry → ExViT: selects model (evidence: `README.md`)
- Model registry → HybridSN: selects model (evidence: `README.md`)
- Model registry → MICF-Net: selects model (evidence: `README.md`)
- Model registry → CNN: selects model (evidence: `README.md`)
- Model registry → FDNet: selects model (evidence: `README.md`)
- Model registry → S2ENet: selects model (evidence: `README.md`)
- Model registry → AsyFFNet: selects model (evidence: `README.md`)
- Model registry → HCTNet: selects model (evidence: `README.md`)
- Model registry → MACN: selects model (evidence: `README.md`)
- Model registry → RSCNet: selects model (evidence: `README.md`)
- Evaluator → Multimodal data: loads test data (evidence: `src/evaluator.py`)
- Evaluator → Model registry: gets adapter (evidence: `src/evaluator.py`)
- Evaluator → Classification metrics: computes metrics (evidence: `src/evaluator.py`)
- Evaluator → Classification maps: creates maps (evidence: `src/evaluator.py`)
- Evaluator → t-SNE analysis: runs analysis (evidence: `src/evaluator.py`)
- Experiment runner → Email notifier: sends notification (evidence: `src/runner.py`)
- Experiment runner → ERF visualization: enables ERF
- Classification metrics → Experiment artifacts: writes reports (evidence: `README.md`)
- Classification maps → Experiment artifacts: saves maps (evidence: `README.md`)
- t-SNE analysis → Experiment artifacts: saves plots (evidence: `README.md`)
