# shubhigupta155/verimediaai architecture

> Architecture diagram of the GitHub repository shubhigupta155/verimediaai, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-01). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/shubhigupta155/verimediaai
- Repository: https://github.com/shubhigupta155/verimediaai

## Overview

VeriMedia AI is a digital-media forensics application: users submit media, specialized image, video, audio and lip-sync analysis produces evidence, and fusion estimates authenticity risk. The Streamlit excerpt shows a working image-analysis path; the FastAPI route currently validates uploads but explicitly says detector orchestration is not connected. Other domain stages and explanation/report capabilities are documented in the README, but their runtime wiring is not established by the excerpts. Edges for those documented stages cite the README; unsampled implementation details are not inferred.

Main entry points: [`modules/image/pipeline.py`](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/pipeline.py) (Image forensics), [`modules/fusion/pipeline.py`](https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/pipeline.py) (Evidence fusion), [`modules/audio/pipeline.py`](https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/pipeline.py) (Audio forensics), [`modules/video/pipeline.py`](https://github.com/shubhigupta155/verimediaai/blob/main/modules/video/pipeline.py) (Video forensics)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_entry["User Interfaces"]
  node_streamlit["Streamlit interface<br/>[app.py]"]
  node_api["FastAPI service<br/>[main.py]"]
  node_upload["Upload validation<br/>[analysis.py]"]
end

subgraph group_forensics["Forensic Analysis"]
  node_image["Image forensics<br/>[pipeline.py]"]
  node_image_metadata["Metadata analysis<br/>[metadata.py]"]
  node_image_compression["Compression analysis<br/>[compression.py]"]
  node_image_noise["Noise analysis<br/>[noise.py]"]
  node_image_frequency["Frequency analysis<br/>[frequency.py]"]
  node_image_detector["AI image detector<br/>[detector.py]"]
  node_image_explain["Image heatmap<br/>[explainability.py]"]
  node_video["Video forensics<br/>[pipeline.py]"]
  node_video_detector["Deepfake detector"]
  node_xception["Xception model<br/>[xception.py]"]
  node_audio["Audio forensics<br/>[pipeline.py]"]
  node_audio_preprocess["Audio preprocessing<br/>[preprocessing.py]"]
  node_spectrogram["Spectrogram analysis<br/>[spectrogram.py]"]
  node_voice["Voice manipulation detection<br/>[voice_detector.py]"]
  node_lipsync["Lip-sync analysis<br/>[pipeline.py]"]
end

subgraph group_assessment["Evidence Assessment"]
  node_fusion["Evidence fusion<br/>[pipeline.py]"]
  node_validation["Result validation<br/>[validator.py]"]
  node_strategies["Fusion strategies<br/>[strategies.py]"]
  node_risk["Risk assessment<br/>[risk_engine.py]"]
end

subgraph group_results["Explanation &amp; Results"]
  node_deepseek["DeepSeek explanation<br/>[deepseek.py]"]
  node_report["Forensic reporting<br/>[report.py]"]
end

node_user(("Media user"))

node_user -->|"submits media"| node_streamlit
node_streamlit -->|"runs analysis"| node_image
node_user -->|"uploads media"| node_api
node_api -->|"registers route"| node_upload
node_upload -->|"accepts upload"| node_user
node_image -->|"extracts metadata"| node_image_metadata
node_image -->|"analyzes compression"| node_image_compression
node_image -->|"analyzes noise"| node_image_noise
node_image -->|"analyzes frequencies"| node_image_frequency
node_image -->|"detects generation"| node_image_detector
node_image -->|"generates heatmap"| node_image_explain
node_video -.->|"analyzes deepfakes"| node_video_detector
node_video_detector -->|"uses model"| node_xception
node_audio -->|"preprocesses audio"| node_audio_preprocess
node_audio -->|"generates spectrogram"| node_spectrogram
node_audio -->|"detects manipulation"| node_voice
node_video -.->|"supports sync analysis"| node_lipsync
node_image -->|"provides evidence"| node_fusion
node_video -->|"provides evidence"| node_fusion
node_audio -->|"provides evidence"| node_fusion
node_lipsync -->|"provides evidence"| node_fusion
node_fusion -->|"validates results"| node_validation
node_fusion -->|"fuses scores"| node_strategies
node_fusion -->|"assesses risk"| node_risk
node_fusion -->|"supplies evidence"| node_deepseek
node_deepseek -->|"explains findings"| node_report

click node_streamlit "https://github.com/shubhigupta155/verimediaai/blob/main/app.py"
click node_api "https://github.com/shubhigupta155/verimediaai/blob/main/backend/main.py"
click node_upload "https://github.com/shubhigupta155/verimediaai/blob/main/backend/routes/analysis.py"
click node_image "https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/pipeline.py"
click node_image_metadata "https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/metadata.py"
click node_image_compression "https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/compression.py"
click node_image_noise "https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/noise.py"
click node_image_frequency "https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/frequency.py"
click node_image_detector "https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/detector.py"
click node_image_explain "https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/explainability.py"
click node_video "https://github.com/shubhigupta155/verimediaai/blob/main/modules/video/pipeline.py"
click node_video_detector "https://github.com/shubhigupta155/verimediaai/blob/main/modules/video/deepfake_detector.py"
click node_xception "https://github.com/shubhigupta155/verimediaai/blob/main/modules/video/network/xception.py"
click node_audio "https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/pipeline.py"
click node_audio_preprocess "https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/preprocessing.py"
click node_spectrogram "https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/spectrogram.py"
click node_voice "https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/voice_detector.py"
click node_lipsync "https://github.com/shubhigupta155/verimediaai/blob/main/modules/lipsync/pipeline.py"
click node_fusion "https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/pipeline.py"
click node_validation "https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/validator.py"
click node_strategies "https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/strategies.py"
click node_risk "https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/risk_engine.py"
click node_deepseek "https://github.com/shubhigupta155/verimediaai/blob/main/ai/deepseek.py"
click node_report "https://github.com/shubhigupta155/verimediaai/blob/main/modules/report.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_streamlit,node_api,node_upload,node_user toneBlue
class node_image,node_image_metadata,node_image_compression,node_image_noise,node_image_frequency,node_image_detector,node_image_explain,node_video,node_video_detector,node_xception,node_audio,node_audio_preprocess,node_spectrogram,node_voice,node_lipsync toneAmber
class node_fusion,node_validation,node_strategies,node_risk toneMint
class node_deepseek,node_report toneRose
```

## Components

### User Interfaces

- [Streamlit interface](https://github.com/shubhigupta155/verimediaai/blob/main/app.py): `app.py`
- [FastAPI service](https://github.com/shubhigupta155/verimediaai/blob/main/backend/main.py): `backend/main.py`
- [Upload validation](https://github.com/shubhigupta155/verimediaai/blob/main/backend/routes/analysis.py): `backend/routes/analysis.py`

### Forensic Analysis

- [Image forensics](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/pipeline.py): `modules/image/pipeline.py`
- [Metadata analysis](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/metadata.py): `modules/image/metadata.py`
- [Compression analysis](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/compression.py): `modules/image/compression.py`
- [Noise analysis](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/noise.py): `modules/image/noise.py`
- [Frequency analysis](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/frequency.py): `modules/image/frequency.py`
- [AI image detector](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/detector.py): `modules/image/detector.py`
- [Image heatmap](https://github.com/shubhigupta155/verimediaai/blob/main/modules/image/explainability.py): `modules/image/explainability.py`
- [Video forensics](https://github.com/shubhigupta155/verimediaai/blob/main/modules/video/pipeline.py): `modules/video/pipeline.py`
- [Deepfake detector](https://github.com/shubhigupta155/verimediaai/blob/main/modules/video/deepfake_detector.py): `modules/video/deepfake_detector.py`
- [Xception model](https://github.com/shubhigupta155/verimediaai/blob/main/modules/video/network/xception.py): `modules/video/network/xception.py`
- [Audio forensics](https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/pipeline.py): `modules/audio/pipeline.py`
- [Audio preprocessing](https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/preprocessing.py): `modules/audio/preprocessing.py`
- [Spectrogram analysis](https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/spectrogram.py): `modules/audio/spectrogram.py`
- [Voice manipulation detection](https://github.com/shubhigupta155/verimediaai/blob/main/modules/audio/voice_detector.py): `modules/audio/voice_detector.py`
- [Lip-sync analysis](https://github.com/shubhigupta155/verimediaai/blob/main/modules/lipsync/pipeline.py): `modules/lipsync/pipeline.py`

### Evidence Assessment

- [Evidence fusion](https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/pipeline.py): `modules/fusion/pipeline.py`
- [Result validation](https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/validator.py): `modules/fusion/validator.py`
- [Fusion strategies](https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/strategies.py): `modules/fusion/strategies.py`
- [Risk assessment](https://github.com/shubhigupta155/verimediaai/blob/main/modules/fusion/risk_engine.py): `modules/fusion/risk_engine.py`

### Explanation & Results

- [DeepSeek explanation](https://github.com/shubhigupta155/verimediaai/blob/main/ai/deepseek.py): `ai/deepseek.py`
- [Forensic reporting](https://github.com/shubhigupta155/verimediaai/blob/main/modules/report.py): `modules/report.py`

### Other components

- **Media user**

## Connections

- Media user → Streamlit interface: submits media (evidence: `README.md`)
- Streamlit interface → Image forensics: runs analysis (evidence: `app.py`)
- Media user → FastAPI service: uploads media (evidence: `README.md`)
- FastAPI service → Upload validation: registers route (evidence: `backend/main.py`)
- Upload validation → Media user: accepts upload (evidence: `backend/routes/analysis.py`)
- Image forensics → Metadata analysis: extracts metadata (evidence: `modules/image/pipeline.py`)
- Image forensics → Compression analysis: analyzes compression (evidence: `modules/image/pipeline.py`)
- Image forensics → Noise analysis: analyzes noise (evidence: `modules/image/pipeline.py`)
- Image forensics → Frequency analysis: analyzes frequencies (evidence: `modules/image/pipeline.py`)
- Image forensics → AI image detector: detects generation (evidence: `modules/image/pipeline.py`)
- Image forensics → Image heatmap: generates heatmap (evidence: `modules/image/pipeline.py`)
- Video forensics → Deepfake detector: analyzes deepfakes
- Deepfake detector → Xception model: uses model (evidence: `modules/video/deepfake_detector.py`)
- Audio forensics → Audio preprocessing: preprocesses audio (evidence: `modules/audio/pipeline.py`)
- Audio forensics → Spectrogram analysis: generates spectrogram (evidence: `modules/audio/pipeline.py`)
- Audio forensics → Voice manipulation detection: detects manipulation (evidence: `modules/audio/pipeline.py`)
- Video forensics → Lip-sync analysis: supports sync analysis (evidence: `README.md`)
- Image forensics → Evidence fusion: provides evidence (evidence: `README.md`)
- Video forensics → Evidence fusion: provides evidence (evidence: `README.md`)
- Audio forensics → Evidence fusion: provides evidence (evidence: `README.md`)
- Lip-sync analysis → Evidence fusion: provides evidence (evidence: `README.md`)
- Evidence fusion → Result validation: validates results (evidence: `modules/fusion/pipeline.py`)
- Evidence fusion → Fusion strategies: fuses scores (evidence: `modules/fusion/pipeline.py`)
- Evidence fusion → Risk assessment: assesses risk (evidence: `modules/fusion/pipeline.py`)
- Evidence fusion → DeepSeek explanation: supplies evidence (evidence: `README.md`)
- DeepSeek explanation → Forensic reporting: explains findings (evidence: `README.md`)
