# altera-fpga/agilex5-ed-camera architecture

> Architecture diagram of the GitHub repository altera-fpga/agilex5-ed-camera, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-01). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/altera-fpga/agilex5-ed-camera
- Repository: https://github.com/altera-fpga/agilex5-ed-camera

## Overview

This repository contains Agilex 5 camera example designs: camera capture and ISP processing, multi-sensor stitching, and optional AI inference and fisheye warp. The central software workflow is the demo application configuring an ISP pipeline and exposing controls through its UI; specialized designs add stitching or AI processing, while a separate DisplayPort transmitter app handles output timing and formats. Edges are limited to relationships shown in excerpts or the README; unsampled implementation details are not inferred.

Main entry points: [`sw/application/src/UdxVvpIspPipeline.cpp`](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/UdxVvpIspPipeline.cpp) (ISP Pipeline), [`sw/application/src/VvpIspDemo.h`](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/VvpIspDemo.h) (Demo Application), [`sw/application/src/StitchPipeline.cpp`](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/StitchPipeline.cpp) (Image Stitching), [`custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c`](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c) (AI Stream Controller)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_app["Camera Application"]
  node_demo["Demo Application<br/>[VvpIspDemo.h]"]
  node_webui["Web UI Toolkit"]
end

subgraph group_pipeline["Video Processing"]
  node_udx["ISP Pipeline"]
  node_coreisp["Core ISP"]
  node_pipelinecore["Pipeline Core<br/>[PipelineCore.cpp]"]
  node_stitch["Image Stitching<br/>[StitchPipeline.cpp]"]
  node_warp["Warp State"]
end

subgraph group_ai["AI Inference"]
  node_aiapp["AI Pipeline<br/>[AiPipeline.cpp]"]
  node_stream["AI Stream Controller"]
  node_aimessages["AI Message Protocol"]
  node_aiusers["AI User Messages"]
  node_aicomms["AI Runtime Comms"]
end

subgraph group_display["Display Output"]
  node_displayapp["DisplayPort App<br/>[main.c]"]
  node_formats["Display Formats<br/>[dptx_formats.c]"]
end

node_operator(("Camera Operator"))
node_sink(("Display Sink"))

node_operator -.->|"operates"| node_demo
node_demo -->|"owns pipeline"| node_udx
node_demo -.->|"provides controls"| node_webui
node_udx -->|"gets ISP pipeline"| node_coreisp
node_udx -.->|"builds video graph"| node_pipelinecore
node_stitch -->|"gets camera pipelines"| node_udx
node_stitch -->|"reads ISP details"| node_coreisp
node_aiapp -.->|"integrates with"| node_demo
node_stream -->|"uses protocol"| node_aimessages
node_stream -->|"uses user messages"| node_aiusers
node_aicomms -->|"uses protocol"| node_aimessages
node_displayapp -->|"updates formats"| node_formats
node_displayapp -.->|"sets output timing"| node_sink
node_udx -.->|"supports warp"| node_warp

click node_demo "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/VvpIspDemo.h"
click node_webui "https://github.com/altera-fpga/agilex5-ed-camera/tree/rel/26.1/sw/application/application-toolkit"
click node_udx "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/UdxVvpIspPipeline.cpp"
click node_coreisp "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/CoreIspPipeline.cpp"
click node_pipelinecore "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/VideoPipeline/PipelineCore.cpp"
click node_stitch "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/StitchPipeline.cpp"
click node_warp "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/hapi/intel-vvp-warp/sw/intel_vvp_warp_data/src/WarpEngineState.cpp"
click node_aiapp "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/AiPipeline.cpp"
click node_stream "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c"
click node_aimessages "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_ai/stream_controller_messages.h"
click node_aiusers "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_ai/stream_controller_userMessages.h"
click node_aicomms "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src-ai/coredla-runtime/src/stream_controller_comms.cpp"
click node_displayapp "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/main.c"
click node_formats "https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/dptx_formats.c"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_demo,node_webui toneBlue
class node_udx,node_coreisp,node_pipelinecore,node_stitch,node_warp toneAmber
class node_aiapp,node_stream,node_aimessages,node_aiusers,node_aicomms toneMint
class node_displayapp,node_formats toneRose
class node_operator,node_sink toneIndigo
```

## Components

### Camera Application

- [Demo Application](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/VvpIspDemo.h): `sw/application/src/VvpIspDemo.h`
- [Web UI Toolkit](https://github.com/altera-fpga/agilex5-ed-camera/tree/rel/26.1/sw/application/application-toolkit): `sw/application/application-toolkit`

### Video Processing

- [ISP Pipeline](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/UdxVvpIspPipeline.cpp): `sw/application/src/UdxVvpIspPipeline.cpp`
- [Core ISP](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/CoreIspPipeline.cpp): `sw/application/src/CoreIspPipeline.cpp`
- [Pipeline Core](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/VideoPipeline/PipelineCore.cpp): `sw/application/src/VideoPipeline/PipelineCore.cpp`
- [Image Stitching](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/StitchPipeline.cpp): `sw/application/src/StitchPipeline.cpp`
- [Warp State](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/hapi/intel-vvp-warp/sw/intel_vvp_warp_data/src/WarpEngineState.cpp): `sw/application/hapi/intel-vvp-warp/sw/intel_vvp_warp_data/src/WarpEngineState.cpp`

### AI Inference

- [AI Pipeline](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src/AiPipeline.cpp): `sw/application/src/AiPipeline.cpp`
- [AI Stream Controller](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c): `custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c`
- [AI Message Protocol](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_ai/stream_controller_messages.h): `custom_user_subsystems/isp_subsystems/software_ai/stream_controller_messages.h`
- [AI User Messages](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_ai/stream_controller_userMessages.h): `custom_user_subsystems/isp_subsystems/software_ai/stream_controller_userMessages.h`
- [AI Runtime Comms](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/sw/application/src-ai/coredla-runtime/src/stream_controller_comms.cpp): `sw/application/src-ai/coredla-runtime/src/stream_controller_comms.cpp`

### Display Output

- [DisplayPort App](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/main.c): `custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/main.c`
- [Display Formats](https://github.com/altera-fpga/agilex5-ed-camera/blob/rel/26.1/custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/dptx_formats.c): `custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/dptx_formats.c`

### Other components

- **Camera Operator**
- **Display Sink**

## Connections

- Camera Operator → Demo Application: operates (evidence: `README.md`)
- Demo Application → ISP Pipeline: owns pipeline (evidence: `sw/application/src/VvpIspDemo.h`)
- Demo Application → Web UI Toolkit: provides controls (evidence: `sw/application/src/VvpIspDemo.h`)
- ISP Pipeline → Core ISP: gets ISP pipeline (evidence: `sw/application/src/UdxVvpIspPipeline.cpp`)
- ISP Pipeline → Pipeline Core: builds video graph
- Image Stitching → ISP Pipeline: gets camera pipelines (evidence: `sw/application/src/StitchPipeline.cpp`)
- Image Stitching → Core ISP: reads ISP details (evidence: `sw/application/src/StitchPipeline.cpp`)
- AI Pipeline → Demo Application: integrates with (evidence: `sw/application/src/VvpIspDemo.h`)
- AI Stream Controller → AI Message Protocol: uses protocol (evidence: `custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c`)
- AI Stream Controller → AI User Messages: uses user messages (evidence: `custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c`)
- AI Runtime Comms → AI Message Protocol: uses protocol
- DisplayPort App → Display Formats: updates formats (evidence: `custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/main.c`)
- DisplayPort App → Display Sink: sets output timing
- ISP Pipeline → Warp State: supports warp
