How altera-fpga/agilex5-ed-camera works
This repository contains Agilex 5 camera example designs: camera capture and ISP processing, multi-sensor stitching, and optional AI inference and fisheye warp. The central software workflow is the demo application configuring an ISP pipeline and exposing controls through its UI; specialized designs add stitching or AI processing, while a separate DisplayPort transmitter app handles output timing and formats. Edges are limited to relationships shown in excerpts or the README; unsampled implementation details are not inferred.
Main entry points: UdxVvpIspPipeline.cpp ISP Pipeline · VvpIspDemo.h Demo Application · StitchPipeline.cpp Image Stitching · stream_controller.c AI Stream Controller
Components 16
Camera Application
- Demo Application
sw/application/src/VvpIspDemo.h - Web UI Toolkit
sw/application/application-toolkit
Video Processing
- ISP Pipeline
sw/application/src/UdxVvpIspPipeline.cpp - Core ISP
sw/application/src/CoreIspPipeline.cpp - Pipeline Core
sw/application/src/VideoPipeline/PipelineCore.cpp - Image Stitching
sw/application/src/StitchPipeline.cpp - Warp State
sw/application/hapi/intel-vvp-warp/sw/intel_vvp_warp_data/src/WarpEngineState.cpp
AI Inference
- AI Pipeline
sw/application/src/AiPipeline.cpp - AI Stream Controller
custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c - AI Message Protocol
custom_user_subsystems/isp_subsystems/software_ai/stream_controller_messages.h - AI User Messages
custom_user_subsystems/isp_subsystems/software_ai/stream_controller_userMessages.h - AI Runtime Comms
sw/application/src-ai/coredla-runtime/src/stream_controller_comms.cpp
Display Output
- DisplayPort App
custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/main.c - Display Formats
custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/dptx_formats.c
Other components
- Camera Operator
- Display Sink
Connections 14
- Camera Operator → Demo Application: operates
README.md - Demo Application → ISP Pipeline: owns pipeline
sw/application/src/VvpIspDemo.h - Demo Application → Web UI Toolkit: provides controls
sw/application/src/VvpIspDemo.h - ISP Pipeline → Core ISP: gets ISP pipeline
sw/application/src/UdxVvpIspPipeline.cpp - ISP Pipeline → Pipeline Core: builds video graph
- Image Stitching → ISP Pipeline: gets camera pipelines
sw/application/src/StitchPipeline.cpp - Image Stitching → Core ISP: reads ISP details
sw/application/src/StitchPipeline.cpp - AI Pipeline → Demo Application: integrates with
sw/application/src/VvpIspDemo.h - AI Stream Controller → AI Message Protocol: uses protocol
custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c - AI Stream Controller → AI User Messages: uses user messages
custom_user_subsystems/isp_subsystems/software_ai/stream_controller.c - AI Runtime Comms → AI Message Protocol: uses protocol
- DisplayPort App → Display Formats: updates formats
custom_user_subsystems/isp_subsystems/software_dp_tx/dp_tx_app_src/main.c - DisplayPort App → Display Sink: sets output timing
- ISP Pipeline → Warp State: supports warp