Senior Design Team 06 • Video Pipeline for Machine Computer Vision
Project Overview
Client: JR Spidell
Faculty Advisor: Dr. Philip Jones
Our project aims to develop a proof-of-concept video pipeline for machine computer vision with the capability of supporting a machine learning algorithm to augment video data. Our team will improve upon a previous senior design team’s bare-metal implantation by making the code more accessible via PYNQ (or python for embedded systems) for future developers who do not have extensive knowledge in low level hardware programming and design.
The design will use a MIPI-connected COTS camera module to a display monitor that executes within a Linux operating system using an FPGA board. Incoming MIPI video data will be sent through a custom configured FPGA-based video pipeline and output a live video stream to a display monitor connected via an active mini displayport cable.
The project’s stretch goal is to pass the incoming video stream through a machine learning algorithm that augments the video before being sent to the display monitor.
FPGA: Ultra96-v2 Xilinx Zynq UltraScale+ MPSoC
Test Pattern Generator (TPG) images used for debugging the pipeline
Team Members
Deniz Tazegul
Video Stream to FPGAComputer Engineer
Liam Janda
VDMA to DDRMComputer Engineer
Taylor Johnson
DDRM to DisplayElectrical Engineer
Ritwesh Kumar
Video Stream to FPGAElectrical Engineer