Vision Apps User Guide
Camera based Image Classification Application

Table of Contents

Introduction

This application shows how to integrate a camera to a TIDL Node for image classification. The demo is designed to work with 2MP sensor and validated ONLY for D3's IMX390 2MP camera. The network chosen is MobileNet_v1. Raw pixels from sensor is captured via CSI2Rx and sent to VISS for image processing. The resulting image is written in NV12 format which is then sent to LDC for fish-eye rectification. The rectified image is scaled into 1/2 and 1/4 resolutions. The 1/2 resolution is sent to display and 1/4 resolution is center cropped and sent to TIDL node for inference.

Supported plaforms

Platform Linux x86_64 Linux+RTOS mode QNX+RTOS mode SoC
Support NO YES YES J721e / J721S2 / J784S4

Data flow

app_tidl_cam_data_flow.jpg

Steps to run the application on J7 EVM

  1. Build the application and related libraries as mentioned in Build Instructions for Linux+RTOS mode
  2. A sample "app_tidl_cam.cfg" for image classification is provided under "/opt/vision_apps/" on the rootfs partition.
  3. This demo is designed to work only with a 2MP sensor. Currently validated only on D3's IMX390 2MP sensor.
  4. Run the app as shown below
    ./run_app_tidl_cam.sh

Steps to run the application on PC Linux x86_64

  1. This demo cannot be run on PC as it requires D3's IMX390 2MP camera.

Sample Output

Shown below is a example input and its corresponding output

app_tidl_cam_output.jpg