A MIX-decision CNN solution for real-time semantic segmentation on embedded devices

Chunyu Yuan; Sos S. Agaian

doi:10.1117/12.2663388

15 June 2023 A MIX-decision CNN solution for real-time semantic segmentation on embedded devices

Chunyu Yuan, Sos S. Agaian

Proceedings Volume 12526, Multimodal Image Exploitation and Learning 2023 ; 125260I (2023) https://doi.org/10.1117/12.2663388
Event: SPIE Defense + Commercial Sensing, 2023, Orlando, Florida, United States

Conference Poster

Abstract

Semantic segmentation (SS) is a critical computer vision task that involves labeling each pixel in an image with a corresponding semantic class. It has numerous applications, such as autonomous driving, augmented reality, and video surveillance, which require real-time processing. However, many existing SS algorithms prioritize accuracy over computational efficiency, often resulting in complex models with high memory and computational requirements and future leading to challenging applications with critical real-time performance and limited computational resources. The paper proposes a novel CNN architecture incorporating binary neural network techniques to improve efficiency without sacrificing accuracy. The proposed MIX-Decision CNN architecture combines accuracy and efficiency and is optimized for real-time performance on embedded platforms. The paper uses the KITTI dataset to benchmark the proposed architecture on three embedded platforms: Raspberry Pi 3, Raspberry Pi 4, and NVIDIA Jetson Nano 4 GB. The paper's main contributions are two-fold: (i) the novel MIX-Decision CNN architecture offers an efficient and accurate solution for real-time SS tasks using binary neural network techniques, and (ii) the paper demonstrates the feasibility of the proposed architecture by implementing and benchmarking it on various embedded platforms. The results show promising performance for real-world scenarios where real-time processing is crucial.

Citation Download Citation

Chunyu Yuan and Sos S. Agaian "A MIX-decision CNN solution for real-time semantic segmentation on embedded devices", Proc. SPIE 12526, Multimodal Image Exploitation and Learning 2023 , 125260I (15 June 2023); https://doi.org/10.1117/12.2663388

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available