Deep learning architecture search for real-time image denoising

Esau A. Hervert Hernandez; Yan Cao; Nasser Kehtarnavaz

doi:10.1117/12.2620349

27 May 2022 Deep learning architecture search for real-time image denoising

Esau A. Hervert Hernandez, Yan Cao, Nasser Kehtarnavaz

Proceedings Volume 12102, Real-Time Image Processing and Deep Learning 2022; 1210205 (2022) https://doi.org/10.1117/12.2620349
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Abstract

Deep learning has been widely used in recent years to accomplish many tasks such as image classification, natural language processing, and image denoising amongst others. However, the process to create deep neural networks by trial and error can often be very repetitive and time consuming and it is not clear if the entire network architecture space is explored towards finding an optimum architecture. This paper presents a systematic and automatic way to design or find an optimal architecture of deep neural networks. First, a sensitivity analysis is carried out on the parameters of interest of a network in order to identify those parameters which are most influential to the performance of the network. A search space is defined based on these parameters. Reinforcement learning is then used to find an optimal architecture within this search space. In this paper, our developed method of finding an optimal network architecture is applied to the problem of image denoising. In particular, the emphasis is placed on the Densely Connected Hierarchical Network (DHDN). A resulting network, named ENAS-DHDN, is shown to marginally outperform the original network suggesting that the original network is close to optimal. After finding an optimal network, it is used to estimate the time to process Standard Definition (SD) and High Definition (HD) videos with a frame rate of 30fps indicating that real-time video denoising at the SD resolution is achievable.

Conference Presentation

Citation Download Citation

Esau A. Hervert Hernandez, Yan Cao, and Nasser Kehtarnavaz "Deep learning architecture search for real-time image denoising", Proc. SPIE 12102, Real-Time Image Processing and Deep Learning 2022, 1210205 (27 May 2022); https://doi.org/10.1117/12.2620349

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available