Active non-line-of-sight human pose estimation based on deep learning

Qianqian Xu; Liquan Dong; Lingqin Kong; Yuejin Zhao; Ming Liu

doi:10.1117/12.2610975

22 July 2022 Active non-line-of-sight human pose estimation based on deep learning

Qianqian Xu, Liquan Dong, Lingqin Kong, Yuejin Zhao, Ming Liu

Proceedings Volume 12277, 2021 International Conference on Optical Instruments and Technology: Optical Systems, Optoelectronic Instruments, Novel Display, and Imaging Technology; 122770J (2022) https://doi.org/10.1117/12.2610975
Event: 2021 International Conference on Optical Instruments and Technology, 2022, Online Only

Abstract

Non-Line-of-Sight technology is to image objects that are hidden from the camera's view. It has a wide range of application prospects in robotic vision, national defense, remote sensing, medical imaging, and unmanned driving. Active Non-Lineof- Sight imaging mainly relies on time-resolved optical impulse responses. The Non-Line-of-Sight imaging system emits ultra-short light pulses to illuminate the diffuse reflection wall, and uses ultra-fast time-resolved single-photon detectors to collect multiple reflected photon information, thereby obtaining information in the hidden scene. Finally, various reconstruction algorithms are used to reconstruct the hidden scene. However, most of the existing reconstruction algorithms have the problems of slow reconstruction speed and fuzzy reconstruction results, especially in the aspect of human pose estimation. In this article, we describe a method of active Non-Line-of-Sight human pose estimation based on deep learning. In order to solve the problem of lack of deep learning data, we simulate large amounts of pseudo-transient images for the network, including various complex actions: walking, jumping, turning, bending back and forth, rotating, using the confocal Non-Line-of-Sight imaging model. And then we train the simulated transient images using light cones Transformation and U-net coding and decoding network structure. Finally, we examine the performance of our method on synthetic and experimental datasets. The prediction results show that our method can not only estimate the pose of real measured non-view human pose data, but also significantly improve the quality of reconstruction.

Citation Download Citation

Qianqian Xu, Liquan Dong, Lingqin Kong, Yuejin Zhao, and Ming Liu "Active non-line-of-sight human pose estimation based on deep learning", Proc. SPIE 12277, 2021 International Conference on Optical Instruments and Technology: Optical Systems, Optoelectronic Instruments, Novel Display, and Imaging Technology, 122770J (22 July 2022); https://doi.org/10.1117/12.2610975

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Non-line-of-sight propagation

Confocal microscopy

Data modeling

Imaging systems

Imaging technologies

Reconstruction algorithms

Image processing

Show All Keywords

Keywords/Phrases

Search In:

Publication Years