3D object detection based on local feature fusion

Jianguo Liu; Xinjia Liao; Fuwu Yan; Rui Zhang; Yingzhi Chen; Youhua Wu; Yunfei Sun; Dafeng Hu; Nuo Chen

doi:10.1117/12.2660956

16 December 2022 3D object detection based on local feature fusion

Jianguo Liu, Xinjia Liao, Fuwu Yan, Rui Zhang, Yingzhi Chen, Youhua Wu, Yunfei Sun, Dafeng Hu, Nuo Chen

Proceedings Volume 12500, Fifth International Conference on Mechatronics and Computer Technology Engineering (MCTE 2022); 1250037 (2022) https://doi.org/10.1117/12.2660956
Event: 5th International Conference on Mechatronics and Computer Technology Engineering (MCTE 2022), 2022, Chongqing, China

Abstract

The existing 3D object detection networks based on the cross-attention mechanism from the bird's-eye view perspective mostly use the parameters calibrated by the camera to take the features corresponding to project each 3D feature point from the front view feature by projecting the 3D point onto the two-dimensional image. The features obtained by this method are affected by the calibration parameters and the projection position. To reduce the influence of the camera calibration parameters and the accuracy of the projection position on the obtained features, a local feature fusion network is proposed, which fuses the features within a certain range near the projection point to represent the corresponding features of the 3D point, thus improving the feature representation capability. The experimental results on the nuScenes val set show that the NDS value is increased by 1.4% compared with the benchmark. In addition, the network has robustness. Under the same noise, its accuracy reduction rate is reduced by more than 56% compared with the benchmark and has a practical value in automatic driving.

Citation Download Citation

Jianguo Liu, Xinjia Liao, Fuwu Yan, Rui Zhang, Yingzhi Chen, Youhua Wu, Yunfei Sun, Dafeng Hu, and Nuo Chen "3D object detection based on local feature fusion", Proc. SPIE 12500, Fifth International Conference on Mechatronics and Computer Technology Engineering (MCTE 2022), 1250037 (16 December 2022); https://doi.org/10.1117/12.2660956

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
6 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Image fusion

Feature extraction

Head

3D image processing

3D modeling

Image segmentation

Show All Keywords

Keywords/Phrases

Search In:

Publication Years