Semantic segmentation networks of 3D point clouds for RGB-D indoor scenes

Ya Wang; Andreas Zell

doi:10.1117/12.2557603

31 January 2020 Semantic segmentation networks of 3D point clouds for RGB-D indoor scenes

Ya Wang, Andreas Zell

Proceedings Volume 11433, Twelfth International Conference on Machine Vision (ICMV 2019); 114331C (2020) https://doi.org/10.1117/12.2557603
Event: Twelfth International Conference on Machine Vision, 2019, Amsterdam, Netherlands

Abstract

This paper focuses on the semantic segmentation networks of 3D point clouds for indoor scenes. We first reduce the PointNet structure to get a reduced point network (RPN) that achieves the same performance but has less training and evaluation time comparing with PointNet. Secondly, we propose two solutions to get scale invariance and robust test performance: one is modifying RPN to get the robust performance and adding stable multi-scaling layers (MPN); another is introducing a novel point-based network based on Angular coordinates instead of Euclidean coordinates for point representation (APN). The ablation study of our networks (RPN, MPN, APN) is done. Compared to state-of-the-art semantic segmentation networks based on 3D point clouds, the experimental results show that our MPN and APN networks both achieve higher training and evaluation accuracy, as well as mean intersection over union (IoU) and overall accuracy on two benchmarks. We also have better qualitative segmentation results when directly test on another benchmark indoor scenes as well as real corridor scenes from our robots RGB-D mapping.

Citation Download Citation

Ya Wang and Andreas Zell "Semantic segmentation networks of 3D point clouds for RGB-D indoor scenes", Proc. SPIE 11433, Twelfth International Conference on Machine Vision (ICMV 2019), 114331C (31 January 2020); https://doi.org/10.1117/12.2557603

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available