Towards object-level semantic RGB-D SLAM in dynamic environments

Shaowu Peng; Dongchang Li

doi:10.1117/12.3005385

7 March 2024 Towards object-level semantic RGB-D SLAM in dynamic environments

Shaowu Peng, Dongchang Li

Proceedings Volume 13085, MIPPR 2023: Automatic Target Recognition and Navigation; 130850M (2024) https://doi.org/10.1117/12.3005385
Event: Twelfth International Symposium on Multispectral Image Processing and Pattern Recognition (MIPPR2023), 2023, Wuhan, China

Abstract

The static world assumption is common in most Simultaneous Localization and Mapping (SLAM) algorithms. However, this assumption introduces errors in real-world environments because the real-world is non-static. Furthermore, explicit motion information of the surroundings helps with decision making and scene understanding. In this paper, we present a robust dynamic SLAM for RGB-D cameras that is capable of tracking rigid objects in a scene and generating their 3D bounding box proposals without any prior knowledge, and incorporate this information into the SLAM formulation. As a result, it improves the accuracy of SLAM trajectories in dynamic environments. To achieve this, our system combines instance segmentation and dense optical flow to detect and track dynamic objects. We evaluate our algorithm in TUM and KITTI datasets. The results show that the absolute trajectory accuracy of our system can be improved significantly compared with ORB-SLAM2. We also compare our algorithm with DynaSLAM and VDO-SLAM, which are also designed for dynamic environments, and achieve significant improvement in counterparts.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Shaowu Peng and Dongchang Li "Towards object-level semantic RGB-D SLAM in dynamic environments", Proc. SPIE 13085, MIPPR 2023: Automatic Target Recognition and Navigation, 130850M (7 March 2024); https://doi.org/10.1117/12.3005385

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Semantics

Object detection

Pose estimation

3D tracking

Optical flow

Detection and tracking algorithms

Optical tracking

Show All Keywords

Keywords/Phrases

Search In:

Publication Years