Three-dimensional scene reconstruction using multiview images and depth camera

Gi-Mun Um; Kang Yeon Kim; ChungHyun Ahn; Kwan Heng Lee

doi:10.1117/12.586764

22 March 2005 Three-dimensional scene reconstruction using multiview images and depth camera

Gi-Mun Um, Kang Yeon Kim, ChungHyun Ahn, Kwan Heng Lee

Proceedings Volume 5664, Stereoscopic Displays and Virtual Reality Systems XII; (2005) https://doi.org/10.1117/12.586764
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

This paper presents a novel multi-depth map fusion approach for the 3D scene reconstruction. Traditional stereo matching techniques that estimate disparities between two images often produce inaccurate depth map because of occlusion and homogeneous area. On the other hand, Depth map obtained from the depth camera is globally accurate but noisy and provides a limited depth range. In order to compensate pros and cons of these two methods, we propose a depth map fusion method that fuses the multi-depth maps from stereo matching and the depth camera. Using a 3-view camera system that includes a depth camera for the center-view, we first obtain 3-view images and a depth map from the center-view depth camera. Then we calculate camera parameters by camera calibration. Using the camera parameters, we rectify left and right-view images with respect to the center-view image for satisfying the well-known epipolar constraint. Using the center-view image as a reference, we obtain two depth maps by stereo matching between the center-left image pair and the center-right image pair. After preprocessing each depth map, we pick an appropriate depth value for each pixel from the processed depth maps based on the depth reliability. Simulation results obtained by our proposed method showed improvements in some background regions.

Citation Download Citation

Gi-Mun Um, Kang Yeon Kim, ChungHyun Ahn, and Kwan Heng Lee "Three-dimensional scene reconstruction using multiview images and depth camera", Proc. SPIE 5664, Stereoscopic Displays and Virtual Reality Systems XII, (22 March 2005); https://doi.org/10.1117/12.586764

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available