Hierarchical depth estimation for image synthesis in mixed reality

HanSung Kim; Kwanghoon Sohn

doi:10.1117/12.473879

30 May 2003 Hierarchical depth estimation for image synthesis in mixed reality

HanSung Kim, Kwanghoon Sohn

Proceedings Volume 5006, Stereoscopic Displays and Virtual Reality Systems X; (2003) https://doi.org/10.1117/12.473879
Event: Electronic Imaging 2003, 2003, Santa Clara, CA, United States

Abstract

Mixed reality is different from the virtual reality in that users can feel immersed in a space which is composed of not only virtual but also real objects. Thus, it is essential to realize seamless integration and mutual occlusion of the virtual and real worlds. Therefore, we need depth information of the real scene to perform the synthesis. We propose the depth estimation algorithm with sharp object boundaries for mixed reality system based on hierarchical disparity estimation. Initial disparity vectors are obtained from downsampled stereo images using region-dividing disparity estimation technique. Then, background region is detected and flattened. With these initial vectors, dense disparities are estimated and regularized with shape-adaptive window in full resolution images. Finally, depth values are calculated by stereo geometry and camera parameters. As a result, virtual objects can be mixed into the image of real world by comparing the calculated depth values with the depth information of generated virtual objects. Experimental results show that occlusion between the virtual and real objects are correctly established with sharp boundaries in the synthesized images, so that user can observe the mixed scene with considerably natural sensation.

Citation Download Citation

HanSung Kim and Kwanghoon Sohn "Hierarchical depth estimation for image synthesis in mixed reality", Proc. SPIE 5006, Stereoscopic Displays and Virtual Reality Systems X, (30 May 2003); https://doi.org/10.1117/12.473879

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available