Combined use of 2D images and 3D models for retrieving and browsing digital archive contents

Rieko Kadobayashi; Ryo Furukawa

doi:10.1117/12.587660

17 January 2005 Combined use of 2D images and 3D models for retrieving and browsing digital archive contents

Rieko Kadobayashi, Ryo Furukawa

Proceedings Volume 5665, Videometrics VIII; 56650E (2005) https://doi.org/10.1117/12.587660
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

In this paper we propose "browsing by 3D scene" and "rendering by photographs" based on viewpoint-based approach. The idea is that by linking the 3D models and photographs via the spatial information, "viewpoint" in particular, we can use them as a reference for each other when browsing photographs or walking through the 3D scene. We use the camera parameters to express the viewpoint. Each photograph has the extrinsic camera parameters as metadata, which is defined according to the same coordinates as the 3D model, and hence we can compare the viewpoints of them and judge their similarity. Unlike content-base image retrieval, the viewpoint-based search is robust to the difference of features such as color and shape among images. The browsing by 3D scene method allows users to retrieve images that contain the same object but show it with different appearances and to browse the images taken from a similar viewpoint in groups. On the other hand, when a user want to see a particular 3D scene, the user specifies a sample image by selecting a photograph from the archive. The system then renders the 3D scene with the viewpoint similar to that of the selected photograph.

Citation Download Citation

Rieko Kadobayashi and Ryo Furukawa "Combined use of 2D images and 3D models for retrieving and browsing digital archive contents", Proc. SPIE 5665, Videometrics VIII, 56650E (17 January 2005); https://doi.org/10.1117/12.587660

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available