Appearance based key-shot selection for a hand held camera

Bram Alefs; Judith Dijk

doi:10.1117/12.818480

27 April 2009 Appearance based key-shot selection for a hand held camera

Bram Alefs, Judith Dijk

Proceedings Volume 7341, Visual Information Processing XVIII; 734105 (2009) https://doi.org/10.1117/12.818480
Event: SPIE Defense, Security, and Sensing, 2009, Orlando, Florida, United States

Abstract

Automatic selection of key-shots is an important step for video data processing. Depending on the purpose, key-shot selection provides user feed back on recorded data, storage reduction and viewpoint selection and it can be used for panoramic image stitching and 3D-reconstruction. In particular, investigating scenes of crime or accidental investigations involves large amount of data, containing information on physical arrangement of objects, details on surface geometry and appearances. This paper proposes an efficient method for automatic selection of key-shot, providing onsite feedback on recorded segments and automatic selection of view-points for 3D-reconstruction. It uses appearance based object and scene modeling for a freely moving, hand held camera. The camera motion is determined on two levels, comparing appearances of local image regions and full 3D reconstruction. On the lower level, the 2D-warp between subsequent video frames is used to determine local change of image appearance and derive a set of motion key frames. These keyframes than are used to determine full 3D motion and to reconstruct objects. Furthermore, key-frames are used for fast indexation and detection of loop closures. Examples for automatic key-frame selection are given for an re-enacted crime scene, and compared to manual selection.

Citation Download Citation

Bram Alefs and Judith Dijk "Appearance based key-shot selection for a hand held camera", Proc. SPIE 7341, Visual Information Processing XVIII, 734105 (27 April 2009); https://doi.org/10.1117/12.818480

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available