Improving scene detection by using gradual shot transitions as cues from film grammar

Christian Petersohn

doi:10.1117/12.760622

28 January 2008 Improving scene detection by using gradual shot transitions as cues from film grammar

Christian Petersohn

Proceedings Volume 6820, Multimedia Content Access: Algorithms and Systems II; 68200D (2008) https://doi.org/10.1117/12.760622
Event: Electronic Imaging, 2008, San Jose, California, United States

Abstract

The types of shot transitions used by film editors in video are not randomly chosen. Cuts, dissolves, fades, and wipes are devices in film grammar used to structure video. In this work knowledge of film grammar is used to improve scene detection algorithms. Three improvements to known scene detection algorithms are proposed: (1) The selection of key-frames for shot similarity measurement should take the position of gradual shot transitions into account. (2) Gradual shot transitions have a separating effect. It is shown how this local cue can be used to improve the global structuring into logical units. (3) Gradual shot transitions also have a merging effect upon shots in their temporal proximity. It is shown how coherence values and shot similarity values used during scene detection have to be modified to exploit this fact. The proposed improvements can be used together with a variety of scene detection approaches. Experimental results with time adaptive grouping indicate that considerable improvements in terms of precision and recall are achieved.

Citation Download Citation

Christian Petersohn "Improving scene detection by using gradual shot transitions as cues from film grammar", Proc. SPIE 6820, Multimedia Content Access: Algorithms and Systems II, 68200D (28 January 2008); https://doi.org/10.1117/12.760622

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available