Mind the gap: another look at the problem of the semantic gap in image retrieval

Jonathon S. Hare; Paul H. Lewis; Peter G. B. Enser; Christine J. Sandom

doi:10.1117/12.647755

16 January 2006 Mind the gap: another look at the problem of the semantic gap in image retrieval

Jonathon S. Hare, Paul H. Lewis, Peter G. B. Enser, Christine J. Sandom

Proceedings Volume 6073, Multimedia Content Analysis, Management, and Retrieval 2006; 607309 (2006) https://doi.org/10.1117/12.647755
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

This paper attempts to review and characterise the problem of the semantic gap in image retrieval and the attempts being made to bridge it. In particular, we draw from our own experience in user queries, automatic annotation and ontological techniques. The first section of the paper describes a characterisation of the semantic gap as a hierarchy between the raw media and full semantic understanding of the media's content. The second section discusses real users' queries with respect to the semantic gap. The final sections of the paper describe our own experience in attempting to bridge the semantic gap. In particular we discuss our work on auto-annotation and semantic-space models of image retrieval in order to bridge the gap from the bottom up, and the use of ontologies, which capture more semantics than keyword object labels alone, as a technique for bridging the gap from the top down.

Citation Download Citation

Jonathon S. Hare, Paul H. Lewis, Peter G. B. Enser, and Christine J. Sandom "Mind the gap: another look at the problem of the semantic gap in image retrieval", Proc. SPIE 6073, Multimedia Content Analysis, Management, and Retrieval 2006, 607309 (16 January 2006); https://doi.org/10.1117/12.647755

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available