Using perceptually based face indexing to facilitate human-computer collaborative retrieval

John Arthur Black Jr.; Laurent Bonnasse; Pallavi Satyan; Seline Ozer; Sethuraman Panchanathan

doi:10.1117/12.596951

18 March 2005 Using perceptually based face indexing to facilitate human-computer collaborative retrieval

John Arthur Black Jr., Laurent Bonnasse, Pallavi Satyan, Seline Ozer, Sethuraman Panchanathan

Proceedings Volume 5666, Human Vision and Electronic Imaging X; (2005) https://doi.org/10.1117/12.596951
Event: Electronic Imaging 2005, 2005, San Jose, California, United States

Abstract

While methods such as Principle Component Analysis, Linear/Fisher Discriminate Analysis, and Hidden Markov Models provide useful similarity measures between face images, they are not based on factors that humans use to perceive facial similarity. This can make it difficult for humans to work collaboratively with face retrieval systems. For example, if a witness to a crime uses a query-by-example paradigm to retrieve the face of the perpetrator from a database of mug-shots, and if the similarity measures used for retrieval are not based on facial features that are salient or important to humans, the retrievals will likely be of limited value. Based on the observation that humans tend to name things that are particularly salient or important to them, this research uses words (such as bearded, bespectacled, big eared, blond, buck-toothed, bug-eyed, curly-haired, dimpled, freckled, gap-toothed, long-faced, snub-nosed, thin-lipped, or wrinkled) to manually index face images. Pair-wise similarity values are then derived from the resulting feature vectors and are compared to ground-truth similarity values, which have been established by having humans hierarchically sort the same set of face images. This comparison indicates which words are most important for indexing the face images, allows the computation of a weighting factor for each word to enhance the overall quality of indexing, and suggests which facial features might provide a more intuitive basis for evaluating similarity.

Citation Download Citation

John Arthur Black Jr., Laurent Bonnasse, Pallavi Satyan, Seline Ozer, and Sethuraman Panchanathan "Using perceptually based face indexing to facilitate human-computer collaborative retrieval", Proc. SPIE 5666, Human Vision and Electronic Imaging X, (18 March 2005); https://doi.org/10.1117/12.596951

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available