A survey of imagery techniques for semantic labeling of human-vehicle interactions in persistent surveillance systems

Vinayak Elangovan; Amir Shirkhodaie

doi:10.1117/12.887019

5 May 2011 A survey of imagery techniques for semantic labeling of human-vehicle interactions in persistent surveillance systems

Vinayak Elangovan, Amir Shirkhodaie

Author Affiliations +

Proceedings Volume 8050, Signal Processing, Sensor Fusion, and Target Recognition XX; 80501P (2011) https://doi.org/10.1117/12.887019
Event: SPIE Defense, Security, and Sensing, 2011, Orlando, Florida, United States

Abstract

Understanding and semantic annotation of Human-Vehicle Interactions (HVI) facilitate fusion of Hard sensor (HS) and Human Intelligence (HUMINT) in a cohesive way. By characterization, classification, and discrimination of HVI patterns pertinent threats may be realized. Various Persistent Surveillance System (PSS) imagery techniques have been proposed in the past decade for identifying human interactions with various objects in the environment. Understanding of such interactions facilitates to discover human intentions and motives. However, without consideration of incidental context, reasoning and analysis of such behavioral activities is a very challenging and difficult task. This paper presents a current survey of related publications in the area of context-based Imagery techniques applied for HVI recognition, in particular, it discusses taxonomy and ontology of HVI and presents a summary of reported robust image processing techniques for spatiotemporal characterization and tracking of human targets in urban environments. The discussed techniques include model-based, shape-based and appearance-based techniques employed for identification and classification of objects. A detailed overview of major past research activities related to HVI in PSS with exploitation of spatiotemporal reasoning techniques applied to semantic labeling of the HVI is also presented.

Citation Download Citation

Vinayak Elangovan and Amir Shirkhodaie "A survey of imagery techniques for semantic labeling of human-vehicle interactions in persistent surveillance systems", Proc. SPIE 8050, Signal Processing, Sensor Fusion, and Target Recognition XX, 80501P (5 May 2011); https://doi.org/10.1117/12.887019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available