X-Eye: a novel wearable vision system

Yuan-Kai Wang; Ching-Tang Fan; Shao-Ang Chen; Hou-Ye Chen

doi:10.1117/12.876637

2 February 2011 X-Eye: a novel wearable vision system

Yuan-Kai Wang, Ching-Tang Fan, Shao-Ang Chen, Hou-Ye Chen

Proceedings Volume 7871, Real-Time Image and Video Processing 2011; 78710Q (2011) https://doi.org/10.1117/12.876637
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States

Abstract

This paper proposes a smart portable device, named the X-Eye, which provides a gesture interface with a small size but a large display for the application of photo capture and management. The wearable vision system is implemented with embedded systems and can achieve real-time performance. The hardware of the system includes an asymmetric dualcore processer with an ARM core and a DSP core. The display device is a pico projector which has a small volume size but can project large screen size. A triple buffering mechanism is designed for efficient memory management. Software functions are partitioned and pipelined for effective execution in parallel. The gesture recognition is achieved first by a color classification which is based on the expectation-maximization algorithm and Gaussian mixture model (GMM). To improve the performance of the GMM, we devise a LUT (Look Up Table) technique. Fingertips are extracted and geometrical features of fingertip's shape are matched to recognize user's gesture commands finally. In order to verify the accuracy of the gesture recognition module, experiments are conducted in eight scenes with 400 test videos including the challenge of colorful background, low illumination, and flickering. The processing speed of the whole system including the gesture recognition is with the frame rate of 22.9FPS. Experimental results give 99% recognition rate. The experimental results demonstrate that this small-size large-screen wearable system has effective gesture interface with real-time performance.

Citation Download Citation

Yuan-Kai Wang, Ching-Tang Fan, Shao-Ang Chen, and Hou-Ye Chen "X-Eye: a novel wearable vision system", Proc. SPIE 7871, Real-Time Image and Video Processing 2011, 78710Q (2 February 2011); https://doi.org/10.1117/12.876637

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Digital signal processing

Gesture recognition

Video

Image processing

Curium

Expectation maximization algorithms

Computing systems

Show All Keywords

Keywords/Phrases

Search In:

Publication Years