Tracking facial features in video sequences using a deformable-model-based approach

Marius Malciu; Francoise J. Preteux

doi:10.1117/12.402450

4 October 2000 Tracking facial features in video sequences using a deformable-model-based approach

Marius Malciu, Francoise J. Preteux

Proceedings Volume 4121, Mathematical Modeling, Estimation, and Imaging; (2000) https://doi.org/10.1117/12.402450
Event: International Symposium on Optical Science and Technology, 2000, San Diego, CA, United States

Abstract

This paper addresses the issue of computer vision-based face motion capture as an alternative to physical sensor-based technologies. The proposed method combines a deformable template-based tracking of mouth and eyes in arbitrary video sequences with a single speaking person with a global 3D head pose estimation procedure yielding robust initializations. Mathematical principles underlying deformable template matching together with definition and extraction of salient image features are presented. Specifically, interpolating cubic B-splines between the MPEG-4 Face Animation Parameters (FAPs) associated with the mouth and eyes are used as template parameterization. Modeling the template a network of springs interconnecting with the mouth and eyes FAPs, the internal energy is expressed as a combination of elastic and symmetry local constraints. The external energy function, which allows to enforce interactions with image data, involves contour, texture and topography properties properly combined within robust potential functions. Template matching is achieved by applying the downhill simplex method for minimizing the global energy cost. Stability and accuracy of the results are discussed on a set of 2000 frames corresponding to 5 video sequences of speaking people.

Citation Download Citation

Marius Malciu and Francoise J. Preteux "Tracking facial features in video sequences using a deformable-model-based approach", Proc. SPIE 4121, Mathematical Modeling, Estimation, and Imaging, (4 October 2000); https://doi.org/10.1117/12.402450

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available