Audio extraction from silent high-speed video using an optical technique

Zhaoyang Wang; Hieu Nguyen; Jason Quisberth

doi:10.1117/1.OE.53.11.110502

21 November 2014 Audio extraction from silent high-speed video using an optical technique

Zhaoyang Wang, Hieu Nguyen, Jason Quisberth

Author Affiliations +

Funded by: Army Research Office (ARO), U.S. Army Research Office (ARO)

Optical Engineering, Vol. 53, Issue 11, 110502 (November 2014). https://doi.org/10.1117/1.OE.53.11.110502

Abstract

It is demonstrated that audio information can be extracted from silent high-speed video with a simple and fast optical technique. The basic principle is that the sound waves can stimulate objects encountered in the traveling path to vibrate. The vibrations, although usually with small amplitudes, can be detected by using an image matching process. The proposed technique applies a subset-based image correlation approach to detect the motions of points on the surface of an object. It employs the Gauss-Newton algorithm and a few other measures to achieve very fast and highly accurate image matching. Because the detected vibrations are directly related to the sound waves, a simple model is introduced to reconstruct the original audio information of the sound waves. The proposed technique is robust and easy to implement, and its effectiveness has been verified by experiments.

Citation Download Citation

Zhaoyang Wang, Hieu Nguyen, and Jason Quisberth "Audio extraction from silent high-speed video using an optical technique," Optical Engineering 53(11), 110502 (21 November 2014). https://doi.org/10.1117/1.OE.53.11.110502

Published: 21 November 2014

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE