A real-time GPU implementation of the SIFT algorithm for large-scale video analysis tasks

Hannes Fassold; Jakub Rosner

doi:10.1117/12.2083201

27 February 2015 A real-time GPU implementation of the SIFT algorithm for large-scale video analysis tasks

Hannes Fassold, Jakub Rosner

Proceedings Volume 9400, Real-Time Image and Video Processing 2015; 940007 (2015) https://doi.org/10.1117/12.2083201
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

The SIFT algorithm is one of the most popular feature extraction methods and therefore widely used in all sort of video analysis tasks like instance search and duplicate/ near-duplicate detection. We present an efficient GPU implementation of the SIFT descriptor extraction algorithm using CUDA. The major steps of the algorithm are presented and for each step we describe how to efficiently parallelize it massively, how to take advantage of the unique capabilities of the GPU like shared memory / texture memory and how to avoid or minimize common GPU performance pitfalls. We compare the GPU implementation with the reference CPU implementation in terms of runtime and quality and achieve a speedup factor of approximately 3 - 5 for SD and 5 - 6 for Full HD video with respect to a multi-threaded CPU implementation, allowing us to run the SIFT descriptor extraction algorithm in real-time on SD video. Furthermore, quality tests show that the GPU implementation gives the same quality as the reference CPU implementation from the HessSIFT library. We further describe the benefits of GPU-accelerated SIFT descriptor calculation for video analysis applications such as near-duplicate video detection.

Citation Download Citation

Hannes Fassold and Jakub Rosner "A real-time GPU implementation of the SIFT algorithm for large-scale video analysis tasks", Proc. SPIE 9400, Real-Time Image and Video Processing 2015, 940007 (27 February 2015); https://doi.org/10.1117/12.2083201

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available