Application of real-time single camera SLAM technology for image-guided targeting in neurosurgery

Yau-Zen Chang; Jung-Fu Hou; Yi Hsiang Tsao; Shih-Tseng Lee

doi:10.1117/12.928448

15 October 2012 Application of real-time single camera SLAM technology for image-guided targeting in neurosurgery

Yau-Zen Chang, Jung-Fu Hou, Yi Hsiang Tsao, Shih-Tseng Lee

Proceedings Volume 8499, Applications of Digital Image Processing XXXV; 84992D (2012) https://doi.org/10.1117/12.928448
Event: SPIE Optical Engineering + Applications, 2012, San Diego, California, United States

Abstract

In this paper, we propose an application of augmented reality technology for targeting tumors or anatomical structures inside the skull. The application is a combination of the technologies of MonoSLAM (Single Camera Simultaneous Localization and Mapping) and computer graphics. A stereo vision system is developed to construct geometric data of human face for registration with CT images. Reliability and accuracy of the application is enhanced by the use of fiduciary markers fixed to the skull. The MonoSLAM keeps track of the current location of the camera with respect to an augmented reality (AR) marker using the extended Kalman filter. The fiduciary markers provide reference when the AR marker is invisible to the camera. Relationship between the markers on the face and the augmented reality marker is obtained by a registration procedure by the stereo vision system and is updated on-line. A commercially available Android based tablet PC equipped with a 320×240 front-facing camera was used for implementation. The system is able to provide a live view of the patient overlaid by the solid models of tumors or anatomical structures, as well as the missing part of the tool inside the skull.

Citation Download Citation

Yau-Zen Chang, Jung-Fu Hou, Yi Hsiang Tsao, and Shih-Tseng Lee "Application of real-time single camera SLAM technology for image-guided targeting in neurosurgery", Proc. SPIE 8499, Applications of Digital Image Processing XXXV, 84992D (15 October 2012); https://doi.org/10.1117/12.928448

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available