End-to-end 3D neuroendoscopic video reconstruction for robot-assisted ventriculostomy

P. Vagdargi; A. Uneri; S. Liu; C. K. Jones; A. Sisniega; J. Lee; P. A. Helm; W. S. Anderson; M. Luciano; G. D. Hager; J. H. Siewerdsen

doi:10.1117/12.3008758

29 March 2024 End-to-end 3D neuroendoscopic video reconstruction for robot-assisted ventriculostomy

P. Vagdargi, A. Uneri, S. Liu, C. K. Jones, A. Sisniega, J. Lee, P. A. Helm, W. S. Anderson, M. Luciano, G. D. Hager, J. H. Siewerdsen

Author Affiliations +

Proceedings Volume 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling; 129280M (2024) https://doi.org/10.1117/12.3008758
Event: SPIE Medical Imaging, 2024, San Diego, California, United States

Abstract

Purpose: Navigating deep-brain structures in neurosurgery, especially under deformation from CSF egress, remains challenging due to the limitations of current robotic systems relying on rigid registration. This study presents the initial steps towards vision-based navigation leveraging Neural Radiance Fields (NeRF) to enable 3D neuroendoscopic reconstruction on the Robot-Assisted Ventriculoscopy (RAV) platform. Methods: An end-to-end 3D reconstruction and registration method using posed images was developed and integrated with the RAV platform. The hyperparameters for training the dual-branch network were first identified. Further experiments were conducted to evaluate reconstruction accuracy using projected error (PE) while varying the volume density threshold parameter. Results: A 3D volume was reconstructed using a simple linear trajectory for data acquisition with 300 frames and corresponding camera poses. The density volume threshold was varied to obtain an optimal value of 96.55 percentile, with a corresponding PE of 0.65 mm. Conclusions: Initial methods for end-to-end neuroendoscopic video reconstruction were developed in phantom studies. Experiments identified the optimal parameters, yielding a geometrically accurate reconstruction along with fast network convergence runtime of < 30 s. The method is highly promising for future clinical translation in realistic neuroendoscopic scenes. Future work will also develop a direct surface-to-volume registration method for improving reconstruction accuracy and runtime.

Conference Presentation

Citation Download Citation

P. Vagdargi, A. Uneri, S. Liu, C. K. Jones, A. Sisniega, J. Lee, P. A. Helm, W. S. Anderson, M. Luciano, G. D. Hager, and J. H. Siewerdsen "End-to-end 3D neuroendoscopic video reconstruction for robot-assisted ventriculostomy", Proc. SPIE 12928, Medical Imaging 2024: Image-Guided Procedures, Robotic Interventions, and Modeling, 129280M (29 March 2024); https://doi.org/10.1117/12.3008758

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available