Intra-operative brain tumor detection with deep learning-optimized hyperspectral imaging

Tommaso Giannantonio; Anna Alperovich; Piercosimo Semeraro; Manfredo Atzori; Xiaohan Zhang; Christoph Hauger; Alexander Freytag; Siri Luthman; Roeland Vandebriel; Murali Jayapala; Lien Solie; Steven de Vleeschouwer

doi:10.1117/12.2646999

6 March 2023 Intra-operative brain tumor detection with deep learning-optimized hyperspectral imaging

Tommaso Giannantonio, Anna Alperovich, Piercosimo Semeraro, Manfredo Atzori, Xiaohan Zhang, Christoph Hauger, Alexander Freytag, Siri Luthman, Roeland Vandebriel, Murali Jayapala, Lien Solie, Steven de Vleeschouwer

Author Affiliations +

Proceedings Volume 12373, Optical Biopsy XXI: Toward Real-Time Spectroscopic Imaging and Diagnosis; 123730F (2023) https://doi.org/10.1117/12.2646999
Event: SPIE BiOS, 2023, San Francisco, California, United States

Conference Poster

Abstract

Surgery for gliomas (intrinsic brain tumors), especially when low-grade, is challenging due to the infiltrative nature of the lesion. Currently, no real-time, intra-operative, label-free and wide-field tool is available to assist and guide the surgeon to find the relevant demarcations for these tumors. While marker-based methods exist for the high-grade glioma case, there is no convenient solution available for the low-grade case; thus, marker-free optical techniques represent an attractive option. Although RGB imaging is a standard tool in surgical microscopes, it does not contain sufficient information for tissue differentiation. We leverage the richer information from hyperspectral imaging (HSI), acquired with a snapscan camera in the 468 − 787 nm range, coupled to a surgical microscope, to build a deep-learning-based diagnostic tool for cancer resection with potential for intra-operative guidance. However, the main limitation of the HSI snapscan camera is the image acquisition time, limiting its widespread deployment in the operation theater. Here, we investigate the effect of HSI channel reduction and pre-selection to scope the design space for the development of cheaper and faster sensors. Neural networks are used to identify the most important spectral channels for tumor tissue differentiation, optimizing the trade-off between the number of channels and precision to enable real-time intra-surgical application. We evaluate the performance of our method on a clinical dataset that was acquired during surgery on five patients. By demonstrating the possibility to efficiently detect low-grade glioma, these results can lead to better cancer resection demarcations, potentially improving treatment effectiveness and patient outcome.

Citation Download Citation

Tommaso Giannantonio, Anna Alperovich, Piercosimo Semeraro, Manfredo Atzori, Xiaohan Zhang, Christoph Hauger, Alexander Freytag, Siri Luthman, Roeland Vandebriel, Murali Jayapala, Lien Solie, and Steven de Vleeschouwer "Intra-operative brain tumor detection with deep learning-optimized hyperspectral imaging", Proc. SPIE 12373, Optical Biopsy XXI: Toward Real-Time Spectroscopic Imaging and Diagnosis, 123730F (6 March 2023); https://doi.org/10.1117/12.2646999

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available