Open Access
16 May 2022 Unsupervised super-resolution reconstruction of hyperspectral histology images for whole-slide imaging
Author Affiliations +
Abstract

Significance: Hyperspectral imaging (HSI) provides rich spectral information for improved histopathological cancer detection. However, acquiring high-resolution HSI data for whole-slide imaging (WSI) can be time-consuming and requires a huge amount of storage space.

Aim: WSI using a color camera can be achieved with fast speed, high image resolution, and excellent image quality due to the established techniques. We aim to develop an RGB-guided unsupervised hyperspectral super-resolution reconstruction method that is hypothesized to improve image quality while maintaining the spectral characteristics.

Approach: High-resolution hyperspectral images of 32 histologic slides were obtained via automated WSI. High-resolution RGB histology images were registered to the hyperspectral images for RGB guidance. An unsupervised super-resolution network was trained to take the downsampled low-resolution hyperspectral patches (LR-HSI) and high-resolution RGB patches (HR-RGB) as inputs to reconstruct high-resolution hyperspectral patches (HR-HSI). Then, an Inception-based network was trained with the HR-RGB, original HR-HSI, and generated HR-HSI, respectively, for whole-slide histopathological cancer detection.

Results: Our super-resolution reconstruction network generated high-resolution hyperspectral images with well-maintained spectral characteristics and improved image quality. Image classification using the original hyperspectral data outperformed RGB because of the extra spectral information. The generated hyperspectral image patches further improved the results.

Conclusions: The proposed method potentially reduces image acquisition time, saves storage space without compromising image quality, and improves the image classification performance.

CC BY: © The Authors. Published by SPIE under a Creative Commons Attribution 4.0 Unported License. Distribution or reproduction of this work in whole or in part requires full attribution of the original publication, including its DOI.
Ling Ma, Armand Rathgeb, Hasan Mubarak, Minh Tran, and Baowei Fei "Unsupervised super-resolution reconstruction of hyperspectral histology images for whole-slide imaging," Journal of Biomedical Optics 27(5), 056502 (16 May 2022). https://doi.org/10.1117/1.JBO.27.5.056502
Received: 18 February 2022; Accepted: 28 April 2022; Published: 16 May 2022
Lens.org Logo
CITATIONS
Cited by 5 scholarly publications.
Advertisement
Advertisement
KEYWORDS
Hyperspectral imaging

Super resolution

RGB color model

Image classification

Cameras

Image quality

Tissues

Back to Top