Approximation of a pipeline of unsupervised retina image analysis methods with a CNN

Friso G. Heslinga; Josien P. W. Pluim; Behdad Dashtbozorg; Tos T. J. M. Berendschot; A. J. H. M. Houben; Ronald M. A. Henry M.D.; Mitko Veta

doi:10.1117/12.2512393

15 March 2019 Approximation of a pipeline of unsupervised retina image analysis methods with a CNN

Friso G. Heslinga, Josien P. W. Pluim, Behdad Dashtbozorg, Tos T. J. M. Berendschot, A. J. H. M. Houben, Ronald M. A. Henry M.D., Mitko Veta

Author Affiliations +

Proceedings Volume 10949, Medical Imaging 2019: Image Processing; 109491N (2019) https://doi.org/10.1117/12.2512393
Event: SPIE Medical Imaging, 2019, San Diego, California, United States

Abstract

A pipeline of unsupervised image analysis methods for extraction of geometrical features from retinal fundus images has previously been developed. Features related to vessel caliber, tortuosity and bifurcations, have been identified as potential biomarkers for a variety of diseases, including diabetes and Alzheimer’s. The current computationally expensive pipeline takes 24 minutes to process a single image, which impedes implementation in a screening setting. In this work, we approximate the pipeline with a convolutional neural network (CNN) that enables processing of a single image in a few seconds. As an additional benefit, the trained CNN is sensitive to key structures in the retina and can be used as a pretrained network for related disease classification tasks. Our model is based on the ResNet-50 architecture and outputs four biomarkers that describe global properties of the vascular tree in retinal fundus images. Intraclass correlation coefficients between the predictions of the CNN and the results of the pipeline showed strong agreement (0.86 - 0.91) for three of four biomarkers and moderate agreement (0.42) for one biomarker. Class activation maps were created to illustrate the attention of the network. The maps show qualitatively that the activations of the network overlap with the biomarkers of interest, and that the network is able to distinguish venules from arterioles. Moreover, local high and low tortuous regions are clearly identified, confirming that a CNN is sensitive to key structures in the retina.

Conference Presentation

Citation Download Citation

Friso G. Heslinga, Josien P. W. Pluim, Behdad Dashtbozorg, Tos T. J. M. Berendschot, A. J. H. M. Houben, Ronald M. A. Henry M.D., and Mitko Veta "Approximation of a pipeline of unsupervised retina image analysis methods with a CNN", Proc. SPIE 10949, Medical Imaging 2019: Image Processing, 109491N (15 March 2019); https://doi.org/10.1117/12.2512393

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available