Paper
6 March 2023 Predicting dementia severity by merging anatomical and diffusion MRI with deep 3D convolutional neural networks
Tamoghna Chattopadhyay, Amit Singh, Neha Ann Joshy, Sophia I. Thomopoulos, Talia M. Nir, Hong Zheng, Elnaz Nourollahimoghadam, Umang Gupta, Greg Ver Steeg, Neda Jahanshad, Paul M. Thompson
Author Affiliations +
Proceedings Volume 12567, 18th International Symposium on Medical Information Processing and Analysis; 125670C (2023) https://doi.org/10.1117/12.2669725
Event: 18th International Symposium on Medical Information Processing and Analysis, 2022, Valparaíso, Chile
Abstract
Machine learning methods have been used for over a decade for staging and subtyping a variety of brain diseases, offering fast and objective methods to classify neurodegenerative diseases such as Alzheimer’s disease (AD). Deep learning models based on convolutional neural networks (CNNs) have also been used to infer dementia severity and predict future clinical decline. Most CNN-based deep learning models use T1-weighted brain MRI scans to identify predictive features for these tasks. In contrast, we examine the added value of diffusion-weighted MRI (dMRI) - a variant of MRI, sensitive to microstructural tissue properties - as an additional input in CNN-based models of dementia severity. dMRI is sensitive to microstructural brain abnormalities not evident on standard anatomical MRI. By training CNNs on combined anatomical and diffusion MRI, we hypothesize that we could boost performance when predicting widely-used clinical assessments of dementia severity, such as individuals’ scores on the ADAS11, ADAS13, and MMSE (mini-mental state exam) clinical scales. For benchmarking, we evaluate CNNs that use T1-weighted MRI and dMRI to estimate “brain age” - the task of predicting a person’s chronological age from their neuroimaging data. To assess which dMRI-derived maps were most beneficial, we computed DWI-derived diffusion tensor imaging (DTI) maps of mean and radial diffusivity (MD/RD), axial diffusivity (AD) and fractional anisotropy (FA) for 1198 elderly subjects (age: 74.35 +/- 7.74 yrs.; 600 F/598 M, with a distribution of 636 CN/421 MCI/141 AD) from the Alzheimer’s Disease Neuroimaging Initiative (ADNI). We tested both 2D Slice CNN and 3D CNN neural network models for the above predictive tasks. Our results suggest that for at least some deep learning architectures, diffusion-weighted MRI may enhance performance for several AD-relevant deep learning tasks relative to using T1-weighted images alone.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Tamoghna Chattopadhyay, Amit Singh, Neha Ann Joshy, Sophia I. Thomopoulos, Talia M. Nir, Hong Zheng, Elnaz Nourollahimoghadam, Umang Gupta, Greg Ver Steeg, Neda Jahanshad, and Paul M. Thompson "Predicting dementia severity by merging anatomical and diffusion MRI with deep 3D convolutional neural networks", Proc. SPIE 12567, 18th International Symposium on Medical Information Processing and Analysis, 125670C (6 March 2023); https://doi.org/10.1117/12.2669725
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Brain

Magnetic resonance imaging

Data modeling

Education and training

3D modeling

Dementia

Neuroimaging

Back to Top