Multimodal graph isomorphism network to study fMRI connectivity in developmental stages of adolescence

Beenish Patel; Anton Orlichenko; Yu-Ping Wang

doi:10.1117/12.2611190

4 April 2022 Multimodal graph isomorphism network to study fMRI connectivity in developmental stages of adolescence

Beenish Patel, Anton Orlichenko, Yu-Ping Wang

Proceedings Volume 12036, Medical Imaging 2022: Biomedical Applications in Molecular, Structural, and Functional Imaging; 120361W (2022) https://doi.org/10.1117/12.2611190
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

A fundamental understanding of sex differences that exist in healthy individuals is critical for the study of neurological illnesses that exhibit phenotypic differences between both genders. Functional magnetic resonance imaging(fMRI) is a useful way to study this problem since it provides a non-invasive and high-resolution tool for observing the fluctuation in blood oxygenation level dependent (BOLD) signals to characterize the metabolism of the human brain. In the meantime, graph neural networks (GNNs) can be applied to fMRI data to effectively discover novel biomarkers underlying brain development. We propose a multi-modal graph isomorphism network (MGIN) to analyze the sex differences based on fMRI task data. Our method is able to integrate all the available connectivity data into graphs for deep learning, and it can be applied to multigraphs with different nodes to learn local graph information without binding to the entire graph. MGIN model can identify important subnetworks between and within multi-task data. In addition, it is interpretable by using GNNExplainer to provide important domain insights to identify graph structures and node features that contribute significantly to the classification results. Our MGIN model can achieve better classification accuracy compared to competing models. We applied the model to a cohort of brain development study to classify sex during different stages of adolescence and experimental results showed that our model can improve classification accuracy and help in our understanding of neurodevelopment during adolescence.

Citation Download Citation

Beenish Patel, Anton Orlichenko, and Yu-Ping Wang "Multimodal graph isomorphism network to study fMRI connectivity in developmental stages of adolescence", Proc. SPIE 12036, Medical Imaging 2022: Biomedical Applications in Molecular, Structural, and Functional Imaging, 120361W (4 April 2022); https://doi.org/10.1117/12.2611190

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available