Segmentation of 4D images via space-time neural networks

Changjian Sun; Jayaram K. Udupa; Yubing Tong; Sanghun Sin; Mark Wagshul; Drew A. Torigian; Raanan Arens

doi:10.1117/12.2549605

28 February 2020 Segmentation of 4D images via space-time neural networks

Changjian Sun, Jayaram K. Udupa, Yubing Tong, Sanghun Sin, Mark Wagshul, Drew A. Torigian, Raanan Arens

Proceedings Volume 11317, Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging; 113170J (2020) https://doi.org/10.1117/12.2549605
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

Medical imaging techniques currently produce 4D images that portray the dynamic behaviors and phenomena associated with internal structures. The segmentation of 4D images poses challenges different from those arising in segmenting 3D static images due to different patterns of variation of object shape and appearance in the space and time dimensions. In this paper, different network models are designed to learn the pattern of slice-to-slice change in the space and time dimensions independently. The two models then allow a gamut of strategies to actually segment the 4D image, such as segmentation following just the space or time dimension only, or following first the space dimension for one time instance and then following all time instances, or vice versa, etc. This paper investigates these strategies in the context of the obstructive sleep apnea (OSA) application and presents a unified deep learning framework to segment 4D images. Because of the sparse tubular nature of the upper airway and the surrounding low-contrast structures, inadequate contrast resolution obtainable in the magnetic resonance (MR) images leaves many challenges for effective segmentation of the dynamic airway in 4D MR images. Given that these upper airway structures are sparse, a Dice coefficient (DC) of ~0.88 for their segmentation based on our preferred strategy is similar to a DC of <0.95 for large non-sparse objects like liver, lungs, etc., constituting excellent accuracy.

Conference Presentation

Citation Download Citation

Changjian Sun, Jayaram K. Udupa, Yubing Tong, Sanghun Sin, Mark Wagshul, Drew A. Torigian, and Raanan Arens "Segmentation of 4D images via space-time neural networks", Proc. SPIE 11317, Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging, 113170J (28 February 2020); https://doi.org/10.1117/12.2549605

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available