Synthesis of pediatric brain tumor images with mass effect

Yu Zhou; Jingru Fu; Örjan Smedby; Rodrigo Moreno

doi:10.1117/12.2654366

3 April 2023 Synthesis of pediatric brain tumor images with mass effect

Yu Zhou, Jingru Fu, Örjan Smedby, Rodrigo Moreno

Proceedings Volume 12464, Medical Imaging 2023: Image Processing; 1246432 (2023) https://doi.org/10.1117/12.2654366
Event: SPIE Medical Imaging, 2023, San Diego, California, United States

Conference Poster

Abstract

In children, brain tumors are the leading cause of cancer-related death. The amount of labeled data in children is much lower than that for adult subjects. This paper proposes a new method to synthesize high-quality pathological pediatric MRI brain images from pathological adult ones. To realistically simulate the appearance of brain tumors, the proposed method considers the mass effect, i.e., the deformation induced by the tumor to the surrounding tissue. First, a probabilistic U-Net was trained to predict a deformation field that encodes the mass effect from the healthy-pathological image pair. Second, the learned deformation field was utilized to warp the healthy mask to simulate the mass effect. The tumor mask is also added to the warped mask. Finally, a label-to-image transformer, i.e., the SPADE GAN, was trained to synthesize a pathological image from the segmentation masks of gray matter, white matter, CSF and the tumor. The synthetic images were evaluated in two quantitative ways: i) three supervised segmentation pipelines were trained on datasets with and without synthetic images. Two pipelines show over 1% improvements in the Dice scores when the datasets were augmented with synthetic data. ii) The Fr´echet inception distance was measured between real and synthetic image distributions. Results show that SPADE outperforms the state-of-the-art Pix2PixHD method in both T1w and T2w modalities. The source code can be accessed on https://github.com/audreyeternal/pediatric-tumor-generation

Citation Download Citation

Yu Zhou, Jingru Fu, Örjan Smedby, and Rodrigo Moreno "Synthesis of pediatric brain tumor images with mass effect", Proc. SPIE 12464, Medical Imaging 2023: Image Processing, 1246432 (3 April 2023); https://doi.org/10.1117/12.2654366

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available