TextureWGAN: texture preserving WGAN with multitask regularizer for computed tomography inverse problems

Masaki Ikuta; Jun Zhang

doi:10.1117/1.JMI.10.2.024003

7 March 2023 TextureWGAN: texture preserving WGAN with multitask regularizer for computed tomography inverse problems

Masaki Ikuta, Jun Zhang

Author Affiliations +

Journal of Medical Imaging, Vol. 10, Issue 2, 024003 (March 2023). https://doi.org/10.1117/1.JMI.10.2.024003

Abstract

Purpose

This paper presents a deep learning (DL) based method called TextureWGAN. It is designed to preserve image texture while maintaining high pixel fidelity for computed tomography (CT) inverse problems. Over-smoothed images by postprocessing algorithms have been a well-known problem in the medical imaging industry. Therefore, our method tries to solve the over-smoothing problem without compromising pixel fidelity.

Approach

The TextureWGAN extends from Wasserstein GAN (WGAN). The WGAN can create an image that looks like a genuine image. This aspect of the WGAN helps preserve image texture. However, an output image from the WGAN is not correlated to the corresponding ground truth image. To solve this problem, we introduce the multitask regularizer (MTR) to the WGAN framework to make a generated image highly correlated to the corresponding ground truth image so that the TextureWGAN can achieve high-level pixel fidelity. The MTR is capable of using multiple objective functions. In this research, we adopt a mean squared error (MSE) loss to maintain pixel fidelity. We also use a perception loss to improve the look and feel of result images. Furthermore, the regularization parameters in the MTR are trained along with generator network weights to maximize the performance of the TextureWGAN generator.

Results

The proposed method was evaluated in CT image reconstruction applications in addition to super-resolution and image-denoising applications. We conducted extensive qualitative and quantitative evaluations. We used PSNR and SSIM for pixel fidelity analysis and the first-order and the second-order statistical texture analysis for image texture. The results show that the TextureWGAN is more effective in preserving image texture compared with other well-known methods such as the conventional CNN and nonlocal mean filter (NLM). In addition, we demonstrate that TextureWGAN can achieve competitive pixel fidelity performance compared with CNN and NLM. The CNN with MSE loss can attain high-level pixel fidelity, but it often damages image texture.

Conclusions

TextureWGAN can preserve image texture while maintaining pixel fidelity. The MTR is not only helpful to stabilize the TextureWGAN’s generator training but also maximizes the generator performance.

Citation Download Citation

Masaki Ikuta and Jun Zhang "TextureWGAN: texture preserving WGAN with multitask regularizer for computed tomography inverse problems," Journal of Medical Imaging 10(2), 024003 (7 March 2023). https://doi.org/10.1117/1.JMI.10.2.024003

Received: 19 October 2021; Accepted: 31 January 2023; Published: 7 March 2023

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $24.00

Non-members: $28.00 ADD TO CART

JOURNAL ARTICLE
35 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Education and training

CT reconstruction

Image analysis

Statistical analysis

Matrices

Image processing

Medical imaging

Purpose

Approach

Results

Conclusions

Show All Keywords

Keywords/Phrases

Search In:

Publication Years