Poster + Paper
4 April 2022 A convolutional neural network based super resolution technique of CT image utilizing both sinogram domain and image domain data
Author Affiliations +
Conference Poster
Abstract
In previous deep learning based super-resolution techniques for CT images, only image domain data is used for training. However, image blurring can occur in image domain method which disrupts accurate diagnosis. In this work, we propose using both sinogram and image domain data to resolve the blurring issue. To predict upsampled sinogram more accurately, we use a convolutional neural network (CNN) as an encoder, which maps an input image to feature map for decoder. For decoder, we use dual multi-layer perceptron (MLP) structure. Our proposed dual-MLP structure consists of modulator and synthesizer MLP. Synthesizer MLP predicts the output pixel value by using coordinate-based information as an input, and modulator MLP helps synthesizer to estimate the output value accurately by using feature map information as an input. This network structure preserves high frequency components better than simple CNN structure. Through our proposed sinogram upsampling network (SUN) at sinogram domain, upsampled sinogram was generated, and image was reconstructed by filtered backprojection. The reconstructed image from upsampled sinogram preserves detailed textures compared to LR image. However, residual artifacts and blur still remain. Therefore, we train CNN using image domain data to reduce residual artifacts and blur. For the dataset, we acquire projection data from Mayo Clinic image using Siddon's algorithm in fan-beam CT geometry applying 4x1 detector binning. The binned sinogram is then used as an input for the SUN. The results show that our proposed hybrid domain method outperforms image domain and sinogram domain method with higher quantitative evaluation results.
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Minwoo Yu, Minah Han, and Jongduk Baek "A convolutional neural network based super resolution technique of CT image utilizing both sinogram domain and image domain data", Proc. SPIE 12032, Medical Imaging 2022: Image Processing, 1203223 (4 April 2022); https://doi.org/10.1117/12.2611972
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image processing

Computed tomography

Super resolution

Convolutional neural networks

Back to Top