Autoencoder-Inspired Convolutional Network-Based Super-Resolution Method in MRI

被引:27
作者
Park, Seonyeong [1 ]
Gach, H. Michael [2 ]
Kim, Siyong [3 ]
Lee, Suk Jin [4 ]
Motai, Yuichi [5 ]
机构
[1] Univ Illinois, Dept Bioengn, Urbana, IL 61820 USA
[2] Washington Univ, Dept Radiat Oncol, St Louis, MO 63130 USA
[3] Virginia Commonwealth Univ, Dept Radiat Oncol, Div Med Phys, Richmond, VA 23284 USA
[4] Columbus State Univ, TSYS Sch Comp Sci, Columbus, GA 31907 USA
[5] Virginia Commonwealth Univ, Dept Elect & Comp Engn, Richmond, VA 23284 USA
基金
美国国家科学基金会; 美国国家卫生研究院;
关键词
Autoencoder; convolution neural network; deep learning; MRI; super resolution; IN-UTERO FETAL; IMAGE SUPERRESOLUTION; VOLUME RECONSTRUCTION; RESOLUTION; BRAIN; DIFFUSION;
D O I
10.1109/JTEHM.2021.3076152
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective: To introduce an MRI in-plane resolution enhancement method that estimates High-Resolution (HR) MRIs from Low-Resolution (LR) MRIs. Method & Materials: Previous CNN-based MRI super-resolution methods cause loss of input image information due to the pooling layer. An Autoencoder-inspired Convolutional Network-based Super-resolution (ACNS) method was developed with the deconvolution layer that extrapolates the missing spatial information by the convolutional neural network-based nonlinear mapping between LR and HR features of MRI. Simulation experiments were conducted with virtual phantom images and thoracic MRIs from four volunteers. The Peak Signal-to-Noise Ratio (PSNR), Structure SIMilarity index (SSIM), Information Fidelity Criterion (IFC), and computational time were compared among: ACNS; Super-Resolution Convolutional Neural Network (SRCNN); Fast Super-Resolution Convolutional Neural Network (FSRCNN); Deeply-Recursive Convolutional Network (DRCN). Results: ACNS achieved comparable PSNR, SSIM, and IFC results to SRCNN, FSRCNN, and DRCN. However, the average computation speed of ACNS was 6, 4, and 35 times faster than SRCNN, FSRCNN, and DRCN, respectively under the computer setup used with the actual average computation time of 0.15 s per 100 x 100 pixels. Conclusion: The result of this study implies the potential application of ACNS to real-time resolution enhancement of 4D MRI in MRI guided radiation therapy.
引用
收藏
页数:13
相关论文
共 77 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]   Deep learning with non-medical training used for chest pathology identification [J].
Bar, Yaniv ;
Diamant, Idit ;
Wolf, Lior ;
Greenspan, Hayit .
MEDICAL IMAGING 2015: COMPUTER-AIDED DIAGNOSIS, 2015, 9414
[3]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[4]   Super-resolution through neighbor embedding [J].
Chang, H ;
Yeung, DY ;
Xiong, Y .
PROCEEDINGS OF THE 2004 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, 2004, :275-282
[5]  
Chaudhari AS, 2020, J MAGN RESON IMAGING, V51, P768, DOI [10.1002/jmri.26872, 10.1002/jmri.26991]
[6]   Super-resolution musculoskeletal MRI using deep learning [J].
Chaudhari, Akshay S. ;
Fang, Zhongnan ;
Kogan, Feliks ;
Wood, Jeff ;
Stevens, Kathryn J. ;
Gibbons, Eric K. ;
Lee, Jin Hyung ;
Gold, Garry E. ;
Hargreaves, Brian A. .
MAGNETIC RESONANCE IN MEDICINE, 2018, 80 (05) :2139-2154
[7]  
Chen YH, 2018, I S BIOMED IMAGING, P739
[8]   Trainable Nonlinear Reaction Diffusion: A Flexible Framework for Fast and Effective Image Restoration [J].
Chen, Yunjin ;
Pock, Thomas .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1256-1272
[9]   Deep-Learning Super-Resolution MRI: Getting Something From Nothing [J].
Chong, Jaron J. R. .
JOURNAL OF MAGNETIC RESONANCE IMAGING, 2020, 51 (04) :1140-1141
[10]  
Doneva M., 2008, Proceedings of the International Society for Magnetic Resonance in Medicine, V16, P336