A hybrid convolutional neural network for super-resolution reconstruction of MR images

被引:20
作者
Zheng, Yingjie [1 ,2 ]
Zhen, Bowen [1 ,2 ]
Chen, Aichi [3 ]
Qi, Fulang [1 ,2 ]
Hao, Xiaohan [1 ,2 ]
Qiu, Bensheng [1 ,2 ]
机构
[1] Univ Sci & Technol China, Hefei Natl Lab Phys Sci Microscale, Hefei 230026, Anhui, Peoples R China
[2] Univ Sci & Technol China, Ctr Biomed Engn, Hefei 230026, Anhui, Peoples R China
[3] Univ Calif Los Angeles, Dept Radiol, Los Angeles, CA 90095 USA
关键词
convolutional neural network; hybrid network; MR images; super-resolution;
D O I
10.1002/mp.14152
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose Spatial resolution is an important parameter for magnetic resonance imaging (MRI). High-resolution MR images provide detailed information and benefit subsequent image analysis. However, higher resolution MR images come at the expense of longer scanning time and lower signal-to-noise ratios (SNRs). Using algorithms to improve image resolution can mitigate these limitations. Recently, some convolutional neural network (CNN)-based super-resolution (SR) algorithms have flourished on MR image reconstruction. However, most algorithms usually adopt deeper network structures to improve the performance. Methods In this study, we propose a novel hybrid network (named HybridNet) to improve the quality of SR images by increasing the width of the network. Specifically, the proposed hybrid block combines a multipath structure and variant dense blocks to extract abundant features from low-resolution images. Furthermore, we fully exploit the hierarchical features from different hybrid blocks to reconstruct high-quality images. Results All SR algorithms are evaluated using three MR image datasets and the proposed HybridNet outperformed the comparative methods with peak a signal-to-noise ratio (PSNR) of 42.12 +/- 0.92 dB, 38.60 +/- 2.46 dB, 35.17 +/- 2.96 dB and a structural similarity index (SSIM) of 0.9949 +/- 0.0015, 0.9892 +/- 0.0034, 0.9740 +/- 0.0064, respectively. Besides, our proposed network can reconstruct high-quality images on an unseen MR dataset with PSNR of 33.27 +/- 1.56 and SSIM of 0.9581 +/- 0.0068. Conclusions The results demonstrate that HybridNet can reconstruct high-quality SR images from degraded MR images and has good generalization ability. It also can be leveraged to assist the task of image analysis or processing.
引用
收藏
页码:3013 / 3022
页数:10
相关论文
共 32 条
[1]  
Alexander DC, 2014, LECT NOTES COMPUT SC, V8675, P225, DOI 10.1007/978-3-319-10443-0_29
[2]  
[Anonymous], 2018, ABS180803344 CORR
[3]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[4]   Shared Address Translation Revisited [J].
Dong, Xiaowan ;
Dwarkadas, Sandhya ;
Cox, Alan L. .
PROCEEDINGS OF THE ELEVENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS, (EUROSYS 2016), 2016,
[5]   Fast and robust multiframe super resolution [J].
Farsiu, S ;
Robinson, MD ;
Elad, M ;
Milanfar, P .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (10) :1327-1344
[6]   Brain tumor segmentation with Deep Neural Networks [J].
Havaei, Mohammad ;
Davy, Axel ;
Warde-Farley, David ;
Biard, Antoine ;
Courville, Aaron ;
Bengio, Yoshua ;
Pal, Chris ;
Jodoin, Pierre-Marc ;
Larochelle, Hugo .
MEDICAL IMAGE ANALYSIS, 2017, 35 :18-31
[7]  
Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.181, 10.1109/CVPR.2016.182]
[8]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[9]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[10]   Survey:: Interpolation methods in medical image processing [J].
Lehmann, TM ;
Gönner, C ;
Spitzer, K .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 1999, 18 (11) :1049-1075