A hybrid convolutional neural network for super-resolution reconstruction of MR images

被引:17
作者
Zheng, Yingjie [1 ,2 ]
Zhen, Bowen [1 ,2 ]
Chen, Aichi [3 ]
Qi, Fulang [1 ,2 ]
Hao, Xiaohan [1 ,2 ]
Qiu, Bensheng [1 ,2 ]
机构
[1] Univ Sci & Technol China, Hefei Natl Lab Phys Sci Microscale, Hefei 230026, Anhui, Peoples R China
[2] Univ Sci & Technol China, Ctr Biomed Engn, Hefei 230026, Anhui, Peoples R China
[3] Univ Calif Los Angeles, Dept Radiol, Los Angeles, CA 90095 USA
关键词
convolutional neural network; hybrid network; MR images; super-resolution;
D O I
10.1002/mp.14152
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
Purpose Spatial resolution is an important parameter for magnetic resonance imaging (MRI). High-resolution MR images provide detailed information and benefit subsequent image analysis. However, higher resolution MR images come at the expense of longer scanning time and lower signal-to-noise ratios (SNRs). Using algorithms to improve image resolution can mitigate these limitations. Recently, some convolutional neural network (CNN)-based super-resolution (SR) algorithms have flourished on MR image reconstruction. However, most algorithms usually adopt deeper network structures to improve the performance. Methods In this study, we propose a novel hybrid network (named HybridNet) to improve the quality of SR images by increasing the width of the network. Specifically, the proposed hybrid block combines a multipath structure and variant dense blocks to extract abundant features from low-resolution images. Furthermore, we fully exploit the hierarchical features from different hybrid blocks to reconstruct high-quality images. Results All SR algorithms are evaluated using three MR image datasets and the proposed HybridNet outperformed the comparative methods with peak a signal-to-noise ratio (PSNR) of 42.12 +/- 0.92 dB, 38.60 +/- 2.46 dB, 35.17 +/- 2.96 dB and a structural similarity index (SSIM) of 0.9949 +/- 0.0015, 0.9892 +/- 0.0034, 0.9740 +/- 0.0064, respectively. Besides, our proposed network can reconstruct high-quality images on an unseen MR dataset with PSNR of 33.27 +/- 1.56 and SSIM of 0.9581 +/- 0.0068. Conclusions The results demonstrate that HybridNet can reconstruct high-quality SR images from degraded MR images and has good generalization ability. It also can be leveraged to assist the task of image analysis or processing.
引用
收藏
页码:3013 / 3022
页数:10
相关论文
共 32 条
  • [1] Alexander DC, 2014, LECT NOTES COMPUT SC, V8675, P225, DOI 10.1007/978-3-319-10443-0_29
  • [2] Learning a Deep Convolutional Network for Image Super-Resolution
    Dong, Chao
    Loy, Chen Change
    He, Kaiming
    Tang, Xiaoou
    [J]. COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 : 184 - 199
  • [3] Shared Address Translation Revisited
    Dong, Xiaowan
    Dwarkadas, Sandhya
    Cox, Alan L.
    [J]. PROCEEDINGS OF THE ELEVENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS, (EUROSYS 2016), 2016,
  • [4] Fast and robust multiframe super resolution
    Farsiu, S
    Robinson, MD
    Elad, M
    Milanfar, P
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (10) : 1327 - 1344
  • [5] Brain tumor segmentation with Deep Neural Networks
    Havaei, Mohammad
    Davy, Axel
    Warde-Farley, David
    Biard, Antoine
    Courville, Aaron
    Bengio, Yoshua
    Pal, Chris
    Jodoin, Pierre-Marc
    Larochelle, Hugo
    [J]. MEDICAL IMAGE ANALYSIS, 2017, 35 : 18 - 31
  • [6] Kim J, 2016, PROC CVPR IEEE, P1637, DOI [10.1109/CVPR.2016.182, 10.1109/CVPR.2016.181]
  • [7] Kingma J., 2014, Adam: A method for stochastic optimization
  • [8] ImageNet Classification with Deep Convolutional Neural Networks
    Krizhevsky, Alex
    Sutskever, Ilya
    Hinton, Geoffrey E.
    [J]. COMMUNICATIONS OF THE ACM, 2017, 60 (06) : 84 - 90
  • [9] Survey:: Interpolation methods in medical image processing
    Lehmann, TM
    Gönner, C
    Spitzer, K
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 1999, 18 (11) : 1049 - 1075
  • [10] Li DP, 2015, PROC CVPR IEEE, P213, DOI 10.1109/CVPR.2015.7298617