Brain MRI super-resolution using coupled-projection residual network

被引:37
作者
Feng, Chun-Mei [1 ]
Wang, Kai [2 ]
Lu, Shijian [3 ]
Xu, Yong [1 ]
Li, Xuelong [4 ]
机构
[1] Harbin Inst Technol, Shenzhen Key Lab Visual Object Detect & Recognit, Shenzhen 518055, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Shenzhen, Peoples R China
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[4] Northwestern Polytech Univ, Sch Art Intelligence Opt & Elect iOPEN, Xian 710071, Peoples R China
关键词
MRI; Super-resolution; Residual network; Coupled-projection; Deep learning; IMAGE SUPERRESOLUTION;
D O I
10.1016/j.neucom.2021.01.130
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic Resonance Imaging (MRI) has been widely used in clinical application and pathology research to help doctors provide better diagnoses. However, accurate diagnosis by MRI remains a great challenge, as images obtained via current MRI techniques usually have low resolutions. Improving MRI image quality and resolution has thus become a critically important task. This paper presents an innovative Coupled-Projection Residual Network (CPRN) for MRI super-resolution. CPRN consists of two complementary sub-networks: a shallow network and a deep one, which maintain content consistency while learning high frequency differences between low-resolution and high-resolution images. The shallow sub-network employs coupled-projection to better retain the MR image details, where a novel feedback mechanism is introduced to guide the reconstruction of high-resolution images. The deep sub-network learns from the residuals of the high-frequency image information, where multiple residual blocks are cascaded to magnify the MR images at the last network layer. Finally, the features from the shallow and deep sub-networks are fused for the reconstruction of high-resolution MR images. For effective feature fusion between the deep and shallow sub-networks, a step-wise connection (CPRN_S) is designed, inspired by the human cognitive process (from simple to complex). Experiments over three public MRI datasets show that our proposed CPRN achieves superior MRI super-resolution performance compared with the state-of-the-art. (c) 2021 Published by Elsevier B.V.
引用
收藏
页码:190 / 199
页数:10
相关论文
共 62 条
[1]   Phase-contrast MRI volume flow - a comparison of breath held and navigator based acquisitions [J].
Andersson, Charlotta ;
Kihlberg, Johan ;
Ebbers, Tino ;
Lindstrom, Lena ;
Carlhall, Carl-Johan ;
Engvall, Jan E. .
BMC MEDICAL IMAGING, 2016, 16
[2]   High Resolution OCT Image Generation Using Super Resolution via Sparse Representation [J].
Asif, Muhammad ;
Akram, Muhammad Usman ;
Hassan, Taimur ;
Shaukat, Arslan ;
Waqar, Razi .
EIGHTH INTERNATIONAL CONFERENCE ON GRAPHIC AND IMAGE PROCESSING (ICGIP 2016), 2017, 10225
[3]   Super Resolution of Cardiac Cine MRI Sequences Using Deep Learning [J].
Basty, Nicolas ;
Grau, Vicente .
IMAGE ANALYSIS FOR MOVING ORGAN, BREAST, AND THORACIC IMAGES, 2018, 11040 :23-31
[4]   The Perception-Distortion Tradeoff [J].
Blau, Yochai ;
Michaeli, Tomer .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6228-6237
[5]   Human Pose Estimation with Iterative Error Feedback [J].
Carreira, Joao ;
Agrawal, Pulkit ;
Fragkiadaki, Katerina ;
Malik, Jitendra .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :4733-4742
[6]  
Chen L, IEEE Transactions on Circuits and Systems
[7]   Efficient and Accurate MRI Super-Resolution Using a Generative Adversarial Network and 3D Multi-level Densely Connected Network [J].
Chen, Yuhua ;
Shi, Feng ;
Christodoulou, Anthony G. ;
Xie, Yibin ;
Zhou, Zhengwei ;
Li, Debiao .
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2018, PT I, 2018, 11070 :91-99
[8]  
Chen YH, 2018, I S BIOMED IMAGING, P739
[9]  
Choi J.-H, 2020, NEUROCOMPUTING
[10]   Compression Artifacts Reduction by a Deep Convolutional Network [J].
Dong, Chao ;
Deng, Yubin ;
Loy, Chen Change ;
Tang, Xiaoou .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :576-584