Single MR image super-resolution via channel splitting and serial fusion network

被引:14
作者
Zhao, Xiaole [1 ]
Zhang, Yulun [2 ]
Qin, Yun [3 ]
Wang, Qian [4 ]
Zhang, Tao [3 ]
Li, Tianrui [1 ]
机构
[1] Southwest Jiaotong Univ, Sch Comp & Artificial Intelligence, Chengdu 611756, Sichuan, Peoples R China
[2] Northeastern Univ, Dept Elect & Comp Engn, Boston, MA 02115 USA
[3] Univ Elect Sci & Technol China, Sch Life Sci & Technol, Chengdu 611731, Sichuan, Peoples R China
[4] Tangshan Seism Stn Hebei Earthquake Agcy, Tangshan 066300, Hebei, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolutional neural network; Magnetic resonance imaging; Channel splitting; Super-resolution; Serial fusion;
D O I
10.1016/j.knosys.2022.108669
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In magnetic resonance imaging (MRI), spatial resolution is an important and critical imaging parameter that represents how much information is contained in a unit space. Acquiring high-resolution MRI data usually takes a long scanning time and is subject to motion artifacts due to hardware, physical, and physiological limitations. Single image super-resolution (SISR) based on deep learning is an effective and promising alternative technique to improve the native spatial resolution of magnetic resonance (MR) images. However, because of the simple diversity and single distribution of training samples, the effective training of deep models with medical training samples and improvement of the tradeoff between model performance and computing overhead are major challenges. In addition, deeper networks are more difficult to effectively train since the information is gradually weakened as the network deepens. In this paper, a novel channel splitting and serial fusion network (CSSFN) is presented for single MR image super-resolution. The proposed CSSFN splits hierarchical features into a series of subfeatures, which are then integrated together in a serial manner. Hence, the network becomes deeper and can discriminatively and reasonably deal with the subfeatures. Moreover, a dense global feature fusion (DGFF) is adopted to integrate the intermediate features, which further promotes the information flow in the network and helps to stabilize model training. Extensive experiments on several typical MR images show the superiority of our CSSFN models to other advanced SISR methods. (C) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 49 条
[31]   MR Image Super-Resolution via Wide Residual Networks With Fixed Skip Connection [J].
Shi, Jun ;
Li, Zheng ;
Ying, Shihui ;
Wang, Chaofeng ;
Liu, Qingping ;
Zhang, Qi ;
Yan, Pingkun .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2019, 23 (03) :1129-1140
[32]   Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network [J].
Shi, Wenzhe ;
Caballero, Jose ;
Huszar, Ferenc ;
Totz, Johannes ;
Aitken, Andrew P. ;
Bishop, Rob ;
Rueckert, Daniel ;
Wang, Zehan .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1874-1883
[33]   A Super-Resolution Framework for 3-D High-Resolution and High-Contrast Imaging Using 2-D Multislice MRI [J].
Shilling, Richard Z. ;
Robbie, Trevor Q. ;
Bailloeul, Timothee ;
Mewes, Klaus ;
Mersereau, Russell M. ;
Brummer, Marijn E. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2009, 28 (05) :633-644
[34]  
Simonyan K., 2014, ICLR
[35]  
Sun, 2017, ARXIV PREPRINT ARXIV
[36]  
Sun J., 2008, INT C COMP VIS PATT, P1
[37]  
Szegedy C, 2015, PROC CVPR IEEE, P1, DOI 10.1109/CVPR.2015.7298594
[38]   MemNet: A Persistent Memory Network for Image Restoration [J].
Tai, Ying ;
Yang, Jian ;
Liu, Xiaoming ;
Xu, Chunyan .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4549-4557
[39]   TDAN: Temporally-Deformable Alignment Network for Video Super-Resolution [J].
Tian, Yapeng ;
Zhang, Yulun ;
Fu, Yun ;
Xu, Chenliang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3357-3366
[40]  
Wang H., 2021, IEEE T CIRC SYST VID