FA-GAN: Fused attentive generative adversarial networks for MRI image super-resolution

被引:73
作者
Jiang, Mingfeng [1 ]
Zhi, Minghao [1 ]
Wei, Liying [1 ]
Yang, Xiaocheng [1 ]
Zhang, Jucheng [2 ]
Li, Yongming [3 ]
Wang, Pin [3 ]
Huang, Jiahao [4 ,5 ]
Yang, Guang [4 ,5 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
[2] Zhejiang Univ, Dept Clin Engn, Sch Med, Affiliated Hosp 2, Hangzhou 310019, Peoples R China
[3] Chongqing Univ, Coll Commun Engn, Chongqing, Peoples R China
[4] Royal Brompton Hosp, Cardiovasc Res Ctr, London SW3 6NP, England
[5] Imperial Coll London, Natl Heart & Lung Inst, London SW7 2AZ, England
基金
欧盟地平线“2020”; 英国科研创新办公室; 中国国家自然科学基金; 欧洲研究理事会;
关键词
Super-resolution; Generative adversarial networks; Attention; Mechanism; MRI; RECONSTRUCTION;
D O I
10.1016/j.compmedimag.2021.101969
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
High-resolution magnetic resonance images can provide fine-grained anatomical information, but acquiring such data requires a long scanning time. In this paper, a framework called the Fused Attentive Generative Adversarial Networks(FA-GAN) is proposed to generate the super-resolution MR image from low-resolution magnetic resonance images, which can reduce the scanning time effectively but with high resolution MR images. In the framework of the FA-GAN, the local fusion feature block, consisting of different three-pass networks by using different convolution kernels, is proposed to extract image features at different scales. And the global feature fusion module, including the channel attention module, the self-attention module, and the fusion operation, is designed to enhance the important features of the MR image. Moreover, the spectral normalization process is introduced to make the discriminator network stable. 40 sets of 3D magnetic resonance images (each set of images contains 256 slices) are used to train the network, and 10 sets of images are used to test the proposed method. The experimental results show that the PSNR and SSIM values of the super-resolution magnetic resonance image generated by the proposed FA-GAN method are higher than the state-of-the-art reconstruction methods.
引用
收藏
页数:11
相关论文
共 40 条
[1]  
Armanious K, 2019, I S BIOMED IMAGING, P1550, DOI [10.1109/isbi.2019.8759509, 10.1109/ISBI.2019.8759509]
[2]   Attention Augmented Convolutional Networks [J].
Bello, Irwan ;
Zoph, Barret ;
Vaswani, Ashish ;
Shlens, Jonathon ;
Le, Quoc V. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3285-3294
[3]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[4]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[5]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[6]   Robust Super-Resolution Volume Reconstruction From Slice Acquisitions: Application to Fetal Brain MRI [J].
Gholipour, Ali ;
Estroff, Judy A. ;
Warfield, Simon K. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2010, 29 (10) :1739-1758
[7]  
Goodfellow I., 2020, ADV NEUR IN, V63, P139, DOI [DOI 10.1145/3422622, 10.1145/3422622]
[8]   DeepPET: A deep encoder-decoder network for directly solving the PET image reconstruction inverse problem [J].
Haggstrom, Ida ;
Schmidtlein, C. Ross ;
Campanella, Gabriele ;
Fuchs, Thomas J. .
MEDICAL IMAGE ANALYSIS, 2019, 54 :253-262
[9]   Single MR Image Super-Resolution via Mixed Self-Similarity Attention Network [J].
Hu, Xiaowan ;
Wang, Haoqian ;
Luo, Yi ;
Sun, Zhongzhi ;
Peng, Yanbin .
MEDICAL IMAGING 2021: IMAGE PROCESSING, 2021, 11596 :CP9-U21
[10]   DPIR-Net: Direct PET Image Reconstruction Based on the Wasserstein Generative Adversarial Network [J].
Hu, Zhanli ;
Xue, Hengzhi ;
Zhang, Qiyang ;
Gao, Juan ;
Zhang, Na ;
Zou, Sijuan ;
Teng, Yueyang ;
Liu, Xin ;
Yang, Yongfeng ;
Liang, Dong ;
Zhu, Xiaohua ;
Zheng, Hairong .
IEEE TRANSACTIONS ON RADIATION AND PLASMA MEDICAL SCIENCES, 2021, 5 (01) :35-43