GAN-TL: Generative Adversarial Networks with Transfer Learning for MRI Reconstruction

被引:18
作者
Yaqub, Muhammad [1 ]
Feng Jinchao [1 ]
Ahmed, Shahzad [1 ]
Arshid, Kaleem [1 ]
Bilal, Muhammad Atif [2 ,3 ]
Akhter, Muhammad Pervez [2 ]
Zia, Muhammad Sultan [4 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
[2] Riphah Int Univ, Riphah Coll Comp, Faisalabad Campus, Islamabad 38000, Pakistan
[3] Jilin Univ, Coll Geoexplorat Sci & Technol, Changchun 130061, Peoples R China
[4] Univ Chenab, Dept Comp Sci, Gujranwala 50250, Pakistan
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 17期
基金
美国国家科学基金会;
关键词
image reconstruction; MRI; GANs; transfer learning; deep learning; CONVOLUTIONAL NEURAL-NETWORK;
D O I
10.3390/app12178841
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Generative adversarial networks (GAN), which are fueled by deep learning, are an efficient technique for image reconstruction using under-sampled MR data. In most cases, the performance of a particular model's reconstruction must be improved by using a substantial proportion of the training data. However, gathering tens of thousands of raw patient data for training the model in actual clinical applications is difficult because retaining k-space data is not customary in the clinical process. Therefore, it is imperative to increase the generalizability of a network that was created using a small number of samples as quickly as possible. This research explored two unique applications based on deep learning-based GAN and transfer learning. Seeing as MRI reconstruction procedures go for brain and knee imaging, the proposed method outperforms current techniques in terms of signal-to-noise ratio (PSNR) and structural similarity index (SSIM). As compared to the results of transfer learning for the brain and knee, using a smaller number of training cases produced superior results, with acceleration factor (AF) 2 (for brain PSNR (39.33); SSIM (0.97), for knee PSNR (35.48); SSIM (0.90)) and AF 4 (for brain PSNR (38.13); SSIM (0.95), for knee PSNR (33.95); SSIM (0.86)). The approach that has been described would make it easier to apply future models for MRI reconstruction without necessitating the acquisition of vast imaging datasets.
引用
收藏
页数:20
相关论文
共 54 条
[1]   Learned Primal-Dual Reconstruction [J].
Adler, Jonas ;
Oktem, Ozan .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1322-1332
[2]  
Afshar P, 2018, IEEE IMAGE PROC, P3129, DOI 10.1109/ICIP.2018.8451379
[3]   MoDL: Model-Based Deep Learning Architecture for Inverse Problems [J].
Aggarwal, Hemant K. ;
Mani, Merry P. ;
Jacob, Mathews .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :394-405
[4]  
Arvinte M., 2021, P INT C MEDICAL IMAG
[5]   Fast Reconstruction of Accelerated Dynamic MRI Using Manifold Kernel Regression [J].
Bhatia, Kanwal K. ;
Caballero, Jose ;
Price, Anthony N. ;
Sun, Ying ;
Hajnal, Jo V. ;
Rueckert, Daniel .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :510-518
[6]   Combination of signals from array coils using image-based estimation of coil sensitivity profiles [J].
Bydder, M ;
Larkman, DJ ;
Hajnal, JV .
MAGNETIC RESONANCE IN MEDICINE, 2002, 47 (03) :539-548
[7]  
Candes, 2006, P INT C MATH MADR SP
[8]   AI-Based Reconstruction for Fast MRI-A Systematic Review and Meta-Analysis [J].
Chen, Yutong ;
Schonlieb, Carola-Bibiane ;
Lio, Pietro ;
Leiner, Tim ;
Dragotti, Pier Luigi ;
Wang, Ge ;
Rueckert, Daniel ;
Firmin, David ;
Yang, Guang .
PROCEEDINGS OF THE IEEE, 2022, 110 (02) :224-245
[9]   Wavelet Improved GAN for MRI reconstruction [J].
Chen, Yutong ;
Firmin, David ;
Yang, Guang .
MEDICAL IMAGING 2021: PHYSICS OF MEDICAL IMAGING, 2021, 11595
[10]   Adaptive convolutional neural networks for accelerating magnetic resonance imaging via k -space data interpolation [J].
Du, Tianming ;
Zhang, Honggang ;
Li, Yuemeng ;
Pickup, Stephen ;
Rosen, Mark ;
Zhou, Rong ;
Song, Hee Kwon ;
Fan, Yong .
MEDICAL IMAGE ANALYSIS, 2021, 72