GAN-TL: Generative Adversarial Networks with Transfer Learning for MRI Reconstruction

被引:18
作者
Yaqub, Muhammad [1 ]
Feng Jinchao [1 ]
Ahmed, Shahzad [1 ]
Arshid, Kaleem [1 ]
Bilal, Muhammad Atif [2 ,3 ]
Akhter, Muhammad Pervez [2 ]
Zia, Muhammad Sultan [4 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing Key Lab Computat Intelligence & Intellige, Beijing 100124, Peoples R China
[2] Riphah Int Univ, Riphah Coll Comp, Faisalabad Campus, Islamabad 38000, Pakistan
[3] Jilin Univ, Coll Geoexplorat Sci & Technol, Changchun 130061, Peoples R China
[4] Univ Chenab, Dept Comp Sci, Gujranwala 50250, Pakistan
来源
APPLIED SCIENCES-BASEL | 2022年 / 12卷 / 17期
基金
美国国家科学基金会;
关键词
image reconstruction; MRI; GANs; transfer learning; deep learning; CONVOLUTIONAL NEURAL-NETWORK;
D O I
10.3390/app12178841
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Generative adversarial networks (GAN), which are fueled by deep learning, are an efficient technique for image reconstruction using under-sampled MR data. In most cases, the performance of a particular model's reconstruction must be improved by using a substantial proportion of the training data. However, gathering tens of thousands of raw patient data for training the model in actual clinical applications is difficult because retaining k-space data is not customary in the clinical process. Therefore, it is imperative to increase the generalizability of a network that was created using a small number of samples as quickly as possible. This research explored two unique applications based on deep learning-based GAN and transfer learning. Seeing as MRI reconstruction procedures go for brain and knee imaging, the proposed method outperforms current techniques in terms of signal-to-noise ratio (PSNR) and structural similarity index (SSIM). As compared to the results of transfer learning for the brain and knee, using a smaller number of training cases produced superior results, with acceleration factor (AF) 2 (for brain PSNR (39.33); SSIM (0.97), for knee PSNR (35.48); SSIM (0.90)) and AF 4 (for brain PSNR (38.13); SSIM (0.95), for knee PSNR (33.95); SSIM (0.86)). The approach that has been described would make it easier to apply future models for MRI reconstruction without necessitating the acquisition of vast imaging datasets.
引用
收藏
页数:20
相关论文
共 54 条
[41]   Speech MRI: Morphology and function [J].
Scott, Andrew D. ;
Wylezinska, Marzena ;
Birch, Malcolm J. ;
Miquel, Marc E. .
PHYSICA MEDICA-EUROPEAN JOURNAL OF MEDICAL PHYSICS, 2014, 30 (06) :604-618
[42]   Satellite and Scene Image Classification Based on Transfer Learning and Fine Tuning of ResNet50 [J].
Shabbir, Amsa ;
Ali, Nouman ;
Ahmed, Jameel ;
Zafar, Bushra ;
Rasheed, Aqsa ;
Sajid, Muhammad ;
Ahmed, Afzal ;
Dar, Saadat Hanif .
MATHEMATICAL PROBLEMS IN ENGINEERING, 2021, 2021
[43]  
Shan S., 2022, ARXIV
[44]   Accelerated Magnetic Resonance Imaging by Adversarial Neural Network [J].
Shitrit, Ohad ;
Raviv, Tammy Riklin .
DEEP LEARNING IN MEDICAL IMAGE ANALYSIS AND MULTIMODAL LEARNING FOR CLINICAL DECISION SUPPORT, 2017, 10553 :30-38
[45]   Coupled Dictionary Learning for Multi-Contrast MRI Reconstruction [J].
Song, Pingfan ;
Weizman, Lior ;
Mota, Joao F. C. ;
Eldar, Yonina C. ;
Rodrigues, Miguel R. D. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (03) :621-633
[46]   Dual-domain cascade of U-nets for multi-channel magnetic resonance image reconstruction [J].
Souza, Roberto ;
Bento, Mariana ;
Nogovitsyn, Nikita ;
Chung, Kevin J. ;
Loos, Wallace ;
Lebel, R. Marc ;
Frayne, Richard .
MAGNETIC RESONANCE IMAGING, 2020, 71 :140-153
[47]  
Waddington David EJ, 2022, ARXIV
[48]   Structured Overcomplete Sparsifying Transform Learning with Convergence Guarantees and Applications [J].
Wen, Bihan ;
Ravishankar, Saiprasad ;
Bresler, Yoram .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 114 (2-3) :137-167
[49]   Self-attention convolutional neural network for improved MR image reconstruction [J].
Wu, Yan ;
Ma, Yajun ;
Liu, Jing ;
Du, Jiang ;
Xing, Lei .
INFORMATION SCIENCES, 2019, 490 :317-328
[50]  
Yang C., 2022, ARXIV