Prior-Guided Image Reconstruction for Accelerated Multi-Contrast MRI via Generative Adversarial Networks

被引:106
作者
Dar, Salman U. H. [1 ,2 ]
Yurt, Mahmut [1 ,2 ]
Shahdloo, Mohammad [2 ,3 ]
Ildiz, Muhammed Emrullah [1 ,2 ]
Tinaz, Berk [1 ,2 ]
Cukur, Tolga [1 ,2 ,4 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkey
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr UMRAM, TR-06800 Ankara, Turkey
[3] Univ Oxford, Dept Expt Psychol, Wellcome Ctr Integrat Neuroimaging, Oxford OX3 9DU, England
[4] Bilkent Univ, Neurosci Program, TR-06800 Ankara, Turkey
关键词
Image reconstruction; Magnetic resonance imaging; Acceleration; Transforms; Generative adversarial networks; Neural networks; Reliability; Generative adversarial network (GAN); synthesis; reconstruction; multi contrast; magnetic resonance imaging (MRI); prior; OPTIMIZATION; REGISTRATION; ROBUST; SENSE;
D O I
10.1109/JSTSP.2020.3001737
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multi-contrast MRI acquisitions of an anatomy enrich the magnitude of information available for diagnosis. Yet, excessive scan times associated with additional contrasts may be a limiting factor. Two mainstream frameworks for enhanced scan efficiency are reconstruction of undersampled acquisitions and synthesis of missing acquisitions. Recently, deep learning methods have enabled significant performance improvements in both frameworks. Yet, reconstruction performance decreases towards higher acceleration factors with diminished sampling density at high-spatial-frequencies, whereas synthesis can manifest artefactual sensitivity or insensitivity to image features due to the absence of data samples from the target contrast. In this article, we propose a new approach for synergistic recovery of undersampled multi-contrast acquisitions based on conditional generative adversarial networks. The proposed method mitigates the limitations of pure learning-based reconstruction or synthesis by utilizing three priors: shared high-frequency prior available in the source contrast to preserve high-spatial-frequency details, low-frequency prior available in the undersampled target contrast to prevent feature leakage/loss, and perceptual prior to improve recovery of high-level features. Demonstrations on brain MRI datasets from healthy subjects and patients indicate the superior performance of the proposed method compared to pure reconstruction and synthesis methods. The proposed method can help improve the quality and scan efficiency of multi-contrast MRI exams.
引用
收藏
页码:1072 / 1087
页数:16
相关论文
共 75 条
[61]   ESPIRiT-An Eigenvalue Approach to Autocalibrating Parallel MRI: Where SENSE Meets GRAPPA [J].
Uecker, Martin ;
Lai, Peng ;
Murphy, Mark J. ;
Virtue, Patrick ;
Elad, Michael ;
Pauly, John M. ;
Vasanawala, Shreyas S. ;
Lustig, Michael .
MAGNETIC RESONANCE IN MEDICINE, 2014, 71 (03) :990-1001
[62]  
Ulyanov Dmitry, 2016, ARXIV
[63]   Unsupervised Cross-modal Synthesis of Subject-specific Scans [J].
Vemulapalli, Raviteja ;
Nguyen, Hien Van ;
Zhou, Shaohua Kevin .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :630-638
[64]   ACCELERATING MAGNETIC RESONANCE IMAGING VIA DEEP LEARNING [J].
Wang, Shanshan ;
Su, Zhenghang ;
Ying, Leslie ;
Peng, Xi ;
Zhu, Shun ;
Liang, Feng ;
Feng, Dagan ;
Liang, Dong .
2016 IEEE 13TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI), 2016, :514-517
[65]  
Welander P., 2018, ARXIV180607777
[66]   DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction [J].
Yang, Guang ;
Yu, Simiao ;
Dong, Hao ;
Slabaugh, Greg ;
Dragotti, Pier Luigi ;
Ye, Xujiong ;
Liu, Fangde ;
Arridge, Simon ;
Keegan, Jennifer ;
Guo, Yike ;
Firmin, David .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (06) :1310-1321
[67]  
Yang Y, 2016, ADV NEUR IN, V29
[68]  
Ye DH, 2013, LECT NOTES COMPUT SC, V8149, P606, DOI 10.1007/978-3-642-40811-3_76
[69]  
Yi BS, 2019, C ELECT INSUL DIEL P, P797, DOI 10.1109/CEIDP47102.2019.9009686
[70]   Ea-GANs: Edge-Aware Generative Adversarial Networks for Cross-Modality MR Image Synthesis [J].
Yu, Biting ;
Zhou, Luping ;
Wang, Lei ;
Shi, Yinghuan ;
Fripp, Jurgen ;
Bourgeat, Pierrick .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (07) :1750-1762