Prior-Guided Image Reconstruction for Accelerated Multi-Contrast MRI via Generative Adversarial Networks

被引:106
作者
Dar, Salman U. H. [1 ,2 ]
Yurt, Mahmut [1 ,2 ]
Shahdloo, Mohammad [2 ,3 ]
Ildiz, Muhammed Emrullah [1 ,2 ]
Tinaz, Berk [1 ,2 ]
Cukur, Tolga [1 ,2 ,4 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkey
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr UMRAM, TR-06800 Ankara, Turkey
[3] Univ Oxford, Dept Expt Psychol, Wellcome Ctr Integrat Neuroimaging, Oxford OX3 9DU, England
[4] Bilkent Univ, Neurosci Program, TR-06800 Ankara, Turkey
关键词
Image reconstruction; Magnetic resonance imaging; Acceleration; Transforms; Generative adversarial networks; Neural networks; Reliability; Generative adversarial network (GAN); synthesis; reconstruction; multi contrast; magnetic resonance imaging (MRI); prior; OPTIMIZATION; REGISTRATION; ROBUST; SENSE;
D O I
10.1109/JSTSP.2020.3001737
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Multi-contrast MRI acquisitions of an anatomy enrich the magnitude of information available for diagnosis. Yet, excessive scan times associated with additional contrasts may be a limiting factor. Two mainstream frameworks for enhanced scan efficiency are reconstruction of undersampled acquisitions and synthesis of missing acquisitions. Recently, deep learning methods have enabled significant performance improvements in both frameworks. Yet, reconstruction performance decreases towards higher acceleration factors with diminished sampling density at high-spatial-frequencies, whereas synthesis can manifest artefactual sensitivity or insensitivity to image features due to the absence of data samples from the target contrast. In this article, we propose a new approach for synergistic recovery of undersampled multi-contrast acquisitions based on conditional generative adversarial networks. The proposed method mitigates the limitations of pure learning-based reconstruction or synthesis by utilizing three priors: shared high-frequency prior available in the source contrast to preserve high-spatial-frequency details, low-frequency prior available in the undersampled target contrast to prevent feature leakage/loss, and perceptual prior to improve recovery of high-level features. Demonstrations on brain MRI datasets from healthy subjects and patients indicate the superior performance of the proposed method compared to pure reconstruction and synthesis methods. The proposed method can help improve the quality and scan efficiency of multi-contrast MRI exams.
引用
收藏
页码:1072 / 1087
页数:16
相关论文
共 75 条
[1]   Scan-specific robust artificial-neural-networks for k-space interpolation (RAKI) reconstruction: Database-free deep learning for fast imaging [J].
Akcakaya, Mehmet ;
Moeller, Steen ;
Weingaertner, Sebastian ;
Ugurbil, Kamil .
MAGNETIC RESONANCE IN MEDICINE, 2019, 81 (01) :439-453
[2]  
[Anonymous], 2018, ARXIV180106940
[3]  
[Anonymous], 2019, IEEE INT WORKS MACH
[4]  
[Anonymous], 2018, PROC MIDL
[5]   Multi-contrast Reconstruction With Bayesian Compressed Sensing [J].
Bilgic, Berkin ;
Goyal, Vivek K. ;
Adalsteinsson, Elfar .
MAGNETIC RESONANCE IN MEDICINE, 2011, 66 (06) :1601-1615
[6]   Vessel tortuosity and brain tumor malignancy: A blinded study [J].
Bullitt, E ;
Zeng, DL ;
Gerig, G ;
Aylward, S ;
Joshi, S ;
Smith, JK ;
Lin, WL ;
Ewend, MG .
ACADEMIC RADIOLOGY, 2005, 12 (10) :1232-1240
[7]   Multimodal MR Synthesis via Modality-Invariant Latent Representation [J].
Chartsias, Agisilaos ;
Joyce, Thomas ;
Giuffrida, Mario Valerio ;
Tsaftaris, Sotirios A. .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (03) :803-814
[8]  
Cheng J. Y, 2018, ARXIV180503300
[9]   Extended Modality Propagation: Image Synthesis of Pathological Cases [J].
Cordier, Nicolas ;
Delingette, Herve ;
Le, Matthieu ;
Ayache, Nicholas .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2016, 35 (12) :2598-2608
[10]   Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks [J].
Dar, Salman U. H. ;
Yurt, Mahmut ;
Karacan, Levent ;
Erdem, Aykut ;
Erdem, Erkut ;
Cukur, Tolga .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (10) :2375-2388