Image Synthesis in Multi-Contrast MRI With Conditional Generative Adversarial Networks

被引:347
作者
Dar, Salman U. H. [1 ,2 ]
Yurt, Mahmut [1 ,2 ]
Karacan, Levent [3 ]
Erdem, Aykut [3 ]
Erdem, Erkut [3 ]
Cukur, Tolga [1 ,2 ,4 ]
机构
[1] Bilkent Univ, Dept Elect & Elect Engn, TR-06800 Ankara, Turkey
[2] Bilkent Univ, Natl Magnet Resonance Res Ctr, TR-06800 Ankara, Turkey
[3] Hacettepe Univ, Dept Comp Engn, TR-06800 Ankara, Turkey
[4] Bilkent Univ, Sabuncu Brain Res Ctr, Neurosci Program, TR-06800 Ankara, Turkey
关键词
Magnetic resonance imaging; Image generation; Generative adversarial networks; Gallium nitride; Feature extraction; Task analysis; Generators; Generative adversarial network; image synthesis; multi-contrast MRI; pixel-wise loss; cycleconsistency loss; REGISTRATION; OPTIMIZATION; SCANNERS; ROBUST;
D O I
10.1109/TMI.2019.2901750
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Acquiring images of the same anatomy with multiple different contrasts increases the diversity of diagnostic information available in an MR exam. Yet, the scan time limitations may prohibit the acquisition of certain contrasts, and some contrasts may be corrupted by noise and artifacts. In such cases, the ability to synthesize unacquired or corrupted contrasts can improve diagnostic utility. For multi-contrast synthesis, the current methods learn a nonlinear intensity transformation between the source and target images, either via nonlinear regression or deterministic neural networks. These methods can, in turn, suffer from the loss of structural details in synthesized images. Here, in this paper, we propose a new approach for multi-contrast MRI synthesis based on conditional generative adversarial networks. The proposed approach preserves intermediate-to-high frequency details via an adversarial loss, and it offers enhanced synthesis performance via pixel-wise and perceptual losses for registered multi-contrast images and a cycle-consistency loss for unregistered images. Information from neighboring cross-sections are utilized to further improve synthesis quality. Demonstrations on T-1 - and T-2 - weighted images from healthy subjects and patients clearly indicate the superior performance of the proposed approach compared to the previous state-of-the-art methods. Our synthesis approach can help improve the quality and versatility of the multi-contrast MRI exams without the need for prolonged or repeated examinations.
引用
收藏
页码:2375 / 2388
页数:14
相关论文
共 80 条
  • [1] [Anonymous], 2017, P SPIE INT SOC OPT E
  • [2] [Anonymous], 2016, INSTANCE NORMALIZATI
  • [3] [Anonymous], 2017, 31 C NEUR INF PROC S
  • [4] [Anonymous], 2018, An introduction to image synthesis with generative adversarial nets
  • [5] [Anonymous], 2010, Principles of Magnetic Resonance Imaging
  • [6] [Anonymous], 2015, INT C LEARNING REPRE
  • [7] [Anonymous], 2017, MED NIPS
  • [8] [Anonymous], 2017, SYNTHETIC MED IMAGES
  • [9] [Anonymous], THEAN PYTH FRAM FAST
  • [10] [Anonymous], 2015, PROC CVPR IEEE