Deep Generative Adversarial Neural Networks for Compressive Sensing MRI

被引:412
作者
Mardani, Morteza [1 ,2 ]
Gong, Enhao [1 ,2 ]
Cheng, Joseph Y. [1 ,2 ]
Vasanawala, Shreyas S. [3 ]
Zaharchuk, Greg [3 ]
Xing, Lei [1 ,4 ]
Pauly, John M. [1 ]
机构
[1] Stanford Univ, Elect Engn Dept, Stanford, CA 94305 USA
[2] Stanford Univ, Radiol Dept, Stanford, CA 94305 USA
[3] Stanford Univ, Radiol Dept, Stanford, CA 94304 USA
[4] Stanford Univ, Med Phys Dept, Stanford, CA 94305 USA
关键词
Deep learning; generative adversarial networks (GAN); convolutional neural networks (CNN); rapid reconstruction; diagnostic quality; compressed sensing (CS);
D O I
10.1109/TMI.2018.2858752
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Undersampled magnetic resonance image (MRI) reconstruction is typically an ill-posed linear inverse task. The time and resource intensive computations require tradeoffs between accuracy and speed. In addition, state-of-the-art compressed sensing (CS) analytics are not cognizant of the image diagnostic quality. To address these challenges, we propose a novel CS framework that uses generative adversarial networks (GAN) to model the (low-dimensional) manifold of high-quality MR images. Leveraging a mixture of least-squares (LS) GANs and pixel-wise l(1)/l(2) cost, a deep residual network with skip connections is trained as the generator that learns to remove the aliasing artifacts by projecting onto the image manifold. The LSGAN learns the texture details, while the l(1)/l(2) cost suppresses high-frequency noise. A discriminator network, which is a multilayer convolutional neural network (CNN), plays the role of a perceptual cost that is then jointly trained based on high-quality MR images to score the quality of retrieved images. In the operational phase, an initial aliased estimate (e.g., simply obtained by zero-filling) is propagated into the trained generator to output the desired reconstruction. This demands a very low computational overhead. Extensive evaluations are performed on a large contrast-enhanced MR dataset of pediatric patients. Images rated by expert radiologists corroborate that GANCS retrieves higher quality images with improved fine texture details compared with conventional Wavelet-based and dictionary-learning-based CS schemes as well as with deep-learning-based schemes usingpixel-wise training. In addition, it offers reconstruction times of under a few milliseconds, which are two orders of magnitude faster than the current state-of-the-art CS-MRI schemes.
引用
收藏
页码:167 / 179
页数:13
相关论文
共 36 条
[1]   K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation [J].
Aharon, Michal ;
Elad, Michael ;
Bruckstein, Alfred .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2006, 54 (11) :4311-4322
[2]  
[Anonymous], P 25 ANN M ISMRM HON
[3]  
[Anonymous], 2017, LEARNING VARIATIONAL
[4]  
[Anonymous], 2017, LEARNED PRIMAL DUAL
[5]  
[Anonymous], 2017, Compressed sensing using generative models
[6]  
[Anonymous], 2016, LEAST SQUARES GENERA
[7]  
[Anonymous], P 25 ANN M ISMRM HON
[8]  
[Anonymous], 2017, ARXIV170107875
[9]  
[Anonymous], P 25 ANN M ISMRM HON
[10]  
[Anonymous], 2017, P 25 ANN M ISMRM HON