Deep compressed sensing MRI via a gradient-enhanced fusion model

被引:2
作者
Dai, Yuxiang [1 ]
Wang, Chengyan [2 ]
Wang, He [1 ,2 ,3 ]
机构
[1] Fudan Univ, Inst Sci & Technol Brain Inspired Intelligence, Shanghai, Peoples R China
[2] Fudan Univ, Human Phenome Inst, Shanghai, Peoples R China
[3] Fudan Univ, Zhangjiang Brain Imaging Ctr, Zhangheng Rd 825, Shanghai 201210, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
compressed sensing MRI; deep learning; gradient fusion network; RECONSTRUCTION;
D O I
10.1002/mp.16164
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
BackgroundCompressed sensing has been employed to accelerate magnetic resonance imaging by sampling fewer measurements. However, conventional iterative optimization-based CS-MRI are time-consuming for iterative calculations and often share poor generalization ability on multicontrast datasets. Most deep-learning-based CS-MRI focus on learning an end-to-end mapping while ignoring some prior knowledge existed in MR images. PurposeWe propose an iterative fusion model to integrate the image and gradient-based priors into reconstruction via convolutional neural network models while maintaining high quality and preserving the detailed information as well. MethodsWe propose a gradient-enhanced fusion network (GFN) for fast and accurate MRI reconstruction, in which dense blocks with dilated convolution and dense residual learnings are used to capture abundant features with fewer parameters. Meanwhile, decomposed gradient maps containing obvious structural information are introduced into the network to enhance the reconstructed images. Besides this, gradient-based priors along directions X and Y are exploited to learn adaptive tight frames for reconstructing the desired image contrast and edges by respective gradient fusion networks. After that, both image and gradient priors are fused in the proposed optimization model, in which we employ the l(2)-norm to promote the sparsity of gradient priors. The proposed fusion model can effectively help to capture edge structures in the gradient images and to preserve more detailed information of MR images. ResultsExperimental results demonstrate that the proposed method outperforms several CS-MRI methods in terms of peak signal-to-noise (PSNR), the structural similarity index (SSIM), and visualizations on three sampling masks with different rates. Noteworthy, to evaluate the generalization ability, the proposed model conducts cross-center training and testing experiments for all three modalities and shares more stable performance compared than other approaches. In addition, the proposed fusion model is applied to other comparable deep learning methods. The quantitative results show that the reconstruction results of these methods are obviously improved. ConclusionsThe gradient-based priors reconstructed from GFNs can effectively enhance the edges and details of under-sampled data. The proposed fusion model integrates image and gradient priors using l(2)-norm can effectively improve the generalization ability on multicontrast datasets reconstruction.
引用
收藏
页码:1390 / 1405
页数:16
相关论文
共 38 条
[1]   MoDL: Model-Based Deep Learning Architecture for Inverse Problems [J].
Aggarwal, Hemant K. ;
Mani, Merry P. ;
Jacob, Mathews .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :394-405
[2]   Efficient directionality-driven dictionary learning for compressive sensing magnetic resonance imaging reconstruction [J].
Arun, Anupama ;
Thomas, Thomas James ;
Rani, J. Sheeba ;
Gorthi, R. K. Sai Subrahmanyam .
JOURNAL OF MEDICAL IMAGING, 2020, 7 (01)
[3]   MR IMAGING - CLINICAL USE OF THE INVERSION RECOVERY SEQUENCE [J].
BYDDER, GM ;
YOUNG, IR .
JOURNAL OF COMPUTER ASSISTED TOMOGRAPHY, 1985, 9 (04) :659-675
[4]   A NOTE ON THE GRADIENT OF A MULTIIMAGE [J].
DIZENZO, S .
COMPUTER VISION GRAPHICS AND IMAGE PROCESSING, 1986, 33 (01) :116-125
[5]   Compressed sensing [J].
Donoho, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (04) :1289-1306
[6]   KIKI-net: cross-domain convolutional neural networks for reconstructing undersampled magnetic resonance images [J].
Eo, Taejoon ;
Jun, Yohan ;
Kim, Taeseong ;
Jang, Jinseong ;
Lee, Ho-Joon ;
Hwang, Dosik .
MAGNETIC RESONANCE IN MEDICINE, 2018, 80 (05) :2188-2201
[7]   Compressed-Sensing MRI Based on Adaptive Tight Frame in Gradient Domain [J].
Fan, Xiaoyu ;
Lian, Qiusheng ;
Shi, Baoshun .
APPLIED MAGNETIC RESONANCE, 2018, 49 (05) :465-477
[8]   A Segmentation-Aware Deep Fusion Network for Compressed Sensing MRI [J].
Fan, Zhiwen ;
Sun, Liyan ;
Ding, Xinghao ;
Huang, Yue ;
Cai, Congbo ;
Paisley, John .
COMPUTER VISION - ECCV 2018, PT VI, 2018, 11210 :55-70
[9]  
Glorot X., 2011, P 14 INT C ART INT S, P315, DOI DOI 10.1002/ECS2.1832
[10]   Compressed-Sensing MRI With Random Encoding [J].
Haldar, Justin P. ;
Hernando, Diego ;
Liang, Zhi-Pei .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2011, 30 (04) :893-903