Deep compressed sensing MRI via a gradient-enhanced fusion model

被引:2
作者
Dai, Yuxiang [1 ]
Wang, Chengyan [2 ]
Wang, He [1 ,2 ,3 ]
机构
[1] Fudan Univ, Inst Sci & Technol Brain Inspired Intelligence, Shanghai, Peoples R China
[2] Fudan Univ, Human Phenome Inst, Shanghai, Peoples R China
[3] Fudan Univ, Zhangjiang Brain Imaging Ctr, Zhangheng Rd 825, Shanghai 201210, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
compressed sensing MRI; deep learning; gradient fusion network; RECONSTRUCTION;
D O I
10.1002/mp.16164
中图分类号
R8 [特种医学]; R445 [影像诊断学];
学科分类号
1002 ; 100207 ; 1009 ;
摘要
BackgroundCompressed sensing has been employed to accelerate magnetic resonance imaging by sampling fewer measurements. However, conventional iterative optimization-based CS-MRI are time-consuming for iterative calculations and often share poor generalization ability on multicontrast datasets. Most deep-learning-based CS-MRI focus on learning an end-to-end mapping while ignoring some prior knowledge existed in MR images. PurposeWe propose an iterative fusion model to integrate the image and gradient-based priors into reconstruction via convolutional neural network models while maintaining high quality and preserving the detailed information as well. MethodsWe propose a gradient-enhanced fusion network (GFN) for fast and accurate MRI reconstruction, in which dense blocks with dilated convolution and dense residual learnings are used to capture abundant features with fewer parameters. Meanwhile, decomposed gradient maps containing obvious structural information are introduced into the network to enhance the reconstructed images. Besides this, gradient-based priors along directions X and Y are exploited to learn adaptive tight frames for reconstructing the desired image contrast and edges by respective gradient fusion networks. After that, both image and gradient priors are fused in the proposed optimization model, in which we employ the l(2)-norm to promote the sparsity of gradient priors. The proposed fusion model can effectively help to capture edge structures in the gradient images and to preserve more detailed information of MR images. ResultsExperimental results demonstrate that the proposed method outperforms several CS-MRI methods in terms of peak signal-to-noise (PSNR), the structural similarity index (SSIM), and visualizations on three sampling masks with different rates. Noteworthy, to evaluate the generalization ability, the proposed model conducts cross-center training and testing experiments for all three modalities and shares more stable performance compared than other approaches. In addition, the proposed fusion model is applied to other comparable deep learning methods. The quantitative results show that the reconstruction results of these methods are obviously improved. ConclusionsThe gradient-based priors reconstructed from GFNs can effectively enhance the edges and details of under-sampled data. The proposed fusion model integrates image and gradient priors using l(2)-norm can effectively improve the generalization ability on multicontrast datasets reconstruction.
引用
收藏
页码:1390 / 1405
页数:16
相关论文
共 38 条
[21]   Effective Snapshot Compressive-spectral Imaging via Deep Denoising and Total Variation Priors [J].
Qiu, Haiquan ;
Wang, Yao ;
Meng, Deyu .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :9123-9132
[22]  
Qu X., 2014, IEEE T MED IMAGING, V18, P843
[23]   Magnetic resonance image reconstruction from undersampled measurements using a patch-based nonlocal operator [J].
Qu, Xiaobo ;
Hou, Yingkun ;
Lam, Fan ;
Guo, Di ;
Zhong, Jianhui ;
Chen, Zhong .
MEDICAL IMAGE ANALYSIS, 2014, 18 (06) :843-856
[24]  
Ravishankar S., 2012, IEEE T MED IMAGING, V30, P964
[25]   A Deep Cascade of Convolutional Neural Networks for Dynamic MR Image Reconstruction [J].
Schlemper, Jo ;
Caballero, Jose ;
Hajnal, Joseph V. ;
Price, Anthony N. ;
Rueckert, Daniel .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2018, 37 (02) :491-503
[26]   A Deep Cascade of Convolutional Neural Networks for MR Image Reconstruction [J].
Schlemper, Jo ;
Caballero, Jose ;
Hajnal, Joseph V. ;
Price, Anthony ;
Rueckert, Daniel .
INFORMATION PROCESSING IN MEDICAL IMAGING (IPMI 2017), 2017, 10265 :647-658
[27]  
Sun J., 2016, Advances in neural information processing systems, P10
[28]  
Sun J, 2008, PROC CVPR IEEE, P2471, DOI 10.1109/CVPR.2008.4587659
[29]  
Szegedy C, 2014, Arxiv, DOI arXiv:1312.6199
[30]   Image Super-Resolution via Deep Recursive Residual Network [J].
Tai, Ying ;
Yang, Jian ;
Liu, Xiaoming .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2790-2798