Deep Unfolding Convolutional Dictionary Model for Multi-Contrast MRI Super-resolution and Reconstruction

被引:0
|
作者
Lei, Pengcheng [1 ]
Fang, Faming [1 ]
Zhang, Guixu [1 ]
Xu, Ming [2 ]
机构
[1] East China Normal Univ, Sch Comp Sci & Technol, Shanghai, Peoples R China
[2] East China Normal Univ, Software Engn Inst, Shanghai, Peoples R China
来源
PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023 | 2023年
基金
国家重点研发计划;
关键词
IMAGE; NETWORK;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic resonance imaging (MRI) tasks often involve multiple contrasts. Recently, numerous deep learning-based multi-contrast MRI super-resolution (SR) and reconstruction methods have been proposed to explore the complementary information from the multi-contrast images. However, these methods either construct parameter-sharing networks or manually design fusion rules, failing to accurately model the correlations between multi-contrast images and lacking certain interpretations. In this paper, we propose a multi-contrast convolutional dictionary (MC-CDic) model under the guidance of the optimization algorithm with a well-designed data fidelity term. Specifically, we bulid an observation model for the multi-contrast MR images to explicitly model the multi-contrast images as common features and unique features. In this way, only the useful information in the reference image can be transferred to the target image, while the inconsistent information will be ignored. We employ the proximal gradient algorithm to optimize the model and unroll the iterative steps into a deep CDic model. Especially, the proximal operators are replaced by learnable ResNet. In addition, multi-scale dictionaries are introduced to further improve the model performance. We test our MC-CDic model on multi-contrast MRI SR and reconstruction tasks. Experimental results demonstrate the superior performance of the proposed MC-CDic model against existing SOTA methods. Code is available at https://github.com/lpcccc-cv/MC-CDic.
引用
收藏
页码:1008 / 1016
页数:9
相关论文
共 50 条
  • [1] Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction
    Yang, Gang
    Zhang, Li
    Zhou, Man
    Liu, Aiping
    Chen, Xun
    Xiong, Zhiwei
    Wu, Feng
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3974 - 3982
  • [2] MGDUN: An interpretable network for multi-contrast MRI image super-resolution reconstruction
    Yang, Gang
    Zhang, Li
    Liu, Aiping
    Fu, Xueyang
    Chen, Xun
    Wang, Rujing
    COMPUTERS IN BIOLOGY AND MEDICINE, 2023, 167
  • [3] Decomposition-Based Variational Network for Multi-Contrast MRI Super-Resolution and Reconstruction
    Lei, Pengcheng
    Fang, Faming
    Zhang, Guixu
    Zeng, Tieyong
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 21239 - 21249
  • [4] Multi-Contrast Super-Resolution MRI Through a Progressive Network
    Lyu, Qing
    Shan, Hongming
    Steber, Cole
    Helis, Corbin
    Whitlow, Chris
    Chan, Michael
    Wang, Ge
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (09) : 2738 - 2749
  • [5] Dual Arbitrary Scale Super-Resolution for Multi-contrast MRI
    Zhang, Jiamiao
    Chi, Yichen
    Lyu, Jun
    Yang, Wenming
    Tian, Yapeng
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 282 - 292
  • [6] DisC-Diff: Disentangled Conditional Diffusion Model for Multi-contrast MRI Super-Resolution
    Mao, Ye
    Jiang, Lan
    Chen, Xi
    Li, Chao
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X, 2023, 14229 : 387 - 397
  • [7] Multi-scale deformable transformer for multi-contrast knee MRI super-resolution
    Zou, Beiji
    Ji, Zexin
    Zhu, Chengzhang
    Dai, Yulan
    Zhang, Wensheng
    Kui, Xiaoyan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 79
  • [8] Multi-contrast MRI Super-Resolution via a Multi-stage Integration Network
    Feng, Chun-Mei
    Fu, Huazhu
    Yuan, Shuhao
    Xu, Yong
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2021, PT VI, 2021, 12906 : 140 - 149
  • [9] Coupled Dictionary Learning for Multi-Contrast MRI Reconstruction
    Song, Pingfan
    Weizman, Lior
    Mota, Joao F. C.
    Eldar, Yonina C.
    Rodrigues, Miguel R. D.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (03) : 621 - 633
  • [10] COUPLED DICTIONARY LEARNING FOR MULTI-CONTRAST MRI RECONSTRUCTION
    Song, Pingfan
    Weizman, Lior
    Mota, Joao F. C.
    Eldar, Yonina C.
    Rodrigues, Miguel R. D.
    2018 25TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2018, : 2880 - 2884