Self-supervised MRI Reconstruction with Unrolled Diffusion Models

被引:24
作者
Korkmaz, Yilmaz [1 ]
Cukur, Tolga [2 ,3 ]
Patel, Vishal M. [1 ]
机构
[1] Johns Hopkins Univ, Baltimore, MD 21218 USA
[2] Bilkent Univ, Ankara, Turkiye
[3] Natl Magnet Resonance Res Ctr UMRAM, Ankara, Turkiye
来源
MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT X | 2023年 / 14229卷
关键词
Magnetic Resonance Imaging; Self-Supervised Learning; Cross-Attention; Transformers; Accelerated MRI; COMPRESSED-SENSING MRI; IMAGE-RECONSTRUCTION;
D O I
10.1007/978-3-031-43999-5_47
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Magnetic Resonance Imaging (MRI) produces excellent soft tissue contrast, albeit it is an inherently slow imaging modality. Promising deep learning methods have recently been proposed to reconstruct accelerated MRI scans. However, existing methods still suffer from various limitations regarding image fidelity, contextual sensitivity, and reliance on fully-sampled acquisitions for model training. To comprehensively address these limitations, we propose a novel self-supervised deep reconstruction model, named Self-Supervised Diffusion Reconstruction (SSDiffRecon). SSDiffRecon expresses a conditional diffusion process as an unrolled architecture that interleaves cross-attention transformers for reverse diffusion steps with data-consistency blocks for physics-driven processing. Unlike recent diffusion methods for MRI reconstruction, a self-supervision strategy is adopted to train SSDiffRecon using only undersampled k-space data. Comprehensive experiments on public brain MR datasets demonstrates the superiority of SSDiffRecon against state-of-the-art supervised, and self-supervised baselines in terms of reconstruction speed and quality. Implementation will be available at https://github.com/yilmazkorkmaz1/SSDiffRecon.
引用
收藏
页码:491 / 501
页数:11
相关论文
共 29 条
[1]   MoDL: Model-Based Deep Learning Architecture for Inverse Problems [J].
Aggarwal, Hemant K. ;
Mani, Merry P. ;
Jacob, Mathews .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2019, 38 (02) :394-405
[2]  
Bakker Tim, 2022, arXiv
[3]  
Cao CT, 2024, Arxiv, DOI arXiv:2208.05481
[4]   Accelerating multi-echo MRI in k-space with complex-valued diffusion probabilistic model [J].
Cao, Ying ;
Wang, Lihui ;
Zhang, Jian ;
Xia, Hui ;
Yang, Feng ;
Zhu, Yuemin .
2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, :479-484
[5]  
Cui ZX, 2022, Arxiv, DOI [arXiv:2209.00835, 10.48550/arXiv.2209.00835]
[6]   Prior-Guided Image Reconstruction for Accelerated Multi-Contrast MRI via Generative Adversarial Networks [J].
Dar, Salman U. H. ;
Yurt, Mahmut ;
Shahdloo, Mohammad ;
Ildiz, Muhammed Emrullah ;
Tinaz, Berk ;
Cukur, Tolga .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2020, 14 (06) :1072-1087
[7]  
Güngor A, 2023, Arxiv, DOI [arXiv:2207.05876, DOI 10.48550/ARXIV.2207.05876]
[8]   Compressed-Sensing MRI With Random Encoding [J].
Haldar, Justin P. ;
Hernando, Diego ;
Liang, Zhi-Pei .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2011, 30 (04) :893-903
[9]  
Hammernik Kerstin, 2021, 2021 55th Asilomar Conference on Signals, Systems, and Computers, P900, DOI 10.1109/IEEECONF53345.2021.9723134
[10]  
Ho J., 2020, P NIPS, V33, P6840