Unsupervised CT Metal Artifact Reduction by Plugging Diffusion Priors in Dual Domains

被引:9
作者
Liu, Xuan [1 ,2 ]
Xie, Yaoqin [2 ]
Diao, Songhui [2 ]
Tan, Shan [1 ]
Liang, Xiaokun [2 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Artificial Intelligence & Automat, Wuhan 430074, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Inst Biomed & Hlth Engn, Shenzhen 518055, Peoples R China
基金
中国国家自然科学基金;
关键词
Computed tomography; Metals; Image reconstruction; Data models; Training; Implants; Convolutional neural networks; metal artifact reduction; diffusion model; unsupervised learning; NETWORK;
D O I
10.1109/TMI.2024.3351201
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
During the process of computed tomography (CT), metallic implants often cause disruptive artifacts in the reconstructed images, impeding accurate diagnosis. Many supervised deep learning-based approaches have been proposed for metal artifact reduction (MAR). However, these methods heavily rely on training with paired simulated data, which are challenging to acquire. This limitation can lead to decreased performance when applying these methods in clinical practice. Existing unsupervised MAR methods, whether based on learning or not, typically work within a single domain, either in the image domain or the sinogram domain. In this paper, we propose an unsupervised MAR method based on the diffusion model, a generative model with a high capacity to represent data distributions. Specifically, we first train a diffusion model using CT images without metal artifacts. Subsequently, we iteratively introduce the diffusion priors in both the sinogram domain and image domain to restore the degraded portions caused by metal artifacts. Besides, we design temporally dynamic weight masks for the image-domian fusion. The dual-domain processing empowers our approach to outperform existing unsupervised MAR methods, including another MAR method based on diffusion model. The effectiveness has been qualitatively and quantitatively validated on synthetic datasets. Moreover, our method demonstrates superior visual results among both supervised and unsupervised methods on clinical datasets. Codes are available in github.com/DeepXuan/DuDoDp-MAR.
引用
收藏
页码:3533 / 3545
页数:13
相关论文
共 37 条
  • [1] Diffusion Models in Vision: A Survey
    Croitoru, Florinel-Alin
    Hondru, Vlad
    Ionescu, Radu Tudor
    Shah, Mubarak
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (09) : 10850 - 10869
  • [2] De Man B, 1999, IEEE T NUCL SCI, V46, P691, DOI 10.1109/23.775600
  • [3] Dhariwal P, 2021, ADV NEUR IN, V34
  • [4] Dinh L, 2015, Arxiv, DOI arXiv:1410.8516
  • [5] Dinh L, 2017, Arxiv, DOI arXiv:1605.08803
  • [6] Deep-Learning-Based Metal Artefact Reduction With Unsupervised Domain Adaptation Regularization for Practical CT Images
    Du, Muge
    Liang, Kaichao
    Zhang, Li
    Gao, Hewei
    Liu, Yinong
    Xing, Yuxiang
    [J]. IEEE TRANSACTIONS ON MEDICAL IMAGING, 2023, 42 (08) : 2133 - 2145
  • [7] Generative Adversarial Networks
    Goodfellow, Ian
    Pouget-Abadie, Jean
    Mirza, Mehdi
    Xu, Bing
    Warde-Farley, David
    Ozair, Sherjil
    Courville, Aaron
    Bengio, Yoshua
    [J]. COMMUNICATIONS OF THE ACM, 2020, 63 (11) : 139 - 144
  • [8] Ho, 2020, ADV NEURAL INFORM PR, V33, P6840, DOI [10.48550/arXiv.2006.11239, DOI 10.48550/ARXIV.2006.11239]
  • [9] An iterative approach to the beam hardening correction in cone beam CT
    Hsieh, J
    Molthen, RC
    Dawson, CA
    Johnson, RH
    [J]. MEDICAL PHYSICS, 2000, 27 (01) : 23 - 29
  • [10] Metal artifact reduction on cervical CT images by deep residual learning
    Huang, Xia
    Wang, Jian
    Tang, Fan
    Zhong, Tao
    Zhang, Yu
    [J]. BIOMEDICAL ENGINEERING ONLINE, 2018, 17