Self-supervised noise modeling and sparsity guided electron tomography volumetric image denoising

被引:2
|
作者
Yang, Zhidong [1 ,2 ,3 ]
Zang, Dawei [1 ]
Li, Hongjia [1 ,3 ]
Zhang, Zhao [4 ]
Zhang, Fa [2 ]
Han, Renmin [4 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, High Performance Comp Res Ctr, Beijing 100190, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Shandong Univ, Res Ctr Math & Interdisciplinary Sci, Frontiers Sci Ctr Nonlinear Expectat, Minist Educ, Qingdao 266237, Peoples R China
基金
中国国家自然科学基金;
关键词
Electron tomography; Image denoising; Self-supervised learning; FILTER; RECONSTRUCTION; REDUCTION; ALGORITHM; QUALITY; NETWORK;
D O I
10.1016/j.ultramic.2023.113860
中图分类号
TH742 [显微镜];
学科分类号
摘要
Cryo-Electron Tomography (cryo-ET) is a revolutionary technique for visualizing macromolecular structures in near-native states. However, the physical limitations of imaging instruments lead to cryo-ET volumetric images with very low Signal-to-Noise Ratio (SNR) with complex noise, which has a side effect on the downstream analysis of the characteristics of observed macromolecules. Additionally, existing methods for image denoising are difficult to be well generalized to the complex noise in cryo-ET volumes. In this work, we propose a self-supervised deep learning model for cryo-ET volumetric image denoising based on noise modeling and sparsity guidance (NMSG), achieved by learning the noise distribution in noisy cryo-ET volumes and introducing sparsity guidance to ensure smoothness. Firstly, a Generative Adversarial Network (GAN) is utilized to learn noise distribution in cryo-ET volumes and generate noisy volumes pair from single volume. Then, a new loss function is devised to both ensure the recovery of ultrastructure and local smoothness. Experiments are done on five real cryo-ET datasets and three simulated cryo-ET datasets. The comprehensive experimental results demonstrate that our method can perform reliable denoising by training on single noisy volume, achieving better results than state-of-the-art single volume-based methods and competitive with methods trained on large-scale datasets.
引用
收藏
页数:11
相关论文
共 50 条
  • [21] Spatial redundancy transformer for self-supervised fluorescence image denoising
    Li, Xinyang
    Hu, Xiaowan
    Chen, Xingye
    Fan, Jiaqi
    Zhao, Zhifeng
    Wu, Jiamin
    Wang, Haoqian
    Dai, Qionghai
    NATURE COMPUTATIONAL SCIENCE, 2023, 3 (12): : 1067 - +
  • [22] Spatial redundancy transformer for self-supervised fluorescence image denoising
    Xinyang Li
    Xiaowan Hu
    Xingye Chen
    Jiaqi Fan
    Zhifeng Zhao
    Jiamin Wu
    Haoqian Wang
    Qionghai Dai
    Nature Computational Science, 2023, 3 : 1067 - 1080
  • [23] NVST Image Denoising Based on Self-Supervised Deep Learning
    Lu Xianwei
    Liu Hui
    Shang Zhenhong
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (06)
  • [24] High-Quality Self-Supervised Deep Image Denoising
    Laine, Samuli
    Karras, Tero
    Lehtinen, Jaakko
    Aila, Timo
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [25] Asymmetric Mask Scheme for Self-supervised Real Image Denoising
    Li, Xiangyu
    Zheng, Tianheng
    Zhong, Jiayu
    Zhang, Pingping
    Ren, Chao
    COMPUTER VISION - ECCV 2024, PT XXV, 2025, 15083 : 199 - 215
  • [26] Comparison between Supervised and Self-supervised Deep Learning for SEM Image Denoising
    Okud, Tomoyuki
    Chen, Jun
    Motoyoshi, Takahiro
    Yumiba, Ryou
    Ishikawa, Masayoshi
    Toyoda, Yasutaka
    METROLOGY, INSPECTION, AND PROCESS CONTROL XXXVII, 2023, 12496
  • [27] Self-supervised learning for CT image denoising and reconstruction: a review
    Choi, Kihwan
    BIOMEDICAL ENGINEERING LETTERS, 2024, 14 (06) : 1207 - 1220
  • [28] Emulating Low-Dose PCCT Image Pairs With Independent Noise for Self-Supervised Spectral Image Denoising
    Wang, Sen
    Yang, Yirong
    Stevens, Grant M.
    Yin, Zhye
    Wang, Adam S.
    IEEE TRANSACTIONS ON MEDICAL IMAGING, 2025, 44 (01) : 530 - 542
  • [29] A self-supervised guided knowledge distillation framework for unpaired low-dose CT image denoising
    Wang, Jiping
    Tang, Yufei
    Wu, Zhongyi
    Du, Qiang
    Yao, Libing
    Yang, Xiaodong
    Li, Ming
    Zheng, Jian
    COMPUTERIZED MEDICAL IMAGING AND GRAPHICS, 2023, 107
  • [30] Dynamic Adaptive Attention-Guided Self-Supervised Single Remote-Sensing Image Denoising
    Liu, Minghao
    Jiang, Wenzong
    Liu, Weifeng
    Tao, Dapeng
    Liu, Baodi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61