Self-supervised noise modeling and sparsity guided electron tomography volumetric image denoising

被引:2
|
作者
Yang, Zhidong [1 ,2 ,3 ]
Zang, Dawei [1 ]
Li, Hongjia [1 ,3 ]
Zhang, Zhao [4 ]
Zhang, Fa [2 ]
Han, Renmin [4 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, High Performance Comp Res Ctr, Beijing 100190, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Shandong Univ, Res Ctr Math & Interdisciplinary Sci, Frontiers Sci Ctr Nonlinear Expectat, Minist Educ, Qingdao 266237, Peoples R China
基金
中国国家自然科学基金;
关键词
Electron tomography; Image denoising; Self-supervised learning; FILTER; RECONSTRUCTION; REDUCTION; ALGORITHM; QUALITY; NETWORK;
D O I
10.1016/j.ultramic.2023.113860
中图分类号
TH742 [显微镜];
学科分类号
摘要
Cryo-Electron Tomography (cryo-ET) is a revolutionary technique for visualizing macromolecular structures in near-native states. However, the physical limitations of imaging instruments lead to cryo-ET volumetric images with very low Signal-to-Noise Ratio (SNR) with complex noise, which has a side effect on the downstream analysis of the characteristics of observed macromolecules. Additionally, existing methods for image denoising are difficult to be well generalized to the complex noise in cryo-ET volumes. In this work, we propose a self-supervised deep learning model for cryo-ET volumetric image denoising based on noise modeling and sparsity guidance (NMSG), achieved by learning the noise distribution in noisy cryo-ET volumes and introducing sparsity guidance to ensure smoothness. Firstly, a Generative Adversarial Network (GAN) is utilized to learn noise distribution in cryo-ET volumes and generate noisy volumes pair from single volume. Then, a new loss function is devised to both ensure the recovery of ultrastructure and local smoothness. Experiments are done on five real cryo-ET datasets and three simulated cryo-ET datasets. The comprehensive experimental results demonstrate that our method can perform reliable denoising by training on single noisy volume, achieving better results than state-of-the-art single volume-based methods and competitive with methods trained on large-scale datasets.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] CryoSamba: Self-supervised deep volumetric denoising for cryo-electron tomography data
    Costa-Filho, Jose Inacio
    Theveny, Liam
    de Sautu, Marilina
    Kirchhausen, Tom
    JOURNAL OF STRUCTURAL BIOLOGY, 2025, 217 (01)
  • [2] Self-Supervised Cryo-Electron Tomography Volumetric Image Restoration from Single Noisy Volume with Sparsity Constraint
    Yang, Zhidong
    Zhang, Fa
    Han, Renmin
    2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 4036 - 4045
  • [3] Iterative Denoiser and Noise Estimator for Self-Supervised Image Denoising
    Zou, Yunhao
    Yan, Chenggang
    Fu, Ying
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 13219 - 13228
  • [4] Noise2Info: Noisy Image to Information of Noise for Self-Supervised Image Denoising
    Wang, Jiachuan
    Di, Shimin
    Chen, Lei
    Ng, Charles Wang Wai
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 15988 - 15997
  • [5] Noise2Inverse: Self-Supervised Deep Convolutional Denoising for Tomography
    Hendriksen, Allard Adriaan
    Pelt, Daniel Maria
    Batenburg, K. Joost
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2020, 6 (06) : 1320 - 1335
  • [6] Investigating self-supervised image denoising with denaturation
    Waida, Hiroki
    Yamazaki, Kimihiro
    Tokuhisa, Atsushi
    Wada, Mutsuyo
    Wada, Yuichiro
    NEURAL NETWORKS, 2025, 184
  • [7] Leveraging Self-supervised Denoising for Image Segmentation
    Prakash, Mangal
    Buchholz, Tim-Oliver
    Lalit, Manan
    Tomancak, Pavel
    Jug, Florian
    Krull, Alexander
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 428 - 432
  • [8] Noise2Same: Optimizing A Self-Supervised Bound for Image Denoising
    Xie, Yaochen
    Wang, Zhengyang
    Ji, Shuiwang
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 33, NEURIPS 2020, 2020, 33
  • [9] Segmentation-Guided Semantic-Aware Self-Supervised Denoising for SAR Image
    Yuan, Ye
    Wu, Yanxia
    Feng, Pengming
    Fu, Yan
    Wu, Yulei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [10] A self-supervised network for image denoising and watermark removal
    Tian, Chunwei
    Xiao, Jingyu
    Zhang, Bob
    Zuo, Wangmeng
    Zhang, Yudong
    Lin, Chia -Wen
    NEURAL NETWORKS, 2024, 174