Self-supervised noise modeling and sparsity guided electron tomography volumetric image denoising

被引:2
|
作者
Yang, Zhidong [1 ,2 ,3 ]
Zang, Dawei [1 ]
Li, Hongjia [1 ,3 ]
Zhang, Zhao [4 ]
Zhang, Fa [2 ]
Han, Renmin [4 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, High Performance Comp Res Ctr, Beijing 100190, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Shandong Univ, Res Ctr Math & Interdisciplinary Sci, Frontiers Sci Ctr Nonlinear Expectat, Minist Educ, Qingdao 266237, Peoples R China
基金
中国国家自然科学基金;
关键词
Electron tomography; Image denoising; Self-supervised learning; FILTER; RECONSTRUCTION; REDUCTION; ALGORITHM; QUALITY; NETWORK;
D O I
10.1016/j.ultramic.2023.113860
中图分类号
TH742 [显微镜];
学科分类号
摘要
Cryo-Electron Tomography (cryo-ET) is a revolutionary technique for visualizing macromolecular structures in near-native states. However, the physical limitations of imaging instruments lead to cryo-ET volumetric images with very low Signal-to-Noise Ratio (SNR) with complex noise, which has a side effect on the downstream analysis of the characteristics of observed macromolecules. Additionally, existing methods for image denoising are difficult to be well generalized to the complex noise in cryo-ET volumes. In this work, we propose a self-supervised deep learning model for cryo-ET volumetric image denoising based on noise modeling and sparsity guidance (NMSG), achieved by learning the noise distribution in noisy cryo-ET volumes and introducing sparsity guidance to ensure smoothness. Firstly, a Generative Adversarial Network (GAN) is utilized to learn noise distribution in cryo-ET volumes and generate noisy volumes pair from single volume. Then, a new loss function is devised to both ensure the recovery of ultrastructure and local smoothness. Experiments are done on five real cryo-ET datasets and three simulated cryo-ET datasets. The comprehensive experimental results demonstrate that our method can perform reliable denoising by training on single noisy volume, achieving better results than state-of-the-art single volume-based methods and competitive with methods trained on large-scale datasets.
引用
收藏
页数:11
相关论文
共 50 条
  • [31] Self-supervised Bone Scan Denoising
    Yie, Si Young
    Kang, Seung Kwan
    Hwang, Donghwi
    Choi, Hongyoon
    Lee, Jae Sung
    JOURNAL OF NUCLEAR MEDICINE, 2021, 62
  • [32] Toward Interactive Self-Supervised Denoising
    Yao, Mingde
    He, Dongliang
    Li, Xin
    Li, Fu
    Xiong, Zhiwei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (10) : 5360 - 5374
  • [33] Self-Supervised Deep Depth Denoising
    Sterzentsenko, Vladimiros
    Saroglou, Leonidas
    Chatzitofis, Anargyros
    Thermos, Spyridon
    Zioulis, Nikolaos
    Doumanoglou, Alexandros
    Zarpalas, Dimitrios
    Daras, Petros
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 1242 - 1251
  • [34] Self-supervised denoising for high-dimensional magnetic resonance image
    Tian, Xuanyu
    Wu, Jiangjie
    Lao, Guoyan
    Du, Chenhe
    Jiang, Changhao
    Li, Yanbin
    Zhang, Jeff L.
    Wei, Hongjiang
    Zhang, Yuyao
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 104
  • [35] Astronomical image denoising by self-supervised deep learning and restoration processes
    Liu, Tie
    Quan, Yuhui
    Su, Yingna
    Guo, Yang
    Liu, Shu
    Ji, Haisheng
    Hao, Qi
    Gao, Yulong
    Liu, Yuxia
    Wang, Yikang
    Sun, Wenqing
    Ding, Mingde
    NATURE ASTRONOMY, 2025, : 608 - 615
  • [36] IDR: Self-Supervised Image Denoising via Iterative Data Refinement
    Zhang, Yi
    Li, Dasong
    Law, Ka Lung
    Wang, Xiaogang
    Qin, Hongwei
    Li, Hongsheng
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2088 - 2097
  • [37] Patch-Craft Self-Supervised Training for Correlated Image Denoising
    Vaksman, Gregory
    Elad, Michael
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 5795 - 5804
  • [38] Pol2Pol: self-supervised polarimetric image denoising
    Liu, Hedong
    Li, Xiaobo
    Cheng, Zhenzhou
    Liu, Tiegen
    Zhai, Jingsheng
    Hu, Haofeng
    OPTICS LETTERS, 2023, 48 (18) : 4821 - 4824
  • [39] Multi-view Self-supervised Disentanglement for General Image Denoising
    Chen, Hao
    Qu, Chenyuan
    Zhang, Yu
    Chen, Chen
    Jiao, Jianbo
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 12247 - 12257
  • [40] Self-supervised ultrasound image denoising based on weighted joint loss
    Yu, Chunlei
    Ren, Fuquan
    Bao, Shuang
    Yang, Yurong
    Xu, Xing
    DIGITAL SIGNAL PROCESSING, 2025, 162