Self-supervised noise modeling and sparsity guided electron tomography volumetric image denoising

被引:2
|
作者
Yang, Zhidong [1 ,2 ,3 ]
Zang, Dawei [1 ]
Li, Hongjia [1 ,3 ]
Zhang, Zhao [4 ]
Zhang, Fa [2 ]
Han, Renmin [4 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, High Performance Comp Res Ctr, Beijing 100190, Peoples R China
[2] Beijing Inst Technol, Sch Med Technol, Beijing 100081, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Shandong Univ, Res Ctr Math & Interdisciplinary Sci, Frontiers Sci Ctr Nonlinear Expectat, Minist Educ, Qingdao 266237, Peoples R China
基金
中国国家自然科学基金;
关键词
Electron tomography; Image denoising; Self-supervised learning; FILTER; RECONSTRUCTION; REDUCTION; ALGORITHM; QUALITY; NETWORK;
D O I
10.1016/j.ultramic.2023.113860
中图分类号
TH742 [显微镜];
学科分类号
摘要
Cryo-Electron Tomography (cryo-ET) is a revolutionary technique for visualizing macromolecular structures in near-native states. However, the physical limitations of imaging instruments lead to cryo-ET volumetric images with very low Signal-to-Noise Ratio (SNR) with complex noise, which has a side effect on the downstream analysis of the characteristics of observed macromolecules. Additionally, existing methods for image denoising are difficult to be well generalized to the complex noise in cryo-ET volumes. In this work, we propose a self-supervised deep learning model for cryo-ET volumetric image denoising based on noise modeling and sparsity guidance (NMSG), achieved by learning the noise distribution in noisy cryo-ET volumes and introducing sparsity guidance to ensure smoothness. Firstly, a Generative Adversarial Network (GAN) is utilized to learn noise distribution in cryo-ET volumes and generate noisy volumes pair from single volume. Then, a new loss function is devised to both ensure the recovery of ultrastructure and local smoothness. Experiments are done on five real cryo-ET datasets and three simulated cryo-ET datasets. The comprehensive experimental results demonstrate that our method can perform reliable denoising by training on single noisy volume, achieving better results than state-of-the-art single volume-based methods and competitive with methods trained on large-scale datasets.
引用
收藏
页数:11
相关论文
共 50 条
  • [41] Self-Supervised Image Denoising Using Implicit Deep Denoiser Prior
    Lin, Huangxing
    Zhuang, Yihong
    Ding, Xinghao
    Zeng, Delu
    Huang, Yue
    Tu, Xiaotong
    Paisley, John
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 2, 2023, : 1586 - 1594
  • [42] Self-supervised denoising of Nyquist-sampled volumetric images via deep learning
    Applegate, Matthew B.
    Kose, Kivanc
    Ghimire, Sandesh
    Rajadhyaksha, Milind
    Dy, Jennifer
    JOURNAL OF MEDICAL IMAGING, 2023, 10 (02)
  • [43] Noise2Contrast: Multi-contrast Fusion Enables Self-supervised Tomographic Image Denoising
    Wagner, Fabian
    Thies, Mareike
    Pfaff, Laura
    Maul, Noah
    Pechmann, Sabrina
    Gu, Mingxuan
    Utz, Jonas
    Aust, Oliver
    Weidner, Daniela
    Neag, Georgiana
    Uderhardt, Stefan
    Choi, Jang-Hwan
    Maier, Andreas
    INFORMATION PROCESSING IN MEDICAL IMAGING, IPMI 2023, 2023, 13939 : 771 - 782
  • [44] Noise2Score: Tweedie's Approach to Self-Supervised Image Denoising without Clean Images
    Kim, Kwanyoung
    Ye, Jong Chul
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 34 (NEURIPS 2021), 2021, 34
  • [45] SELF-SUPERVISED DENOISING OF OPTICAL COHERENCE TOMOGRAPHY WITH INTER-FRAME REPRESENTATION
    Liu, Zhengji
    Law, Tsz-Kin
    Li, Jizhou
    To, Chi-Ho
    Chun, Rachel Ka-Man
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 3334 - 3338
  • [46] CVF-SID: Cyclic multi-Variate Function for Self-Supervised Image Denoising by Disentangling Noise from Image
    Neshatavar, Reyhaneh
    Yavartanoo, Mohsen
    Son, Sanghyun
    Lee, Kyoung Mu
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 17562 - 17570
  • [47] Self-Supervised Denoising of single OCT image with Self2Self-OCT Network
    Ge, Chenkun
    Yu, Xiaojun
    Li, Mingshuai
    Mo, Jianhua
    2022 IEEE 7TH OPTOELECTRONICS GLOBAL CONFERENCE, OGC, 2022, : 200 - 204
  • [48] A Self-Supervised Method Using Noise2Noise Strategy for Denoising CRP Gathers
    Wang, Xiaokai
    Fan, Siyuan
    Zhao, Chen
    Liu, Dawei
    Chen, Wenchao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [49] Self2Self With Dropout: Learning Self-Supervised Denoising From Single Image
    Quan, Yuhui
    Chen, Mingqin
    Pang, Tongyao
    Ji, Hui
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 1887 - 1895
  • [50] Self-Supervised Deep Learning for Low-Dose CT Image Denoising
    Bai, T.
    Nguyen, D.
    Jiang, S.
    MEDICAL PHYSICS, 2020, 47 (06) : E658 - E658