Investigating self-supervised image denoising with denaturation

被引:0
|
作者
Waida, Hiroki [1 ]
Yamazaki, Kimihiro [2 ]
Tokuhisa, Atsushi [3 ]
Wada, Mutsuyo [2 ]
Wada, Yuichiro [2 ,4 ]
机构
[1] Inst Sci Tokyo, Dept Math & Comp Sci, 2-12-1 Ookayama,Meguro Ku, Tokyo 1528550, Japan
[2] Fujitsu Ltd, 4-1-1 Kamikodanaka,Nakahara Ku, Kawasaki, Kanagawa 2118588, Japan
[3] RIKEN Ctr Computat Sci, 7-1-26 Minatojima-minami-machi,Chuo Ku, Kobe, Hyogo 6500047, Japan
[4] RIKEN Ctr Adv Intelligence Project, Nihonbashi 1 Chome Mitsui Bldg,15th floor,1-4-1 Ni, Tokyo 1030027, Japan
关键词
Self-supervised image denoising; Theory on denoising; CRYO-EM;
D O I
10.1016/j.neunet.2024.106966
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Self-supervised learning for image denoising problems in the presence of denaturation for noisy data is a crucial approach in machine learning. However, theoretical understanding of the performance of the approach that uses denatured data is lacking. To provide better understanding of the approach, in this paper, we analyze a self-supervised denoising algorithm that uses denatured data in depth through theoretical analysis and numerical experiments. Through the theoretical analysis, we discuss that the algorithm finds desired solutions to the optimization problem with the population risk, while the guarantee for the empirical risk depends on the hardness of the denoising task in terms of denaturation levels. We also conduct several experiments to investigate the performance of an extended algorithm in practice. The results indicate that the algorithm training with denatured images works, and the empirical performance aligns with the theoretical results. These results suggest several insights for further improvement of self-supervised image denoising that uses denatured data in future directions.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Two-scale Real Image Blind Denoising with Self-supervised Constraints
    Wang D.
    Pan J.-S.
    Tang J.-H.
    Ruan Jian Xue Bao/Journal of Software, 2023, 34 (06): : 2942 - 2958
  • [42] Diffraction denoising using self-supervised learning
    Markovic, Magdalena
    Malehmir, Reza
    Malehmir, Alireza
    GEOPHYSICAL PROSPECTING, 2023, 71 (07) : 1215 - 1225
  • [43] Self-Supervised Poisson-Gaussian Denoising
    Khademi, Wesley
    Rao, Sonia
    Minnerath, Clare
    Hagen, Guy
    Ventura, Jonathan
    2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, : 2130 - 2138
  • [44] NIRN: Self-supervised noisy image reconstruction network for real-world image denoising
    Li, Xiaopeng
    Fan, Cien
    Zhao, Chen
    Zou, Lian
    Tian, Sheng
    APPLIED INTELLIGENCE, 2022, 52 (14) : 16683 - 16700
  • [45] Noise2Info: Noisy Image to Information of Noise for Self-Supervised Image Denoising
    Wang, Jiachuan
    Di, Shimin
    Chen, Lei
    Ng, Charles Wang Wai
    2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 15988 - 15997
  • [46] NIRN: Self-supervised noisy image reconstruction network for real-world image denoising
    Xiaopeng Li
    Cien Fan
    Chen Zhao
    Lian Zou
    Sheng Tian
    Applied Intelligence, 2022, 52 : 16683 - 16700
  • [47] Blind2Unblind: Self-Supervised Image Denoising with Visible Blind Spots
    Wang, Zejin
    Liu, Jiazheng
    Li, Guoqing
    Han, Hua
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2017 - 2026
  • [48] A Denoising Convolutional Neural Network for Self-Supervised Rank Effectiveness Estimation on Image Retrieval
    Valem, Lucas Pascotti
    Guimaraes Pedronette, Daniel Carlos
    PROCEEDINGS OF THE 2021 INTERNATIONAL CONFERENCE ON MULTIMEDIA RETRIEVAL (ICMR '21), 2021, : 294 - 302
  • [49] A CNN-Based Self-Supervised Synthetic Aperture Radar Image Denoising Approach
    Tan, Shen
    Zhang, Xin
    Wang, Han
    Yu, Le
    Du, Yanlei
    Yin, Junjun
    Wu, Bingfang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [50] Self-supervised noise modeling and sparsity guided electron tomography volumetric image denoising
    Yang, Zhidong
    Zang, Dawei
    Li, Hongjia
    Zhang, Zhao
    Zhang, Fa
    Han, Renmin
    ULTRAMICROSCOPY, 2024, 255