As If by Magic: Self-Supervised Training of Deep Despeckling Networks With MERLIN

被引:45
|
作者
Dalsasso, Emanuele [1 ]
Denis, Loic [2 ]
Tupin, Florence [1 ]
机构
[1] Inst Polytech Paris, Telecom Paris, Informat Proc & Commun Lab LTCI, F-91120 Palaiseau, France
[2] Univ Jean Monnet UJM St Etienne, Lab Hubert Curien UMR 5516, CNRS, Inst Opt Grad Sch, F-42023 St Etienne, France
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
关键词
Speckle; Training; Radar polarimetry; Synthetic aperture radar; Transfer functions; Image restoration; Deep learning; image despeckling; self-supervised training; synthetic aperture radar (SAR); SPECKLE REDUCTION; SAR;
D O I
10.1109/TGRS.2021.3128621
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Speckle fluctuations seriously limit the interpretability of synthetic aperture radar (SAR) images. Speckle reduction has thus been the subject of numerous works spanning at least four decades. Techniques based on deep neural networks have recently achieved a new level of performance in terms of SAR image restoration quality. Beyond the design of suitable network architectures or the selection of adequate loss functions, the construction of training sets is of uttermost importance. So far, most approaches have considered a supervised training strategy: the networks are trained to produce outputs as close as possible to speckle-free reference images. Speckle-free images are generally not available, which requires resorting to natural or optical images or the selection of stable areas in long time series to circumvent the lack of ground truth. Self-supervision, on the other hand, avoids the use of speckle-free images. We introduce a self-supervised strategy based on the separation of the real and imaginary parts of single-look complex (SLC) SAR images, called coMplex sElf-supeRvised despeckLINg (MERLIN), and show that it offers a straightforward way to train all kinds of deep despeckling networks. Networks trained with MERLIN take into account the spatial correlations due to the SAR transfer function specific to a given sensor and imaging mode. By requiring only a single image, and possibly exploiting large archives, MERLIN opens the door to hassle-free as well as large-scale training of despeckling networks. The code of the trained models is made freely available at <uri>https://gitlab.telecom-paris.fr/RING/MERLIN</uri>.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] MERLIN-Seg: Self-supervised despeckling for label-efficient semantic segmentation
    Dalsasso, Emanuele
    Rambour, Clement
    Trouve, Nicolas
    Thome, Nicolas
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 241
  • [2] Self-Supervised SAR Despeckling Using Deep Image Prior
    Albisani, Chiara
    Baracchi, Daniele
    Piva, Alessandro
    Argenti, Fabrizio
    PATTERN RECOGNITION LETTERS, 2025, 190 : 169 - 176
  • [3] Self-Supervised SAR Despeckling Powered by Implicit Deep Denoiser Prior
    Lin, Huangxing
    Zhuang, Yihong
    Huang, Yue
    Ding, Xinghao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [4] Biologically Plausible Training Mechanisms for Self-Supervised Learning in Deep Networks
    Tang, Mufeng
    Yang, Yibo
    Amit, Yali
    FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2022, 16
  • [5] PolMERLIN: Self-Supervised Polarimetric Complex SAR Image Despeckling With Masked Networks
    Kyoto University, Graduate School of Informatics, Kyoto
    606-8501, Japan
    不详
    100-0004, Japan
    IEEE Geosci. Remote Sens. Lett., 2024, (1-5): : 1 - 5
  • [6] PolMERLIN: Self-Supervised Polarimetric Complex SAR Image Despeckling With Masked Networks
    Kato, Shunya
    Saito, Masaki
    Ishiguro, Katsuhiko
    Cummings, Sol
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [7] Noise2Noise Self-Supervised Deep Learning Holographic Despeckling Method
    Shen, Chenghua
    Zhou, Wenjing
    Zhang, Hongbo
    Yu, Yingjie
    HOLOGRAPHY, DIFFRACTIVE OPTICS, AND APPLICATIONS XII, 2022, 12318
  • [8] Speckle2Void: Deep Self-Supervised SAR Despeckling With Blind-Spot Convolutional Neural Networks
    Molini, Andrea Bordone
    Valsesia, Diego
    Fracastoro, Giulia
    Magli, Enrico
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Comments on "PolMERLIN: Self-Supervised Polarimetric Complex SAR Image Despeckling With Masked Networks"
    Denis, Loic
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 1
  • [10] Deep anomaly detection with self-supervised learning and adversarial training
    Zhang, Xianchao
    Mu, Jie
    Zhang, Xiaotong
    Liu, Han
    Zong, Linlin
    Li, Yuangang
    PATTERN RECOGNITION, 2022, 121