CycleSAR: SAR Image Despeckling as Unpaired Image-to-Image Translation

被引:2
作者
Lattari, Francesco [1 ]
Santomarco, Vincenzo [1 ]
Santambrogio, Riccardo [1 ]
Rucci, Alessio [2 ]
Matteucci, Matteo [1 ]
机构
[1] Politecn Milan, Dipartimento Elettron Informazione & Bioingn DEIB, I-20133 Milan, Italy
[2] TRE ALTAMIRA S r l, I-20143 Milan, Italy
来源
2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN | 2023年
关键词
Synthetic Aperture Radar; despeckling; deep learning; unpaired image-to-image translation; generative adversarial networks; ALGORITHM;
D O I
10.1109/IJCNN54540.2023.10191089
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Synthetic Aperture Radar (SAR) is a cutting-edge remote sensing technology that offers a unique perspective on the Earth's surface through its advanced microwave imaging, providing valuable insights into various aspects of the environment. However, SAR images are impacted by the speckle phenomenon, which acts as noise, hindering accurate interpretation of the scene and presenting a major challenge for SAR image analysis and understanding. Deep Learning has emerged as a powerful solution for despeckling SAR images, but acquiring large amounts of labeled data for training is a significant obstacle as obtaining ground truth in the SAR domain is not feasible. The proposed method overcomes this limitation with a novel unsupervised approach to single-look SAR image despeckling. Our method, CycleSAR, leverages the power of cycle-consistent generative adversarial networks (CycleGANs) to formulate the despeckling problem as an unpaired image-to-image translation, by effectively bypassing the need for ground truth data. Additionally, our method not only effectively reduces the speckle in single-look SAR images, but also enables, by construction, the simultaneous learning of a generative model to generate realistic speckled realizations of multi-look SAR images. The addition of a conditional variational autoencoder (CVAE) further enhances the method, enabling the one-to-many generation of speckled images and leading to an overall improvement in despeckling performance. The experimental results demonstrate the remarkable capabilities of the proposed method, CycleSAR, in providing high-quality despeckling and realistic speckle realizations. CycleSAR stands apart from existing state-of-the-art methods as it does not rely on data simulation or make any assumptions about the speckle distribution.
引用
收藏
页数:8
相关论文
共 39 条
[1]  
Abramov S., 2010, INTECH COMPUTATIONAL, V01
[2]  
Arjovsky M, 2017, Arxiv, DOI arXiv:1701.07875
[3]  
Bashkirova D., 2019, arXiv
[4]  
Molini AB, 2020, Arxiv, DOI arXiv:2007.02075
[5]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[6]  
Chierchia G, 2017, INT GEOSCI REMOTE SE, P5438, DOI 10.1109/IGARSS.2017.8128234
[7]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095
[8]   SAR2SAR: A Semi-Supervised Despeckling Algorithm for SAR Images [J].
Dalsasso, Emanuele ;
Denis, Loic ;
Tupin, Florence .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :4321-4329
[9]  
Ferretti A., 2007, InSAR Principles: Guidelines for SAR Interferometry Processing and Interpretation
[10]  
Ferretti A, 2014, SATELLITE INSAR DATA: RESERVOIR MONITORING FROM SPACE, P1, DOI 10.3997/9789073834712