Joint compression and despeckling by SAR representation learning

被引:3
作者
Amao-Oliva, Joel [1 ]
Foix-Colonier, Nils [2 ]
Sica, Francescopaolo [3 ]
机构
[1] German Aerosp Ctr, Microwaves & Radar Inst, Munchener Str 20, D-82234 Wessling, Germany
[2] Nantes Univ, Ecole Cent Nantes, CNRS, UMR 6004,LS2N, 1 Rue Noe, F-44000 Nantes, France
[3] Univ Bundeswehr Munich, Dept Aerosp Engn, Werner Heisenberg Weg 39, D-85577 Neubiberg, Germany
关键词
Synthetic Aperture Radar (SAR); Despeckling; Image compression; Machine learning; Self-supervised learning; Representation learning; IMAGE COMPRESSION;
D O I
10.1016/j.isprsjprs.2024.12.016
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Synthetic Aperture Radar (SAR) imagery is a powerful and widely used tool in a variety of remote sensing applications. The increasing number of SAR sensors makes it challenging to process and store such a large amount of data. In addition, as the flexibility and processing power of on-board electronics increases, the challenge of effectively transmitting large images to the ground becomes more tangible and pressing. In this paper, we present a method that uses self-supervised despeckling to learn a SAR image representation that is then used to perform image compression. The intuition that despeckling will additionally improve the compression task is based on the fact that the image representation used for despeckling forms an image prior that preserves the main image features while suppressing the spatially correlated noise component. The same learned image representation, which can already be seen as the output of a data reduction task, is further compressed in a lossless manner. While the two tasks can be solved separately, we propose to simultaneously training our model for despeckling and compression in a self-supervised and multi-objective fashion. The proposed network architecture avoids the use of skip connections by ensuring that the encoder and decoder share only the features generated at the lowest network level, namely the bridge, which is then further transformed into a bitstream. This differs from the usual network architectures used for despeckling, such as the commonly used Deep Residual U-Net. In this way, our network design allows compression and reconstruction to be performed at two different times and locations. The proposed method is trained and tested on real data from the TerraSAR-X sensor (downloaded from https://earth.esa.int/eogateway/catalog/terrasarx-esa-archive). The experiments show that joint optimization can achieve performance beyond the state-ofthe-art for both despeckling and compression, represented hereby the MERLIN and JPEG2000 algorithms, respectively. Furthermore, our method has been successfully tested against the cascade of these despeckling and compression algorithms, showing abetter spatial and radiometric resolution, while achieving abetter compression rate, e.g. a Peak Signal to Noise Ratio (PSNR) always higher than the comparison methods for any achieved bits-per-pixel (BPP) and specifically a PSNR gain of more than 2 dB by a compression rate of 0.7 BPP.
引用
收藏
页码:524 / 534
页数:11
相关论文
共 38 条
[1]   A Tutorial on Speckle Reduction in Synthetic Aperture Radar Images [J].
Argenti, Fabrizio ;
Lapini, Alessandro ;
Alparone, Luciano ;
Bianchi, Tiziano .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2013, 1 (03) :6-35
[2]  
Ball‚ J, 2017, Arxiv, DOI arXiv:1611.01704
[3]  
Balle J, 2016, Arxiv, DOI arXiv:1511.06281
[4]  
Ball‚ J, 2018, Arxiv, DOI arXiv:1802.01436
[5]   Nonlinear Transform Coding [J].
Balle, Johannes ;
Chou, Philip A. ;
Minnen, David ;
Singh, Saurabh ;
Johnston, Nick ;
Agustsson, Eirikur ;
Hwang, Sung Jin ;
Toderici, George .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2021, 15 (02) :339-353
[6]   End-to-end optimization of nonlinear transform codes for perceptual quality [J].
Balle, Johannes ;
Laparra, Valero ;
Simoncelli, Eero P. .
2016 PICTURE CODING SYMPOSIUM (PCS), 2016,
[7]  
Ballé J, 2018, PICT COD SYMP, P248, DOI 10.1109/PCS.2018.8456272
[8]   SAR image compression with the Gabor transform [J].
Baxter, RA .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1999, 37 (01) :574-588
[9]   DenoiSeg: Joint Denoising and Segmentation [J].
Buchholz, Tim-Oliver ;
Prakash, Mangal ;
Schmidt, Deborah ;
Krull, Alexander ;
Jug, Florian .
COMPUTER VISION - ECCV 2020 WORKSHOPS, PT I, 2020, 12535 :324-337
[10]  
Cheng K.L., 2022, Optimizing image compression via joint learning with denoising