HTCNet: Hybrid Transformer-CNN for SAR Image Denoising

被引:4
作者
Huang, Min [1 ]
Luo, Shuaili [1 ]
Wang, Shuaihui [1 ]
Guo, Jinghang [1 ]
Wang, Jingyang [1 ]
机构
[1] Hebei Univ Sci & Technol, Sch Informat Sci & Engn, Shijiazhuang 050018, Peoples R China
关键词
Convolutional neural networks (CNNs); image denoising; synthetic aperture radar; transformer; QUALITY ASSESSMENT; ALGORITHM; NOISE;
D O I
10.1109/JSTARS.2024.3483786
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Synthetic aperture radar (SAR) is extensively utilized in diverse fields, including military defense and resource exploration, due to its all-day, all-weather characteristics. However, the extraction of information from SAR images is severely affected by speckle noise, making denoising crucial. This article proposes a hybrid transformer-convolutional neural networks (CNNs) network, a hybrid denoising network that combines transformer and CNN. The three core designs of the network ensure its suitability for SAR image denoising: 1) The network integrates a transformer-based encoder with a CNN-based decoder, capturing both local and global dependencies inherent in SAR images, thereby enhancing the effectiveness of noise removal. 2) Patch embedding blocks enhance the convolutional neural network's perception of features at different scales. 3) Depthwise separable convolutions are fused into the Transformer block to further improve the network's ability to capture spatial information while reducing computational complexity. The proposed algorithm demonstrates excellent denoising performance in both simulated and real SAR images, as evidenced by experimental results. Compared to other denoising algorithms, this method efficiently removes speckle noise while preserving the texture information within the images.
引用
收藏
页码:19380 / 19394
页数:15
相关论文
共 63 条
[1]   Synthetic aperture radar image and its despeckling using variational methods: A Review of recent trends [J].
Baraha, Satyakam ;
Sahoo, Ajit Kumar .
SIGNAL PROCESSING, 2023, 212
[2]   A systematic review on recent developments in nonlocal and variational methods for SAR image despeckling [J].
Baraha, Satyakam ;
Sahoo, Ajith Kumar ;
Modalavalasa, Sowjanya .
SIGNAL PROCESSING, 2022, 196
[3]   A Blind SAR Image Despeckling Method Based on Improved Weighted Nuclear Norm Minimization [J].
Bo, Fuyu ;
Lu, Wenfeng ;
Wang, Gongtang ;
Zhou, Maoxia ;
Wang, Qiaoyun ;
Fang, Jing .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[4]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[5]  
Chierchia G, 2017, INT GEOSCI REMOTE SE, P5438, DOI 10.1109/IGARSS.2017.8128234
[6]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[7]  
Dalsasso E., 2022, P EUSAR 14 EUR C SYN, P1
[8]   SAR2SAR: A Semi-Supervised Despeckling Algorithm for SAR Images [J].
Dalsasso, Emanuele ;
Denis, Loic ;
Tupin, Florence .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :4321-4329
[9]   Iterative Weighted Maximum Likelihood Denoising With Probabilistic Patch-Based Weights [J].
Deledalle, Charles-Alban ;
Denis, Loic ;
Tupin, Florence .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (12) :2661-2672
[10]   Quality Assessment of Despeckled SAR Images [J].
Dellepiane, Silvana G. ;
Angiati, Elena .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2014, 7 (02) :691-707