HTCNet: Hybrid Transformer-CNN for SAR Image Denoising

被引:4
作者
Huang, Min [1 ]
Luo, Shuaili [1 ]
Wang, Shuaihui [1 ]
Guo, Jinghang [1 ]
Wang, Jingyang [1 ]
机构
[1] Hebei Univ Sci & Technol, Sch Informat Sci & Engn, Shijiazhuang 050018, Peoples R China
关键词
Convolutional neural networks (CNNs); image denoising; synthetic aperture radar; transformer; QUALITY ASSESSMENT; ALGORITHM; NOISE;
D O I
10.1109/JSTARS.2024.3483786
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Synthetic aperture radar (SAR) is extensively utilized in diverse fields, including military defense and resource exploration, due to its all-day, all-weather characteristics. However, the extraction of information from SAR images is severely affected by speckle noise, making denoising crucial. This article proposes a hybrid transformer-convolutional neural networks (CNNs) network, a hybrid denoising network that combines transformer and CNN. The three core designs of the network ensure its suitability for SAR image denoising: 1) The network integrates a transformer-based encoder with a CNN-based decoder, capturing both local and global dependencies inherent in SAR images, thereby enhancing the effectiveness of noise removal. 2) Patch embedding blocks enhance the convolutional neural network's perception of features at different scales. 3) Depthwise separable convolutions are fused into the Transformer block to further improve the network's ability to capture spatial information while reducing computational complexity. The proposed algorithm demonstrates excellent denoising performance in both simulated and real SAR images, as evidenced by experimental results. Compared to other denoising algorithms, this method efficiently removes speckle noise while preserving the texture information within the images.
引用
收藏
页码:19380 / 19394
页数:15
相关论文
共 63 条
[51]   Trans-NLM Network for SAR Image Despeckling [J].
Xiao, Siyao ;
Zhang, Shunsheng ;
Huang, Libing ;
Wang, Wen-Qin .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 :1-12
[52]   UNSUPERVISED SAR DESPECKLING BASED ON DIFFUSION MODEL [J].
Xiao, Siyao ;
Huang, Libing ;
Zhang, Shunsheng .
IGARSS 2023 - 2023 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2023, :810-813
[53]  
Yang Y., 2010, P 18 SIGSPATIAL INT, P270, DOI [https://doi.org/10.1145/1869790.1869829, DOI 10.1145/1869790.1869829]
[54]   Landslide Detection Based on ResU-Net with Transformer and CBAM Embedded: Two Examples with Geologically Different Environments [J].
Yang, Zhiqiang ;
Xu, Chong ;
Li, Lei .
REMOTE SENSING, 2022, 14 (12)
[55]  
Yu Chushi, 2022, 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), P1738, DOI 10.1109/ICTC55196.2022.9952991
[56]   An effective CNN and Transformer complementary network for medical image segmentation [J].
Yuan, Feiniu ;
Zhang, Zhengxiao ;
Fang, Zhijun .
PATTERN RECOGNITION, 2023, 136
[57]   HCformer: Hybrid CNN-Transformer for LDCT Image Denoising [J].
Yuan, Jinli ;
Zhou, Feng ;
Guo, Zhitao ;
Li, Xiaozeng ;
Yu, Hengyong .
JOURNAL OF DIGITAL IMAGING, 2023, 36 (05) :2290-2305
[58]   An Advanced SAR Image Despeckling Method by Bernoulli-Sampling-Based Self-Supervised Deep Learning [J].
Yuan, Ye ;
Wu, Yanxia ;
Fu, Yan ;
Wu, Yulei ;
Zhang, Lidan ;
Jiang, Yan .
REMOTE SENSING, 2021, 13 (18)
[59]   Restormer: Efficient Transformer for High-Resolution Image Restoration [J].
Zamir, Syed Waqas ;
Arora, Aditya ;
Khan, Salman ;
Hayat, Munawar ;
Khan, Fahad Shahbaz ;
Yang, Ming-Hsuan .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5718-5729
[60]  
Zeyada H., 2022, Int J Intell Eng Syst, V15, P416