A self-attention multi-scale convolutional neural network method for SAR image despeckling

被引:8
作者
Wen, Zhiqing [1 ,2 ,3 ]
He, Yi [1 ,2 ,3 ,4 ]
Yao, Sheng [1 ,2 ,3 ]
Yang, Wang [1 ,2 ,3 ]
Zhang, Lifeng [1 ,2 ,3 ]
机构
[1] Lanzhou Jiaotong Univ, Fac Geomat, Lanzhou, Peoples R China
[2] Lanzhou Jiaotong Univ, Natl Local Joint Engn Res Ctr Technol & Applicat N, Lanzhou, Peoples R China
[3] Lanzhou Jiaotong Univ, Gansu Prov Engn Lab Natl Geog State Monitoring, Lanzhou, Peoples R China
[4] Lanzhou Jiaotong Univ, Fac Geomat, Duxing Bldg, 88 Anning West Rd, Lanzhou 1513, Peoples R China
关键词
Convolutional neural network; attention mechanism; multi-scale features; SAR image despeckling; QUALITY ASSESSMENT; WAVELET ENERGY; DEEP CNN; SEGMENTATION; NOISE; MODEL;
D O I
10.1080/01431161.2023.2173029
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The speckle noise found in synthetic aperture radar (SAR) images severely affects the efficiency of image interpretation, retrieval and other applications. Thus, effective methods for despeckling SAR image are required. The traditional methods for SAR image despeckling fail to balance in terms of the relationship between the intensity of speckle noise filtering and the retention of texture details. Deep learning based SAR image despeckling methods have been shown to have the potential to achieve this balance. Therefore, this study proposes a self-attention multi-scale convolution neural network (SAMSCNN) method for SAR image despeckling. The advantage of the SAMSCNN method is that it considers both multi-scale feature extraction and channel attention mechanisms for multi-scale fused features. In the SAMSCNN method, multi-scale features are extracted from SAR images through convolution layers with different depths. These are concatenated; then, and an attention mechanism is introduced to assign different weights to features of different scales, obtaining multi-scale fused features with weights. Finally, the despeckled SAR image is generated through global residual noise reduction and image structure fine-tuning. The despeckling experiments in this study involved a variety of scenes using simulated and real data. The performance of the proposed model was analysed using quantitative and qualitative evaluation methods and compared to probabilistic patch-based (PPB), SAR block-matching 3-D (SAR-BM3D) and SAR-CNN methods. The experimental results show that the method proposed in this paper improves the objective indexes and shows great advantages in visual effects compared to these classical methods. The method proposed in this study can provide key technical support for the practical application of SAR images.
引用
收藏
页码:902 / 923
页数:22
相关论文
共 41 条
[1]   Osdes_net: oil spill detection based on efficient_shuffle network using synthetic aperture radar imagery [J].
Aghaei, Nastaran ;
Akbarizadeh, Gholamreza ;
Kosarian, Abdolnabi .
GEOCARTO INTERNATIONAL, 2022, 37 (26) :13539-13560
[2]   Iris tissue recognition based on GLDM feature extraction and hybrid MLPNN-ICA classifier [J].
Ahmadi, Neda ;
Akbarizadeh, Gholamreza .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (07) :2267-2281
[3]   A New Statistical-Based Kurtosis Wavelet Energy Feature for Texture Recognition of SAR Images [J].
Akbarizadeh, Gholamreza .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2012, 50 (11) :4358-4368
[4]   A New Region-Based Active Contour Model with Skewness Wavelet Energy for Segmentation of SAR Images [J].
Akbarizadeh, Gholamreza ;
Rezai-Rad, Gholam Ali ;
Shokouhi, Shahriar Baradaran .
IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2010, E93D (07) :1690-1699
[5]   Speckle removal from SAR images in the undecimated wavelet domain [J].
Argenti, F ;
Alparone, L .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2002, 40 (11) :2363-2374
[6]   A non-local algorithm for image denoising [J].
Buades, A ;
Coll, B ;
Morel, JM .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 2, PROCEEDINGS, 2005, :60-65
[7]   A Unified Multi-scale Deep Convolutional Neural Network for Fast Object Detection [J].
Cai, Zhaowei ;
Fan, Quanfu ;
Feris, Rogerio S. ;
Vasconcelos, Nuno .
COMPUTER VISION - ECCV 2016, PT IV, 2016, 9908 :354-370
[8]   Prediction of InSAR deformation time-series using a long short-term memory neural network [J].
Chen, Yi ;
He, Yi ;
Zhang, Lifeng ;
Chen, Youdong ;
Pu, Hongyu ;
Chen, Baoshan ;
Gao, Liya .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2021, 42 (18) :6921-6944
[9]  
Chierchia G, 2017, INT GEOSCI REMOTE SE, P5438, DOI 10.1109/IGARSS.2017.8128234
[10]   Image denoising by sparse 3-D transform-domain collaborative filtering [J].
Dabov, Kostadin ;
Foi, Alessandro ;
Katkovnik, Vladimir ;
Egiazarian, Karen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2007, 16 (08) :2080-2095