RETRACTED: Attention-Based Deep Feature Fusion for the Scene Classification of High-Resolution Remote Sensing Images (Retracted Article)

被引:19
作者
Zhu, Ruixi [1 ]
Yan, Li [1 ]
Mo, Nan [1 ]
Liu, Yi [1 ]
机构
[1] Wuhan Univ, Sch Geodesy & Geomat, 129 Luoyu Rd, Wuhan 430079, Hubei, Peoples R China
关键词
remote sensing; scene classification; attention maps; multiplicative fusion of deep feature; center loss; CONVOLUTIONAL NEURAL-NETWORKS; LEARNING FRAMEWORK; REPRESENTATION;
D O I
10.3390/rs11171996
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Scene classification of high-resolution remote sensing images (HRRSI) is one of the most important means of land-cover classification. Deep learning techniques, especially the convolutional neural network (CNN) have been widely applied to the scene classification of HRRSI due to the advancement of graphic processing units (GPU). However, they tend to extract features from the whole images rather than discriminative regions. The visual attention mechanism can force the CNN to focus on discriminative regions, but it may suffer from the influence of intra-class diversity and repeated texture. Motivated by these problems, we propose an attention-based deep feature fusion (ADFF) framework that constitutes three parts, namely attention maps generated by Gradient-weighted Class Activation Mapping (Grad-CAM), a multiplicative fusion of deep features and the center-based cross-entropy loss function. First of all, we propose to make attention maps generated by Grad-CAM as an explicit input in order to force the network to concentrate on discriminative regions. Then, deep features derived from original images and attention maps are proposed to be fused by multiplicative fusion in order to consider both improved abilities to distinguish scenes of repeated texture and the salient regions. Finally, the center-based cross-entropy loss function that utilizes both the cross-entropy loss and center loss function is proposed to backpropagate fused features so as to reduce the effect of intra-class diversity on feature representations. The proposed ADFF architecture is tested on three benchmark datasets to show its performance in scene classification. The experiments confirm that the proposed method outperforms most competitive scene classification methods with an average overall accuracy of 94% under different training ratios.
引用
收藏
页数:23
相关论文
共 67 条
[1]   Softsense: Sensing at Software Level [J].
Ahmed, Nova ;
Syrus, Minhaz Ahmed ;
Chowdhury, Arshad M. .
UBICOMP'16 ADJUNCT: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, 2016, :1-4
[2]   Learning a Multi-Branch Neural Network from Multiple Sources for Knowledge Adaptation in Remote Sensing Imagery [J].
Al Rahhal, Mohamad M. ;
Bazi, Yakoub ;
Abdullah, Taghreed ;
Mekhalfi, Mohamed L. ;
AlHichri, Haikel ;
Zuair, Mansour .
REMOTE SENSING, 2018, 10 (12)
[3]  
[Anonymous], P 3 INT C LEARNING R
[4]  
[Anonymous], PROC CVPR IEEE
[5]  
[Anonymous], 2017, P IEEE, DOI DOI 10.1109/JPROC.2017.2675998
[6]   Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification [J].
Anwer, Rao Muhammad ;
Khan, Fahad Shahbaz ;
van de Weijer, Joost ;
Molinier, Matthieu ;
Laaksonen, Jorma .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 138 :74-85
[7]   SmokeNet: Satellite Smoke Scene Detection Using Convolutional Neural Network with Spatial and Channel-Wise Attention [J].
Ba, Rui ;
Chen, Chen ;
Yuan, Jing ;
Song, Weiguo ;
Lo, Siuming .
REMOTE SENSING, 2019, 11 (14)
[8]   Building Development Monitoring in Multitemporal Remotely Sensed Image Pairs with Stochastic Birth-Death Dynamics [J].
Benedek, Csaba ;
Descombes, Xavier ;
Zerubia, Josiane .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (01) :33-50
[9]   Fusing Local and Global Features for High-Resolution Scene Classification [J].
Bian, Xiaoyong ;
Chen, Chen ;
Tian, Long ;
Du, Qian .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (06) :2889-2901
[10]   Deep Heterogeneous Feature Fusion for Template-Based Face Recognition [J].
Bodla, Navaneeth ;
Zheng, Jingxiao ;
Xu, Hongyu ;
Chen, Jun-Cheng ;
Castillo, Carlos ;
Chellappa, Rama .
2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, :586-595