Multilayer Feature Fusion With Weight Adjustment Based on a Convolutional Neural Network for Remote Sensing Scene Classification

被引:18
作者
Ma, Chenhui [1 ]
Mu, Xiaodong [1 ]
Lin, Renpu [1 ]
Wang, Shuyang [1 ]
机构
[1] Xian Res Inst Hitech, Xian 710025, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Redundancy; Nonhomogeneous media; Fuses; Remote sensing; Semantics; Kernel; Convolutional neural network; feature fusion; remote sensing scene classification; weight adjustment;
D O I
10.1109/LGRS.2020.2970810
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remote sensing scene classification is still a challenging task. Extracting features effectively from restricted existing labeled data is key to scene classification. Convolutional neural networks (CNNs) are an effective method of constructing discriminating feature representation. However, CNNs usually utilize the feature map from the last layer and ignore additional layers with valuable feature information. In addition, the direct integration of multiple layers brings only a small improvement due to feature redundancy and destruction. To explore the potential information from additional layers and improve the effect of feature fusion, we propose multilayer feature fusion accesses with weight adjustment based on a CNN. We construct access to deliver additional features to one layer to achieve feature fusion and set weight factors to adjust the fusion degree to reduce feature redundancy and destruction. We perform experiments on two common data sets, which indicate improved accuracies and advantages of the extraction capability of our method.
引用
收藏
页码:241 / 245
页数:5
相关论文
共 20 条
[1]  
[Anonymous], 2014, Comput. Sci.
[2]  
[Anonymous], 2015, PROC JOINT URBAN REM
[3]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[4]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[5]   A semi-supervised generative framework with deep learning features for high-resolution remote sensing image scene classification [J].
Han, Wei ;
Feng, Ruyi ;
Wang, Lizhe ;
Cheng, Yafan .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 145 :23-43
[6]   Remote Sensing Scene Classification Using Multilayer Stacked Covariance Pooling [J].
He, Nanjun ;
Fang, Leyuan ;
Li, Shutao ;
Plaza, Antonio ;
Plaza, Javier .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (12) :6899-6910
[7]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[8]   Siamese Convolutional Neural Networks for Remote Sensing Scene Classification [J].
Liu, Xuning ;
Zhou, Yong ;
Zhao, Jiaqi ;
Yao, Rui ;
Liu, Bing ;
Zheng, Yi .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (08) :1200-1204
[9]   Scene Classification Based on Multiscale Convolutional Neural Network [J].
Liu, Yanfei ;
Zhong, Yanfei ;
Qin, Qianqing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (12) :7109-7121
[10]   Richer Convolutional Features for Edge Detection [J].
Liu, Yun ;
Cheng, Ming-Ming ;
Hu, Xiaowei ;
Wang, Kai ;
Bai, Xiang .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5872-5881