A Deep Neural Network Combined With Context Features for Remote Sensing Scene Classification

被引:14
作者
Deng, Peifang [1 ]
Huang, Hong [1 ]
Xu, Kejie [1 ]
机构
[1] Chongqing Univ, Key Lab Optoelect Technol & Syst, Educ Minist China, Chongqing 400044, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Logic gates; Neural networks; Remote sensing; Image sequences; Spatial resolution; Nonhomogeneous media; Context features; convolutional neural network (CNN); deep transfer learning; high spatial resolution (HSR) images; remote sensing (RS) scene classification; FEATURE-EXTRACTION; REPRESENTATION;
D O I
10.1109/LGRS.2020.3016769
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Scene classification is an important research topic in the field of remote sensing (RS), and deep features from convolutional neural networks (CNNs) have shown good classification performance. However, a key issue is how to effectively combine context features for further improving classification accuracy. In this letter, an end-to-end framework termed deep neural network combined with context features (CFDNN) is proposed for scene classification. At first, the pretrained VGG-16 is transferred as feature extractor to obtain convolutional features. Then, two parallel modules, global average pooling (GAP) and long short-term memory (LSTM), are employed to extract global features and context features, respectively. Finally, a weighted concatenation method is introduced to combine the global and context features. As a result, the CFDNN method can adapt high spatial resolution (HSR) images with arbitrary size and obtain satisfactory classification accuracy. The experimental results on the aerial image data set (AID) demonstrate that the proposed CFDNN method has competitive classification performance compared with some state-of-the-art methods.
引用
收藏
页数:5
相关论文
共 34 条
[1]   Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification [J].
Anwer, Rao Muhammad ;
Khan, Fahad Shahbaz ;
van de Weijer, Joost ;
Molinier, Matthieu ;
Laaksonen, Jorma .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 138 :74-85
[2]   Fusing Local and Global Features for High-Resolution Scene Classification [J].
Bian, Xiaoyong ;
Chen, Chen ;
Tian, Long ;
Du, Qian .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (06) :2889-2901
[3]   Deep Feature Fusion for VHR Remote Sensing Scene Classification [J].
Chaib, Souleyman ;
Liu, Huan ;
Gu, Yanfeng ;
Yao, Hongxun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (08) :4775-4784
[4]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[5]   Remote Sensing Image Scene Classification Using Bag of Convolutional Features [J].
Cheng, Gong ;
Li, Zhenpeng ;
Yao, Xiwen ;
Guo, Lei ;
Wei, Zhongliang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (10) :1735-1739
[6]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[7]   Random Forest and Rotation Forest for fully polarized SAR image classification using polarimetric and spatial features [J].
Du, Peijun ;
Samat, Alim ;
Waske, Bjoern ;
Liu, Sicong ;
Li, Zhenhong .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2015, 105 :38-53
[8]   Robust Space-Frequency Joint Representation for Remote Sensing Image Scene Classification [J].
Fang, Jie ;
Yuan, Yuan ;
Lu, Xiaoqiang ;
Feng, Yachuang .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (10) :7492-7502
[9]   Remote Sensing Scene Classification Using Multilayer Stacked Covariance Pooling [J].
He, Nanjun ;
Fang, Leyuan ;
Li, Shutao ;
Plaza, Antonio ;
Plaza, Javier .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (12) :6899-6910
[10]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.8.1735, 10.1162/neco.1997.9.1.1, 10.1007/978-3-642-24797-2]