A Lightweight and Robust Lie Group-Convolutional Neural Networks Joint Representation for Remote Sensing Scene Classification

被引:37
作者
Xu, Chengjun [1 ]
Zhu, Guobin [1 ]
Shu, Jingqian [2 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] Nanchang Univ, Coll Sci & Technol, Nanchang 330031, Jiangxi, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
关键词
Feature extraction; Remote sensing; Image decomposition; Deep learning; Manifolds; Covariance matrices; Visualization; Convolutional neural network (CNN); joint representation; lie group; lie group region covariance; remote sensing scene classification; REGION COVARIANCE; RECOGNITION; HISTOGRAMS; EXTRACTION; IMAGES; MODEL;
D O I
10.1109/TGRS.2020.3048024
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The existing convolutional neural network (CNN) models have shown excellent performance in remote sensing scene classification. However, the structure of such models is becoming more and more complex, and the learning of low-level features is difficult to interpret. To address this problem, in this study, we introduce lie group machine learning into the CNN model, try to combine both approaches to extract more distinguishing ability and effective features, and propose a novel network model, namely, the lie group regional influence network (LGRIN). First, manifold space samples of the lie group are obtained by mapping, and then, the features of the lie group are extracted after the operations of image decomposition and integral image calculation. Second, the multidilation pooling is integrated into the CNN architecture. At the same time, the image regional influence network module is designed to guide the attention of the classification model by using the regional-level supervision of the decomposition. Finally, the fusion features are classified, and the predicted results are obtained. Our model takes full advantage of regional influence, lie group kernel function, and lie group feature learning. Moreover, our model produces satisfactory performance on three public and challenging data sets: Aerial Image Dataset (AID), UC Merced, and NWPU-RESISC45. The experimental results verify that, compared with the state-of-the-art methods, this method is more explanatory and achieves higher accuracy.
引用
收藏
页数:15
相关论文
共 101 条
[1]  
[Anonymous], 2012, MATRIX GROUPS INTRO
[2]   Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification [J].
Anwer, Rao Muhammad ;
Khan, Fahad Shahbaz ;
van de Weijer, Joost ;
Molinier, Matthieu ;
Laaksonen, Jorma .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 138 :74-85
[3]  
Aral RA, 2018, IEEE INT CONF BIG DA, P2058, DOI 10.1109/BigData.2018.8622212
[4]   Local Primitive Pattern for the Classification of SAR Images [J].
Aytekin, Orsan ;
Koc, Mehmet ;
Ulusoy, Ilkay .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2013, 51 (04) :2431-2441
[5]   AN INVESTIGATION OF THE TEXTURAL CHARACTERISTICS ASSOCIATED WITH GRAY-LEVEL COOCCURRENCE MATRIX STATISTICAL PARAMETERS [J].
BARALDI, A ;
PARMIGGIANI, F .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 1995, 33 (02) :293-304
[6]   Efficient local-region approach for high-resolution remote-sensing image retrieval and classification [J].
Bouteldja, Samia ;
Kourgli, Assia ;
Aissa, Aichouche Belhadj .
JOURNAL OF APPLIED REMOTE SENSING, 2019, 13 (01)
[7]   Deep Feature Fusion for VHR Remote Sensing Scene Classification [J].
Chaib, Souleyman ;
Liu, Huan ;
Gu, Yanfeng ;
Yao, Hongxun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (08) :4775-4784
[8]   Pyramid of Spatial Relatons for Scene-Level Land Use Classification [J].
Chen, Shizhi ;
Tian, YingLi .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (04) :1947-1957
[9]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[10]   Remote Sensing Image Scene Classification Using Bag of Convolutional Features [J].
Cheng, Gong ;
Li, Zhenpeng ;
Yao, Xiwen ;
Guo, Lei ;
Wei, Zhongliang .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2017, 14 (10) :1735-1739