Remote sensing scene image classification model based on multi-scale features and attention mechanism

被引:3
作者
Wang, Guowei [1 ]
Xu, Haixia [1 ]
Wang, Xinyu [1 ]
Yuan, Liming [1 ]
Wen, Xianbin [1 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Key Lab Comp Vis & Syst, Minist Educ, Tianjin, Peoples R China
关键词
remote scene; scene classification; convolutional neural network; multi-scale feature fusion; attention mechanism; LAND-USE; BENCHMARK; NETWORKS;
D O I
10.1117/1.JRS.16.044510
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Remote sensing scene classification has received more and more attention as important fundamental research in recent years. However, the redundant background information and complex spatial scale variability of remote sensing scene images make the existing convolutional neural network models, which mainly concentrate on global features, perform poorly. To effectively alleviate these problems, we proposed an MSRes-SplitNet model based on multiscale features and attention mechanisms for remote sensing scene image classification. First, MSRes blocks are constructed for the extraction of multi-scale features. Then, the multi-channel local features are fused by the Split-Attention block. Finally, the global and local feature information is aggregated by convolution, thus obtaining multi-scale features while alleviating the smallsample learning problem. Experiments are conducted on three publicly available datasets and compared with other state-of-the-art methods, showing that the proposed method MSRes-SplitNet has better performance while effectively reducing a large number of parameters. (c) 2022 Society of Photo-Optical Instrumentation Engineers (SPIE)
引用
收藏
页数:22
相关论文
共 56 条
[1]  
Blei DM, 2002, ADV NEUR IN, V14, P601
[2]   Fusing Deep Features by Kernel Collaborative Representation for Remote Sensing Scene Classification [J].
Chen, Xiaoning ;
Ma, Mingyang ;
Li, Yong ;
Cheng, Wei .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :12429-12439
[3]   An Improved Pretraining Strategy-Based Scene Classification With Deep Learning [J].
Chen, Zongli ;
Wang, Yiyue ;
Han, Wei ;
Feng, Ruyi ;
Chen, Jia .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (05) :844-848
[4]   Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities [J].
Cheng, Gong ;
Xie, Xingxing ;
Han, Junwei ;
Guo, Lei ;
Xia, Gui-Song .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :3735-3756
[5]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[6]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[7]   Multi-class geospatial object detection and geographic image classification based on collection of part detectors [J].
Cheng, Gong ;
Han, Junwei ;
Zhou, Peicheng ;
Guo, Lei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2014, 98 :119-132
[8]  
Fan RY, 2019, INT GEOSCI REMOTE SE, P1346, DOI [10.1109/igarss.2019.8900199, 10.1109/IGARSS.2019.8900199]
[9]   Semi-Supervised Deep Learning Classification for Hyperspectral Image Based on Dual-Strategy Sample Selection [J].
Fang, Bei ;
Li, Ying ;
Zhang, Haokui ;
Chan, Jonathan Cheung-Wai .
REMOTE SENSING, 2018, 10 (04)
[10]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662