Remote Sensing Image Classification using Transfer Learning and Attention Based Deep Neural Network

被引:1
作者
Pham, Lam [1 ]
Tran, Khoa [2 ]
Ngo, Dat [3 ]
Lampert, Jasmin [1 ]
Schindler, Alexander [1 ]
机构
[1] Austrian Inst Technol, Ctr Digital Safety Secur, Seibersdorf, Austria
[2] Univ Danang, Univ Sci & Technol, Danang, Vietnam
[3] Univ Essex, Sch Comp Sci & Elect Engn, Colchester, England
来源
IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVIII | 2022年 / 12267卷
关键词
Convolutional Neural Network (CNN); Transfer Learning; Attention; Remote Sensing Image; Data Augmentation; LIGHTWEIGHT;
D O I
10.1117/12.2635320
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The task of remote sensing image scene classification (RSISC), which aims at classifying remote sensing images into groups of semantic categories based on their contents, has assumed an important role in a wide range of applications such as urban planning, natural hazards detection, environmental monitoring, vegetation mapping or geospatial object detection. During the past years, the research community focusing on RSISC tasks has shown significant effort to publish diverse datasets as well as to propose different approaches. Recently, almost all proposed RSISC systems are based on deep learning models, which proves powerful and outperform traditional approaches using image processing and machine learning. In this paper, we also leverage the power of deep learning technologies, evaluate a variety of deep neural network architectures and indicate main factors affecting the performance of a RSISC system. Given the comprehensive analysis, we propose a deep learning based framework for RSISC, which makes use of a transfer learning technique and a multihead attention scheme. The proposed deep learning framework is evaluated on the NWPU-RESISC45 benchmark dataset and achieves a classification accuracy of up to 92.6% and 94.7% with two official data split suggestions (10% and 20% of entire the NWPU-RESISC45 dataset for training). The achieved results are very competitive and show potential for real-life applications.
引用
收藏
页数:8
相关论文
共 27 条
[1]  
[Anonymous], 2015, KERAS LIB
[2]  
[Anonymous], 2010, P 27 INT C MACHINE
[3]   Simple Yet Effective Fine-Tuning of Deep CNNs Using an Auxiliary Classification Loss for Remote Sensing Scene Classification [J].
Bazi, Yakoub ;
Al Rahhal, Mohamad M. ;
Alhichri, Haikel ;
Alajlan, Naif .
REMOTE SENSING, 2019, 11 (24)
[4]   APDC-Net: Attention Pooling-Based Convolutional Network for Aerial Scene Classification [J].
Bi, Qi ;
Qin, Kun ;
Zhang, Han ;
Xie, Jiafen ;
Li, Zhili ;
Xu, Kai .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (09) :1603-1607
[5]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[6]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[7]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[8]   ON INFORMATION AND SUFFICIENCY [J].
KULLBACK, S ;
LEIBLER, RA .
ANNALS OF MATHEMATICAL STATISTICS, 1951, 22 (01) :79-86
[9]   Integrated visual vocabulary in latent Dirichlet allocation-based scene classification for IKONOS image [J].
Kusumaningrum, Retno ;
Wei, Hong ;
Manurung, Ruli ;
Murni, Aniati .
JOURNAL OF APPLIED REMOTE SENSING, 2014, 8
[10]   Hydra: An Ensemble of Convolutional Neural Networks for Geospatial Land Classification [J].
Minetto, Rodrigo ;
Segundo, Mauricio Pamplona ;
Sarkar, Sudeep .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (09) :6530-6541