Remote sensing image scene classification using CNN-MLP with data augmentation

被引:57
作者
Shawky, Osama A. [1 ]
Hagag, Ahmed [2 ]
El-Dahshan, El-Sayed A. [1 ,3 ]
Ismail, Manal A. [4 ]
机构
[1] Egyptian E Learning Univ, Fac Informat Technol, Giza 12611, Egypt
[2] Benha Univ, Fac Comp & Artificial Intelligence, Dept Sci Comp, Banha 13518, Egypt
[3] Ain Shams Univ, Fac Sci, Dept Phys, Cairo 11566, Egypt
[4] Helwan Univ, Fac Engn, Cairo 11731, Egypt
来源
OPTIK | 2020年 / 221卷
关键词
Convolutional neural network (CNN); Deep learning; Multilayer perceptron (MLP); Data augmentation; Scene classification; VHR image; NEURAL-NETWORKS; REPRESENTATION; COMPRESSION;
D O I
10.1016/j.ijleo.2020.165356
中图分类号
O43 [光学];
学科分类号
070207 ; 0803 ;
摘要
Classification of the very high-resolution (VHR) imagery scene has become a challenging problem. The convolutional neural network (CNN) has increased the accuracy in this area due to learning features. However, models based on CNN contain many deep layers for classifying images that are not perfect in describing the relationship between objects within the image. Therefore, an enhanced multilayer perceptron (MLP) depending on Adagrad optimizer is employed in the classification step in this paper as a deep classifier. Motivated by this idea, this paper proposes an effective classification model named CNN-MLP to utilize the benefits of these two techniques: CNN and MLP. The features are generated using pre-trained CNN without fully connected layers. Due to limited training images per class, the proposed model uses data augmentation techniques to expand the training images. Then, an MLP is used to classify the final feature maps into the specified classes. Three public remote sensing datasets of VHR images to evaluate the proposed CNN-MLP model: UC-Merced, Aerial Image (AID), and NWPU-RESISC45 datasets. The experiment's findings show that the proposed method will contribute to higher classification performance relative to state-of-the-art methods.
引用
收藏
页数:14
相关论文
共 48 条
[1]   Multiwavelength laser induced fluorescence (LIF) LIDAR system for remote detection and identification of oil spills [J].
Alaruri, Sami D. .
OPTIK, 2019, 181 :239-245
[2]   Regression Wavelet Analysis for Near-Lossless Remote Sensing Data Compression [J].
Alvarez-Cortes, Sara ;
Serra-Sagrista, Joan ;
Bartrina-Rapesta, Joan ;
Marcellin, Michael W. .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (02) :790-798
[3]  
[Anonymous], 2020, IEEE T INTELL TRANSP, DOI DOI 10.1109/TITS.2020.3017183
[4]  
[Anonymous], 2010, P 18 SIGSPATIAL INT
[5]   Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification [J].
Anwer, Rao Muhammad ;
Khan, Fahad Shahbaz ;
van de Weijer, Joost ;
Molinier, Matthieu ;
Laaksonen, Jorma .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 138 :74-85
[6]   Fusing Local and Global Features for High-Resolution Scene Classification [J].
Bian, Xiaoyong ;
Chen, Chen ;
Tian, Long ;
Du, Qian .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (06) :2889-2901
[7]  
Byju A.P., 2020, IEEE T GEOSCI REMOTE, P1
[8]   Deep Feature Fusion for VHR Remote Sensing Scene Classification [J].
Chaib, Souleyman ;
Liu, Huan ;
Gu, Yanfeng ;
Yao, Hongxun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2017, 55 (08) :4775-4784
[9]   Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities [J].
Cheng, Gong ;
Xie, Xingxing ;
Han, Junwei ;
Guo, Lei ;
Xia, Gui-Song .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :3735-3756
[10]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821