Improving satellite image classification accuracy using GAN-based data augmentation and vision transformers

被引:11
作者
Alzahem, Ayyub [1 ]
Boulila, Wadii [1 ,2 ]
Koubaa, Anis [1 ]
Khan, Zahid [1 ]
Alturki, Ibrahim [3 ]
机构
[1] Prince Sultan Univ, Robot & Internet Of Things Lab, Riyadh 12345, Saudi Arabia
[2] Univ Manouba, Natl Sch Comp Sci, RIADI Lab, Manouba 2010, Tunisia
[3] Taibah Univ, Coll Comp Sci & Engn, Medina 41477, Saudi Arabia
关键词
Generative Adversarial Network (GAN); vision transformers (ViT); data augmentation; satellite image classification;
D O I
10.1007/s12145-023-01153-x
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep learning (DL) algorithms have shown great potential in classifying satellite imagery but require large amounts of labeled data to make accurate predictions. However, generating large amounts of labeled data is time-consuming, costly, and can be problematic in the case of limited or imbalanced datasets. Data augmentation techniques have been proposed to improve the accuracy and robustness of DL models for satellite image classification. This paper presents a new approach to automated satellite data augmentation leveraging Generative Adversarial Networks (GANs) assisted with Vision Transformers (ViT) and evaluating its effectiveness on satellite image classification. The proposed approach is divided into two main steps: data augmentation using GAN-based transformers and satellite image classification. The GAN generates new images by learning the statistical distribution of the original images and generating new images that are similar to the original ones. ViT are used to learn the images' features and improve the classification task's accuracy. The performance of the proposed approach is evaluated through extensive experiments on real-world datasets. The proposed approach achieves an accuracy increase from 76.9% with traditional data augmentation to 98.7%. This is a significant improvement demonstrating the proposed approach's effectiveness in enhancing the accuracy of satellite image classification.
引用
收藏
页码:4169 / 4186
页数:18
相关论文
共 42 条
[31]   Generative adversarial networks (GANs) for image augmentation in agriculture: A systematic review [J].
Lu, Yuzhen ;
Chen, Dong ;
Olaniyi, Ebenezer ;
Huang, Yanbo .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2022, 200
[32]  
Mariani G., 2018, ARXIV
[33]  
Mikolajczyk Agnieszka, 2018, 2018 International Interdisciplinary PhD Workshop (IIPhDW), P117, DOI 10.1109/IIPHDW.2018.8388338
[34]  
Mirza M., 2014, CoRR
[35]   Image Retrieval Using Convolutional Autoencoder, InfoGAN, and Vision Transformer Unsupervised Models [J].
Sabry, Eman S. ;
Elagooz, Salah S. ;
Abd El-Samie, Fathi E. ;
El-Shafai, Walid ;
El-Bahnasawy, Nirmeen A. ;
El-Banby, Ghada M. ;
Algarni, Abeer D. ;
Soliman, Naglaa F. ;
Ramadan, Rabie A. .
IEEE ACCESS, 2023, 11 :20445-20477
[36]   A survey on Image Data Augmentation for Deep Learning [J].
Shorten, Connor ;
Khoshgoftaar, Taghi M. .
JOURNAL OF BIG DATA, 2019, 6 (01)
[37]   Land-Use Land-Cover Classification by Machine Learning Classifiers for Satellite Observations-A Review [J].
Talukdar, Swapan ;
Singha, Pankaj ;
Mahato, Susanta ;
Shahfahad ;
Pal, Swades ;
Liou, Yuei-An ;
Rahman, Atiqur .
REMOTE SENSING, 2020, 12 (07)
[38]  
Tarasiou M, 2023, ARXIV
[39]   On Data Augmentation for GAN Training [J].
Tran, Ngoc-Trung ;
Tran, Viet-Hung ;
Nguyen, Ngoc-Bao ;
Nguyen, Trung-Kien ;
Cheung, Ngai-Man .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :1882-1897
[40]   Hyperspectral image classification on insufficient-sample and feature learning using deep neural networks: A review [J].
Wambugu, Naftaly ;
Chen, Yiping ;
Xiao, Zhenlong ;
Tan, Kun ;
Wei, Mingqiang ;
Liu, Xiaoxue ;
Li, Jonathan .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 105