Improving satellite image classification accuracy using GAN-based data augmentation and vision transformers

被引:11
作者
Alzahem, Ayyub [1 ]
Boulila, Wadii [1 ,2 ]
Koubaa, Anis [1 ]
Khan, Zahid [1 ]
Alturki, Ibrahim [3 ]
机构
[1] Prince Sultan Univ, Robot & Internet Of Things Lab, Riyadh 12345, Saudi Arabia
[2] Univ Manouba, Natl Sch Comp Sci, RIADI Lab, Manouba 2010, Tunisia
[3] Taibah Univ, Coll Comp Sci & Engn, Medina 41477, Saudi Arabia
关键词
Generative Adversarial Network (GAN); vision transformers (ViT); data augmentation; satellite image classification;
D O I
10.1007/s12145-023-01153-x
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep learning (DL) algorithms have shown great potential in classifying satellite imagery but require large amounts of labeled data to make accurate predictions. However, generating large amounts of labeled data is time-consuming, costly, and can be problematic in the case of limited or imbalanced datasets. Data augmentation techniques have been proposed to improve the accuracy and robustness of DL models for satellite image classification. This paper presents a new approach to automated satellite data augmentation leveraging Generative Adversarial Networks (GANs) assisted with Vision Transformers (ViT) and evaluating its effectiveness on satellite image classification. The proposed approach is divided into two main steps: data augmentation using GAN-based transformers and satellite image classification. The GAN generates new images by learning the statistical distribution of the original images and generating new images that are similar to the original ones. ViT are used to learn the images' features and improve the classification task's accuracy. The performance of the proposed approach is evaluated through extensive experiments on real-world datasets. The proposed approach achieves an accuracy increase from 76.9% with traditional data augmentation to 98.7%. This is a significant improvement demonstrating the proposed approach's effectiveness in enhancing the accuracy of satellite image classification.
引用
收藏
页码:4169 / 4186
页数:18
相关论文
共 42 条
[1]  
Adedeji O., 2022, ARXIV
[2]   Towards Optimizing Malware Detection: An Approach Based on Generative Adversarial Networks and Transformers [J].
Alzahem, Ayyub ;
Boulila, Wadii ;
Driss, Maha ;
Koubaa, Anis ;
Almomani, Iman .
COMPUTATIONAL COLLECTIVE INTELLIGENCE, ICCCI 2022, 2022, 13501 :598-610
[3]  
[Anonymous], 2023, GENERATIVE ADVERSARI
[4]  
Boulila W., 2010, PROC CORIA, P35
[5]  
Boulila W., 2009, ICDM, V9, P222
[6]   Sensitivity analysis approach to model epistemic and aleatory imperfection: Application to Land Cover Change prediction model [J].
Boulila, Wadii ;
Ayadi, Zouhayra ;
Farah, Imed Riadh .
JOURNAL OF COMPUTATIONAL SCIENCE, 2017, 23 :58-70
[7]   Image Classification With Small Datasets: Overview and Benchmark [J].
Brigato, Lorenzo ;
Barz, Bjoern ;
Iocchi, Luca ;
Denzler, Joachim .
IEEE ACCESS, 2022, 10 :49233-49250
[8]   Enhancement of Image Classification Using Transfer Learning and GAN-Based Synthetic Data Augmentation [J].
Chatterjee, Subhajit ;
Hazra, Debapriya ;
Byun, Yung-Cheol ;
Kim, Yong-Woon .
MATHEMATICS, 2022, 10 (09)
[9]   Assessing the effects of convolutional neural network architectural factors on model performance for remote sensing image classification: An in-depth investigation [J].
Chen, Feihao ;
Tsou, Jin Yeu .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 112
[10]   CycleGAN-STF: Spatiotemporal Fusion via CycleGAN-Based Image Generation [J].
Chen, Jia ;
Wang, Lizhe ;
Feng, Ruyi ;
Liu, Peng ;
Han, Wei ;
Chen, Xiaodao .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07) :5851-5865