Improving satellite image classification accuracy using GAN-based data augmentation and vision transformers

被引:11
作者
Alzahem, Ayyub [1 ]
Boulila, Wadii [1 ,2 ]
Koubaa, Anis [1 ]
Khan, Zahid [1 ]
Alturki, Ibrahim [3 ]
机构
[1] Prince Sultan Univ, Robot & Internet Of Things Lab, Riyadh 12345, Saudi Arabia
[2] Univ Manouba, Natl Sch Comp Sci, RIADI Lab, Manouba 2010, Tunisia
[3] Taibah Univ, Coll Comp Sci & Engn, Medina 41477, Saudi Arabia
关键词
Generative Adversarial Network (GAN); vision transformers (ViT); data augmentation; satellite image classification;
D O I
10.1007/s12145-023-01153-x
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Deep learning (DL) algorithms have shown great potential in classifying satellite imagery but require large amounts of labeled data to make accurate predictions. However, generating large amounts of labeled data is time-consuming, costly, and can be problematic in the case of limited or imbalanced datasets. Data augmentation techniques have been proposed to improve the accuracy and robustness of DL models for satellite image classification. This paper presents a new approach to automated satellite data augmentation leveraging Generative Adversarial Networks (GANs) assisted with Vision Transformers (ViT) and evaluating its effectiveness on satellite image classification. The proposed approach is divided into two main steps: data augmentation using GAN-based transformers and satellite image classification. The GAN generates new images by learning the statistical distribution of the original images and generating new images that are similar to the original ones. ViT are used to learn the images' features and improve the classification task's accuracy. The performance of the proposed approach is evaluated through extensive experiments on real-world datasets. The proposed approach achieves an accuracy increase from 76.9% with traditional data augmentation to 98.7%. This is a significant improvement demonstrating the proposed approach's effectiveness in enhancing the accuracy of satellite image classification.
引用
收藏
页码:4169 / 4186
页数:18
相关论文
共 42 条
[11]   Enhanced contextual representation with deep neural networks for land cover classification based on remote sensing images [J].
Cheng, Xijie ;
He, Xiaohui ;
Qiao, Mengjia ;
Li, Panle ;
Hu, Shaokai ;
Chang, Peng ;
Tian, Zhihui .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 107
[12]   A review of medical image data augmentation techniques for deep learning applications [J].
Chlap, Phillip ;
Min, Hang ;
Vandenberg, Nym ;
Dowling, Jason ;
Holloway, Lois ;
Haworth, Annette .
JOURNAL OF MEDICAL IMAGING AND RADIATION ONCOLOGY, 2021, 65 (05) :545-563
[13]   Generative Adversarial Networks An overview [J].
Creswell, Antonia ;
White, Tom ;
Dumoulin, Vincent ;
Arulkumaran, Kai ;
Sengupta, Biswa ;
Bharath, Anil A. .
IEEE SIGNAL PROCESSING MAGAZINE, 2018, 35 (01) :53-65
[14]   An octonion-based nonlinear echo state network for speech emotion recognition in Metaverse [J].
Daneshfar, Fatemeh ;
Jamshidi, Mohammad .
NEURAL NETWORKS, 2023, 163 :108-121
[15]   Current trends in deep learning for Earth Observation: An open-source benchmark arena for image classification [J].
Dimitrovski, Ivica ;
Kitanovski, Ivan ;
Kocev, Dragi ;
Simidjievski, Nikola .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2023, 197 :18-35
[16]   Intelligent Rider Optimization Algorithm with Deep Learning Enabled Hyperspectral Remote Sensing Imaging Classification [J].
Dutta, Ashit Kumar ;
Alsanea, Majed ;
Qureshi, Basit ;
Alghayadh, Faisal Yousef ;
Sait, Abdul Rahaman Wahab .
CANADIAN JOURNAL OF REMOTE SENSING, 2022, 48 (05) :649-662
[17]   Reducing uncertainties in land cover change models using sensitivity analysis [J].
Ferchichi, Ahlem ;
Boulila, Wadii ;
Farah, Imed Riadh .
KNOWLEDGE AND INFORMATION SYSTEMS, 2018, 55 (03) :719-740
[18]   Propagating aleatory and epistemic uncertainty in land cover change prediction process [J].
Ferchichi, Ahlem ;
Boulila, Wadii ;
Farah, Imed Riadh .
ECOLOGICAL INFORMATICS, 2017, 37 :24-37
[19]  
Frid-Adar M, 2018, I S BIOMED IMAGING, P289, DOI 10.1109/ISBI.2018.8363576
[20]   Generative Adversarial Networks [J].
Goodfellow, Ian ;
Pouget-Abadie, Jean ;
Mirza, Mehdi ;
Xu, Bing ;
Warde-Farley, David ;
Ozair, Sherjil ;
Courville, Aaron ;
Bengio, Yoshua .
COMMUNICATIONS OF THE ACM, 2020, 63 (11) :139-144