Optimal band selection using explainable artificial intelligence for machine learning-based hyperspectral image classification

被引:0
作者
Atik, Saziye Ozge [1 ]
Atik, Muhammed Enes [1 ]
机构
[1] Istanbul Tech Univ, Dept Geomat Engn, Fac Civil Engn, Maslak, Turkiye
关键词
hyperspectral image classification; explainable artificial intelligence; Shapley additive explanations; permutation feature importance; machine learning; feature selection; CONVOLUTIONAL NEURAL-NETWORK; FEATURE-EXTRACTION; PCA;
D O I
10.1117/1.JRS.18.042604
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Classification of complex and large hyperspectral images (HSIs) with machine learning (ML) algorithms is an important research area. Recently, explainable artificial intelligence (XAI), which helps to explain and interpret black-box ML algorithms, has become popular. Our study aims to present extensive research on the use of XAI methods in explaining the band effect in HSI classification and the impact of reducing the high band number of HSIs by feature selection on the performance of the classifiers. The importance levels of the spectral bands that are effective in the decisions of the different ML classifiers were examined with the deep reinforcement learning and XAI methods, such as Shapley additive explanations (SHAP) and permutation feature importance (PFI). Our work selects representative bands using SHAP and PFI as XAI analysis techniques. We evaluated the XAI-based band selection performance on three publicly available HSI datasets using random forest, light gradient-boosting machine, and extreme gradient boosting classifier algorithms. The results obtained by applying XAI and deep learning methods were used to select spectral bands. Additionally, principal component analysis, a common dimension reduction technique, was performed on the dataset used in our study. Comparable performance evaluation shows that XAI-based methods choose informative bands and outperform other methods in the subsequent tasks. Thus the global and class-based effects of spectral bands can be explained, and the performance of classifiers can be improved by eliminating features that have a negative impact on classification. In HSI classification, studies examining the decisions of ML classifiers using XAI techniques are limited. Our study is one of the pioneer studies in the usage of XAI in HSI classification.
引用
收藏
页数:30
相关论文
共 67 条
[41]   A Review on Random Forest: An Ensemble Classifier [J].
Parmar, Aakash ;
Katariya, Rakesh ;
Patel, Vatsal .
INTERNATIONAL CONFERENCE ON INTELLIGENT DATA COMMUNICATION TECHNOLOGIES AND INTERNET OF THINGS, ICICI 2018, 2019, 26 :758-763
[42]  
Pedregosa F, 2011, J MACH LEARN RES, V12, P2825
[43]   Discriminative Transfer Joint Matching for Domain Adaptation in Hyperspectral Image Classification [J].
Peng, Jiangtao ;
Sun, Weiwei ;
Ma, Li ;
Du, Qian .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (06) :972-976
[44]   Hyperspectral remote sensing in lithological mapping, mineral exploration, and environmental geology: an updated review [J].
Peyghambari, Sima ;
Zhang, Yun .
JOURNAL OF APPLIED REMOTE SENSING, 2021, 15 (03)
[45]   Individual tree segmentation and tree species classification in subtropical broadleaf forests using UAV-based LiDAR, hyperspectral, and ultrahigh-resolution RGB data [J].
Qin, Haiming ;
Zhou, Weiqi ;
Yao, Yang ;
Wang, Weimin .
REMOTE SENSING OF ENVIRONMENT, 2022, 280
[46]   Extending SC-PDSI-PM with neural network regression using GLDAS data and Permutation Feature Importance [J].
Ramirez, Saul G. ;
Hales, Riley Chad ;
Williams, Gustavious P. ;
Jones, Norman L. .
ENVIRONMENTAL MODELLING & SOFTWARE, 2022, 157
[47]   Deep neural networks-based relevant latent representation learning for hyperspectral image classification [J].
Sellami, Akrem ;
Tabbone, Salvatore .
PATTERN RECOGNITION, 2022, 121
[48]  
Shanthamallu Uday Shankar, 2022, Machine and Deep Learning Algorithms and Applications. Synthesis Lectures on Signal Processing, P1, DOI 10.1007/978-3-031-03758-0_1
[49]   Classifying Forest Type in the National Forest Inventory Context with Airborne Hyperspectral and Lidar Data [J].
Shoot, Caileigh ;
Andersen, Hans-Erik ;
Moskal, L. Monika ;
Babcock, Chad ;
Cook, Bruce D. ;
Morton, Douglas C. .
REMOTE SENSING, 2021, 13 (10)
[50]   Hyperspectral Band Selection A review [J].
Sun, Weiwei ;
Du, Qian .
IEEE GEOSCIENCE AND REMOTE SENSING MAGAZINE, 2019, 7 (02) :118-139