Optimal band selection using explainable artificial intelligence for machine learning-based hyperspectral image classification

被引:0
作者
Atik, Saziye Ozge [1 ]
Atik, Muhammed Enes [1 ]
机构
[1] Istanbul Tech Univ, Dept Geomat Engn, Fac Civil Engn, Maslak, Turkiye
关键词
hyperspectral image classification; explainable artificial intelligence; Shapley additive explanations; permutation feature importance; machine learning; feature selection; CONVOLUTIONAL NEURAL-NETWORK; FEATURE-EXTRACTION; PCA;
D O I
10.1117/1.JRS.18.042604
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Classification of complex and large hyperspectral images (HSIs) with machine learning (ML) algorithms is an important research area. Recently, explainable artificial intelligence (XAI), which helps to explain and interpret black-box ML algorithms, has become popular. Our study aims to present extensive research on the use of XAI methods in explaining the band effect in HSI classification and the impact of reducing the high band number of HSIs by feature selection on the performance of the classifiers. The importance levels of the spectral bands that are effective in the decisions of the different ML classifiers were examined with the deep reinforcement learning and XAI methods, such as Shapley additive explanations (SHAP) and permutation feature importance (PFI). Our work selects representative bands using SHAP and PFI as XAI analysis techniques. We evaluated the XAI-based band selection performance on three publicly available HSI datasets using random forest, light gradient-boosting machine, and extreme gradient boosting classifier algorithms. The results obtained by applying XAI and deep learning methods were used to select spectral bands. Additionally, principal component analysis, a common dimension reduction technique, was performed on the dataset used in our study. Comparable performance evaluation shows that XAI-based methods choose informative bands and outperform other methods in the subsequent tasks. Thus the global and class-based effects of spectral bands can be explained, and the performance of classifiers can be improved by eliminating features that have a negative impact on classification. In HSI classification, studies examining the decisions of ML classifiers using XAI techniques are limited. Our study is one of the pioneer studies in the usage of XAI in HSI classification.
引用
收藏
页数:30
相关论文
共 67 条
[21]   Comparison of CNN Algorithms on Hyperspectral Image Classification in Agricultural Lands [J].
Hsieh, Tien-Heng ;
Kiang, Jean-Fu .
SENSORS, 2020, 20 (06)
[22]   Graph Embedding and Distribution Alignment for Domain Adaptation in Hyperspectral Image Classification [J].
Huang, Yi ;
Peng, Jiangtao ;
Ning, Yujie ;
Sun, Weiwei ;
Du, Qian .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :7654-7666
[23]   SuperPCA: A Superpixelwise PCA Approach for Unsupervised Feature Extraction of Hyperspectral Imagery [J].
Jiang, Junjun ;
Ma, Jiayi ;
Chen, Chen ;
Wang, Zhongyuan ;
Cai, Zhihua ;
Wang, Lizhe .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (08) :4581-4593
[24]   High-Resolution Mangrove Forests Classification with Machine Learning Using Worldview and UAV Hyperspectral Data [J].
Jiang, Yufeng ;
Zhang, Li ;
Yan, Min ;
Qi, Jianguo ;
Fu, Tianmeng ;
Fan, Shunxiang ;
Chen, Bowei .
REMOTE SENSING, 2021, 13 (08)
[25]   Investigation of feature contribution to shield tunneling-induced settlement using Shapley additive explanations method [J].
Kannangara, K. K. Pabodha M. ;
Zhou, Wanhuan ;
Ding, Zhi ;
Hong, Zhehao .
JOURNAL OF ROCK MECHANICS AND GEOTECHNICAL ENGINEERING, 2022, 14 (04) :1052-1063
[26]   Effects of auxiliary and ancillary data on LULC classification in a heterogeneous environment using optimized random forest algorithm [J].
Kavzoglu, Taskin ;
Bilucan, Furkan .
EARTH SCIENCE INFORMATICS, 2023, 16 (01) :415-435
[27]   Predictive Performances of Ensemble Machine Learning Algorithms in Landslide Susceptibility Mapping Using Random Forest, Extreme Gradient Boosting (XGBoost) and Natural Gradient Boosting (NGBoost) [J].
Kavzoglu, Taskin ;
Teke, Alihan .
ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2022, 47 (06) :7367-7385
[28]  
Ke GL, 2017, ADV NEUR IN, V30
[29]   A systematic review on hyperspectral imaging technology with a machine and deep learning methodology for agricultural applications [J].
Khan, Atiya ;
Vibhute, Amol D. ;
Mali, Shankar ;
Patil, C. H. .
ECOLOGICAL INFORMATICS, 2022, 69
[30]   Hyperspectral and Lidar Data Applied to the Urban Land Cover Machine Learning and Neural-Network-Based Classification: A Review [J].
Kuras, Agnieszka ;
Brell, Maximilian ;
Rizzi, Jonathan ;
Burud, Ingunn .
REMOTE SENSING, 2021, 13 (17)