Explainable artificial intelligence: A survey of needs, techniques, applications, and future direction

被引:26
作者
Mersha, Melkamu [1 ]
Lam, Khang [2 ]
Wood, Joseph [1 ]
Alshami, Ali K. [1 ]
Kalita, Jugal [1 ]
机构
[1] Univ Colorado, Coll Engn & Appl Sci, Colorado Springs, CO 80918 USA
[2] Can Tho Univ, Coll Informat & Commun Technol, Can Tho 90000, Vietnam
关键词
XAI; Explainable artificial intelligence; Interpretable deep learning; Machine learning; Neural networks; Evaluation methods; Computer vision; Natural language processing; NLP; Transformers; Time series; Healthcare; Autonomous cars; BLACK-BOX; PREDICTION MODEL; LEARNING-MODELS; AI; XAI; INTERPRETABILITY; CLASSIFICATION; EXPLANATIONS; TRUSTWORTHY; DECISIONS;
D O I
10.1016/j.neucom.2024.128111
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial intelligence models encounter significant challenges due to their black-box nature, particularly in safety-critical domains such as healthcare, finance, and autonomous vehicles. Explainable Artificial Intelligence (XAI) addresses these challenges by providing explanations for how these models make decisions and predictions, ensuring transparency, accountability, and fairness. Existing studies have examined the fundamental concepts of XAI, its general principles, and the scope of XAI techniques. However, there remains a gap in the literature as there are no comprehensive reviews that delve into the detailed mathematical representations, design methodologies of XAI models, and other associated aspects. This paper provides a comprehensive literature review encompassing common terminologies and definitions, the need for XAI, beneficiaries of XAI, a taxonomy of XAI methods, and the application of XAI methods in different application areas. The survey is aimed at XAI researchers, XAI practitioners, AI model developers, and XAI beneficiaries who are interested in enhancing the trustworthiness, transparency, accountability, and fairness of their AI models.
引用
收藏
页数:25
相关论文
共 226 条
[71]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[72]  
Hedstrom A., 2023, Journal of Machine Learning Research, V24, P1
[73]   Collective eXplainable AI: Explaining Cooperative Strategies and Agent Contribution in Multiagent Reinforcement Learning With Shapley Values [J].
Heuillet, Alexandre ;
Couthouis, Fabien ;
Diaz-Rodriguez, Natalia .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2022, 17 (01) :59-71
[74]   Explainability in deep reinforcement learning [J].
Heuillet, Alexandre ;
Couthouis, Fabien ;
Diaz-Rodriguez, Natalia .
KNOWLEDGE-BASED SYSTEMS, 2021, 214 (214)
[75]   Explainable Software Analytics [J].
Hoa Khanh Dam ;
Truyen Tran ;
Ghose, Aditya .
2018 IEEE/ACM 40TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING: NEW IDEAS AND EMERGING TECHNOLOGIES RESULTS (ICSE-NIER), 2018, :53-56
[76]   User Trust in Intelligent Systems: A Journey Over Time [J].
Holliday, Daniel ;
Wilson, Stephanie ;
Stumpf, Simone .
PROCEEDINGS OF THE 21ST INTERNATIONAL CONFERENCE ON INTELLIGENT USER INTERFACES (IUI'16), 2016, :164-168
[77]   Causability and explainability of artificial intelligence in medicine [J].
Holzinger, Andreas ;
Langs, Georg ;
Denk, Helmut ;
Zatloukal, Kurt ;
Mueller, Heimo .
WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2019, 9 (04)
[78]   Physically explainable CNN for SAR image classification [J].
Huang, Zhongling ;
Yao, Xiwen ;
Liu, Ying ;
Dumitru, Corneliu Octavian ;
Datcu, Mihai ;
Han, Junwei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2022, 190 :25-37
[79]   Local and global explanations of agent behavior: Integrating strategy summaries with saliency maps [J].
Huber, Tobias ;
Weitz, Katharina ;
Andre, Elisabeth ;
Amir, Ofra .
ARTIFICIAL INTELLIGENCE, 2021, 301
[80]   Machine learning and artificial intelligence to aid climate change research and preparedness [J].
Huntingford, Chris ;
Jeffers, Elizabeth S. ;
Bonsall, Michael B. ;
Christensen, Hannah M. ;
Lees, Thomas ;
Yang, Hui .
ENVIRONMENTAL RESEARCH LETTERS, 2019, 14 (12)