Explainable AI for Cyber-Physical Systems: Issues and Challenges

被引:8
作者
Hoenig, Amber [1 ]
Roy, Kaushik [2 ]
Acquaah, Yaa Takyiwaa [2 ]
Yi, Sun [3 ]
Desai, Salil S. [4 ,5 ]
机构
[1] North Carolina Agr & Tech State Univ, Dept Computat Data Sci & Engn, Greensboro, NC 27411 USA
[2] North Carolina Agr & Tech State Univ, Dept Comp Sci, Greensboro, NC 27411 USA
[3] North Carolina Agr & Tech State Univ, Dept Mech Engn, Greensboro, NC 27411 USA
[4] North Carolina Agr & Tech State Univ, Dept Ind & Syst Engn, Greensboro, NC 27411 USA
[5] North Carolina Agr & Tech State Univ, Ctr Excellence Prod Design & Adv Mfg, Greensboro, NC 27411 USA
关键词
Artificial intelligence; Cyber-physical systems; Explainable AI; Biological system modeling; Reviews; Safety; Computer security; Fifth Industrial Revolution; Cyber-physical systems (CPS); cyber-resilience; cybersecurity; explainable artificial intelligence (XAI); industrial CPS; Industry; 5.0; ARTIFICIAL-INTELLIGENCE; INTRUSION DETECTION; FUTURE;
D O I
10.1109/ACCESS.2024.3395444
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence and cyber-physical systems (CPS) are two of the key technologies of the future that are enabling major global shifts. However, most of the current implementations of AI in CPS are not explainable, which creates serious problems in ethical, legal, regulatory, and other domains. Therefore, it is necessary for explainable artificial intelligence (XAI) to be integrated with cyber-physical systems to meet the vital needs for control, fairness, accountability, safety, cyber-resilience, and cybersecurity. The goal of this review is to demonstrate the need, benefits, challenges, and implementation of XAI for CPS. We review the existing literature about XAI and CPS, discuss the current state of the art, examine applications in different domains, and make recommendations for future research directions. To the best of our knowledge, this is the first peer-reviewed academic article to provide a comprehensive review of general XAI for CPS. We also contribute new research ideas including development of multisensory explanations and outputs for these systems, application of XAI to CPS to decrease occupational burnout and increase employee engagement, and enumeration of the multidisciplinary goals and benefits of XAI as applied to cyber-physical systems.
引用
收藏
页码:73113 / 73140
页数:28
相关论文
共 78 条
[1]   Explainable artificial intelligence (XAI) for interpreting the contributing factors feed into the wildfire susceptibility prediction model [J].
Abdollahi, Arnick ;
Pradhan, Biswajeet .
SCIENCE OF THE TOTAL ENVIRONMENT, 2023, 879
[2]   A Novel IoT-Based Explainable Deep Learning Framework for Intrusion Detection Systems [J].
El Houda Z.A. ;
Brik B. ;
Senouci S.-M. .
IEEE Internet of Things Magazine, 2022, 5 (02) :20-23
[3]   From Artificial Intelligence to Explainable Artificial Intelligence in Industry 4.0: A Survey on What, How, and Where [J].
Ahmed, Imran ;
Jeon, Gwanggil ;
Piccialli, Francesco .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (08) :5031-5042
[4]   Sentence subjectivity analysis of a political and ideological debate dataset using LSTM and BiLSTM with attention and GRU models [J].
Al Hamoud, Ahmed ;
Hoenig, Amber ;
Roy, Kaushik .
JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2022, 34 (10) :7974-7987
[5]   Cyber-physical systems and their security issues [J].
Alguliyev, Rasim ;
Imamverdiyev, Yadigar ;
Sukhostat, Lyudmila .
COMPUTERS IN INDUSTRY, 2018, 100 :212-223
[6]  
Alikhademi K, 2022, ARTIF INTELL LAW, V30, P1, DOI 10.1007/s10506-021-09286-4
[7]   A Survey on XAI for Cyber Physical Systems in Medicine [J].
Alimonda, Nicola ;
Guidotto, Luca ;
Malandri, Lorenzo ;
Mercorio, Fabio ;
Mezzanzanica, Mario ;
Tosi, Giovanni .
2022 IEEE INTERNATIONAL CONFERENCE ON METROLOGY FOR EXTENDED REALITY, ARTIFICIAL INTELLIGENCE AND NEURAL ENGINEERING (METROXRAINE), 2022, :265-270
[8]  
Aljazzaf Zainab M., 2010, Proceedings 2010 5th International Multi-Conference on Computing in the Global Information Technology (ICCGI 2010), P163, DOI 10.1109/ICCGI.2010.17
[9]   Smart Agent System for Cyber Nano-Manufacturing in Industry 4.0 [J].
Almakayeel, Naif ;
Desai, Salil ;
Alghamdi, Saleh ;
Qureshi, Mohamed Rafik Noor Mohamed .
APPLIED SCIENCES-BASEL, 2022, 12 (12)
[10]   Explainable Artificial Intelligence Enabled Intrusion Detection Technique for Secure Cyber-Physical Systems [J].
Almuqren, Latifah ;
Maashi, Mashael S. ;
Alamgeer, Mohammad ;
Mohsen, Heba ;
Hamza, Manar Ahmed ;
Abdelmageed, Amgad Atta .
APPLIED SCIENCES-BASEL, 2023, 13 (05)