Explainable AI for Cyber-Physical Systems: Issues and Challenges

被引:8
作者
Hoenig, Amber [1 ]
Roy, Kaushik [2 ]
Acquaah, Yaa Takyiwaa [2 ]
Yi, Sun [3 ]
Desai, Salil S. [4 ,5 ]
机构
[1] North Carolina Agr & Tech State Univ, Dept Computat Data Sci & Engn, Greensboro, NC 27411 USA
[2] North Carolina Agr & Tech State Univ, Dept Comp Sci, Greensboro, NC 27411 USA
[3] North Carolina Agr & Tech State Univ, Dept Mech Engn, Greensboro, NC 27411 USA
[4] North Carolina Agr & Tech State Univ, Dept Ind & Syst Engn, Greensboro, NC 27411 USA
[5] North Carolina Agr & Tech State Univ, Ctr Excellence Prod Design & Adv Mfg, Greensboro, NC 27411 USA
关键词
Artificial intelligence; Cyber-physical systems; Explainable AI; Biological system modeling; Reviews; Safety; Computer security; Fifth Industrial Revolution; Cyber-physical systems (CPS); cyber-resilience; cybersecurity; explainable artificial intelligence (XAI); industrial CPS; Industry; 5.0; ARTIFICIAL-INTELLIGENCE; INTRUSION DETECTION; FUTURE;
D O I
10.1109/ACCESS.2024.3395444
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence and cyber-physical systems (CPS) are two of the key technologies of the future that are enabling major global shifts. However, most of the current implementations of AI in CPS are not explainable, which creates serious problems in ethical, legal, regulatory, and other domains. Therefore, it is necessary for explainable artificial intelligence (XAI) to be integrated with cyber-physical systems to meet the vital needs for control, fairness, accountability, safety, cyber-resilience, and cybersecurity. The goal of this review is to demonstrate the need, benefits, challenges, and implementation of XAI for CPS. We review the existing literature about XAI and CPS, discuss the current state of the art, examine applications in different domains, and make recommendations for future research directions. To the best of our knowledge, this is the first peer-reviewed academic article to provide a comprehensive review of general XAI for CPS. We also contribute new research ideas including development of multisensory explanations and outputs for these systems, application of XAI to CPS to decrease occupational burnout and increase employee engagement, and enumeration of the multidisciplinary goals and benefits of XAI as applied to cyber-physical systems.
引用
收藏
页码:73113 / 73140
页数:28
相关论文
共 50 条
[41]   A Survey on Cyber-Resilience Approaches for Cyber-Physical Systems [J].
Segovia-Ferreira, Mariana ;
Rubio-Hernan, Jose ;
Cavalli, Ana Rosa ;
Garcia-Alfaro, Joaquin .
ACM COMPUTING SURVEYS, 2024, 56 (08)
[42]   Explainable Artificial Intelligence Enabled Intrusion Detection Technique for Secure Cyber-Physical Systems [J].
Almuqren, Latifah ;
Maashi, Mashael S. ;
Alamgeer, Mohammad ;
Mohsen, Heba ;
Hamza, Manar Ahmed ;
Abdelmageed, Amgad Atta .
APPLIED SCIENCES-BASEL, 2023, 13 (05)
[43]   Cyber-physical systems research and education in 2030: Scenarios and strategies [J].
Broo, Didem Gurdur ;
Boman, Ulf ;
Torngren, Martin .
JOURNAL OF INDUSTRIAL INFORMATION INTEGRATION, 2021, 21
[44]   An Explainable Intelligent Framework for Anomaly Mitigation in Cyber-Physical Inverter-Based Systems [J].
Khan, Asad Ali ;
Beg, Omar A. ;
Jin, Yu-Fang ;
Ahmed, Sara .
IEEE ACCESS, 2023, 11 :65382-65394
[45]   Cyber-physical systems: a bibliometric analysis of literature [J].
Singh, Nitin ;
Panigrahi, Prabin Kumar ;
Zhang, Zuopeng ;
Jasimuddin, Sajjad M. .
JOURNAL OF INTELLIGENT MANUFACTURING, 2025, 36 (04) :2335-2371
[46]   ENIGMA: An explainable digital twin security solution for cyber-physical systems [J].
Suhail, Sabah ;
Iqbal, Mubashar ;
Hussain, Rasheed ;
Jurdak, Raja .
COMPUTERS IN INDUSTRY, 2023, 151
[47]   NETWORKS FOR CYBER-PHYSICAL SYSTEMS AND INDUSTRY 4.0 [J].
Sabella, Roberto ;
Shamsunder, Sanyogita ;
Albrecht, Sandor ;
Bovensiepen, Daniel .
IEEE COMMUNICATIONS MAGAZINE, 2021, 59 (08) :12-12
[48]   Human-in-the-loop cyber-physical systems [J].
Yau, Kok-Lim Alvin .
FRONTIERS IN NEUROROBOTICS, 2022, 16
[49]   Smart Agents in Industrial Cyber-Physical Systems [J].
Leitao, Paulo ;
Karnouskos, Stamatis ;
Ribeiro, Luis ;
Lee, Jay ;
Strasser, Thomas ;
Colombo, Armando W. .
PROCEEDINGS OF THE IEEE, 2016, 104 (05) :1086-1101
[50]   Towards Trustworthy Smart Cyber-Physical Systems [J].
David, M. W. ;
Yerkes, C. R. ;
Simmons, M. E. ;
Franceschini, W. .
INFORMATION AND COMMUNICATIONS SECURITY, ICICS 2016, 2016, 9977 :392-399