Explainable AI for Cyber-Physical Systems: Issues and Challenges

被引:8
作者
Hoenig, Amber [1 ]
Roy, Kaushik [2 ]
Acquaah, Yaa Takyiwaa [2 ]
Yi, Sun [3 ]
Desai, Salil S. [4 ,5 ]
机构
[1] North Carolina Agr & Tech State Univ, Dept Computat Data Sci & Engn, Greensboro, NC 27411 USA
[2] North Carolina Agr & Tech State Univ, Dept Comp Sci, Greensboro, NC 27411 USA
[3] North Carolina Agr & Tech State Univ, Dept Mech Engn, Greensboro, NC 27411 USA
[4] North Carolina Agr & Tech State Univ, Dept Ind & Syst Engn, Greensboro, NC 27411 USA
[5] North Carolina Agr & Tech State Univ, Ctr Excellence Prod Design & Adv Mfg, Greensboro, NC 27411 USA
关键词
Artificial intelligence; Cyber-physical systems; Explainable AI; Biological system modeling; Reviews; Safety; Computer security; Fifth Industrial Revolution; Cyber-physical systems (CPS); cyber-resilience; cybersecurity; explainable artificial intelligence (XAI); industrial CPS; Industry; 5.0; ARTIFICIAL-INTELLIGENCE; INTRUSION DETECTION; FUTURE;
D O I
10.1109/ACCESS.2024.3395444
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Artificial intelligence and cyber-physical systems (CPS) are two of the key technologies of the future that are enabling major global shifts. However, most of the current implementations of AI in CPS are not explainable, which creates serious problems in ethical, legal, regulatory, and other domains. Therefore, it is necessary for explainable artificial intelligence (XAI) to be integrated with cyber-physical systems to meet the vital needs for control, fairness, accountability, safety, cyber-resilience, and cybersecurity. The goal of this review is to demonstrate the need, benefits, challenges, and implementation of XAI for CPS. We review the existing literature about XAI and CPS, discuss the current state of the art, examine applications in different domains, and make recommendations for future research directions. To the best of our knowledge, this is the first peer-reviewed academic article to provide a comprehensive review of general XAI for CPS. We also contribute new research ideas including development of multisensory explanations and outputs for these systems, application of XAI to CPS to decrease occupational burnout and increase employee engagement, and enumeration of the multidisciplinary goals and benefits of XAI as applied to cyber-physical systems.
引用
收藏
页码:73113 / 73140
页数:28
相关论文
共 50 条
[31]   Cyber-Physical Systems for Industrial Applications [J].
Gaiceanu, Marian .
2019 6TH INTERNATIONAL SYMPOSIUM ON ELECTRICAL AND ELECTRONICS ENGINEERING (ISEEE), 2019,
[32]   Challenges of Machine Learning Applied to Safety-Critical Cyber-Physical Systems [J].
Pereira, Ana ;
Thomas, Carsten .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2020, 2 (04) :579-602
[33]   User Interfaces for Cyber-Physical Systems: Challenges and Possible Approaches [J].
Paelke, Volker ;
Roecker, Carsten .
DESIGN, USER EXPERIENCE, AND USABILITY: DESIGN DISCOURSE (DUXU 2015), PT I, 2015, 9186 :75-85
[34]   Comparison and Investigation of AI-Based Approaches for Cyberattack Detection in Cyber-Physical Systems [J].
Abdullahi, Mujaheed ;
Alhussian, Hitham ;
Aziz, Norshakirah ;
Abdulkadir, Said Jadid ;
Alwadain, Ayed ;
Muazu, Aminu Aminu ;
Bala, Abubakar .
IEEE ACCESS, 2024, 12 :31988-32004
[35]   A framework for AI-based self-adaptive cyber-physical process systems [J].
Guldner, Achim ;
Hoffmann, Maximilian ;
Lohr, Christian ;
Machhamer, Ruediger ;
Malburg, Lukas ;
Morgen, Marlies ;
Rodermund, Stephanie C. ;
Schaefer, Florian ;
Schaupeter, Lars ;
Schneider, Jens ;
Theusch, Felix ;
Bergmann, Ralph ;
Dartmann, Guido ;
Kuhn, Norbert ;
Naumann, Stefan ;
Timm, Ingo J. ;
Vette-Steinkamp, Matthias ;
Weyers, Benjamin .
IT-INFORMATION TECHNOLOGY, 2023, 65 (03) :113-127
[36]   Discovery of AI/ML Supply Chain Vulnerabilities within Automotive Cyber-Physical Systems [J].
Williams, Daniel ;
Clark, Chelece ;
McGahan, Rachel ;
Potteiger, Bradley ;
Cohen, Daniel ;
Musau, Patrick .
2022 IEEE INTERNATIONAL CONFERENCE ON ASSURED AUTONOMY (ICAA 2022), 2022, :93-96
[37]   Design Automation of Cyber-Physical Systems: Challenges, Advances, and Opportunities [J].
Seshia, Sanjit A. ;
Hu, Shiyan ;
Li, Wenchao ;
Zhu, Qi .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2017, 36 (09) :1421-1434
[38]   Assessment of the challenges of integrating cyber-physical systems in Nigerian construction [J].
Oke, Ayodeji Emmanuel ;
Adekunye, Olusegun Johnson ;
Adeosun, Femi Emmanuel ;
Aliu, John ;
Akanni, Prince Oluleye ;
Aghimien, Douglas ;
Aigbavboa, Clinton Ohis .
ENGINEERING CONSTRUCTION AND ARCHITECTURAL MANAGEMENT, 2025,
[39]   The Big Picture on the "AI Turn" for Digital Health: The Internet of Things and Cyber-Physical Systems [J].
Ozdemir, Vural .
OMICS-A JOURNAL OF INTEGRATIVE BIOLOGY, 2019, 23 (06) :308-311
[40]   CYBER-PHYSICAL SYSTEMS (CPS): THE "SYSTEMS-OF-SYSTEMS" CHALLENGES [J].
Schoitsch, Erwin .
IDIMT-2010: INFORMATION TECHNOLOGY - HUMAN VALUES, INNOVATION AND ECONOMY, 2010, 32 :163-176