Sources of Risk of AI Systems

被引:18
作者
Steimers, Andre [1 ]
Schneider, Moritz [1 ]
机构
[1] Inst Occupat Safety & Hlth German Social Accid Hl, D-53757 St Augustin, Germany
关键词
artificial intelligence; risk management; occupational safety; protective devices; assistance systems; ALGORITHM; SAFETY; HEALTH; DRIFT;
D O I
10.3390/ijerph19063641
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Artificial intelligence can be used to realise new types of protective devices and assistance systems, so their importance for occupational safety and health is continuously increasing. However, established risk mitigation measures in software development are only partially suitable for applications in AI systems, which only create new sources of risk. Risk management for systems that for systems using AI must therefore be adapted to the new problems. This work objects to contribute hereto by identifying relevant sources of risk for AI systems. For this purpose, the differences between AI systems, especially those based on modern machine learning methods, and classical software were analysed, and the current research fields of trustworthy AI were evaluated. On this basis, a taxonomy could be created that provides an overview of various AI-specific sources of risk. These new sources of risk should be taken into account in the overall risk assessment of a system based on AI technologies, examined for their criticality and managed accordingly at an early stage to prevent a later system failure.
引用
收藏
页数:32
相关论文
共 50 条
  • [21] Physics of Organization Dynamics: An AI Framework for opportunity and risk management
    Benaben, Frederick
    Lauras, Matthieu
    Montreuil, Benoit
    Faugere, Louis
    Gou, Juanqiong
    Mu, Wenxin
    PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INDUSTRIAL ENGINEERING AND SYSTEMS MANAGEMENT (IESM 2019), 2019, : 371 - 376
  • [22] AI and Security, From an Information Security and Risk Manager Standpoint
    Shetty, Pranith
    IEEE ACCESS, 2024, 12 : 77468 - 77474
  • [23] Managing Risk and Quality of AI in Healthcare: Are Hospitals Ready for Implementation?
    Ranjbar, Arian
    Mork, Eilin Wermundsen
    Ravn, Jesper
    Brogger, Helga
    Myrseth, Per
    Ostrem, Hans Peter
    Hallock, Harry
    RISK MANAGEMENT AND HEALTHCARE POLICY, 2024, 17 : 877 - 882
  • [24] AI, machine learning and deep learning in cyber risk management
    Ishrag Hamid
    M. M. Hafizur Rahman
    Discover Sustainability, 6 (1):
  • [25] A Framework for Trustworthy AI in Credit Risk Management: Perspectives and Practices
    Mazumder, Sourav
    Dhar, Subhankar
    Asthana, Avinash
    COMPUTER, 2023, 56 (05) : 28 - 40
  • [26] Safety Challenges of AI in Autonomous Systems Design - Solutions from Human Factors Perspective Emphasizing AI Awareness
    Karvonen, Hannu
    Heikkila, Eetu
    Wahlstrom, Mikael
    ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS. COGNITION AND DESIGN, EPCE 2020, PT II, 2020, 12187 : 147 - 160
  • [27] Explainable AI for Cyber-Physical Systems: Issues and Challenges
    Hoenig, Amber
    Roy, Kaushik
    Acquaah, Yaa Takyiwaa
    Yi, Sun
    Desai, Salil S.
    IEEE ACCESS, 2024, 12 : 73113 - 73140
  • [28] Toward a Methodology for the Verification and Validation of AI-Based Systems
    Paardekooper, Jan-Pieter
    Borth, Michael
    SAE INTERNATIONAL JOURNAL OF CONNECTED AND AUTOMATED VEHICLES, 2025, 8 (01):
  • [29] Toward AI-Enhanced VLC Systems for Industrial Applications
    Costa, Wesley
    Camporez, Higor
    Hinrichs, Malte
    Rocha, Helder
    Pontes, Maria
    Segatto, Marcelo
    Paraskevopoulos, Anagnostis
    Jungnickel, Volker
    Freund, Ronald
    Silva, Jair
    JOURNAL OF LIGHTWAVE TECHNOLOGY, 2023, 41 (04) : 1064 - 1076
  • [30] Systems Modeling of Trust in AI-Enabled Medical Diagnosis
    Moghadasi, Negin
    Piran, Misagh
    Valdez, Rupa S.
    Moghaddasi, Negar
    Loose, Davis C.
    Polmateer, Thomas L.
    Lambert, James H.
    18TH ANNUAL IEEE INTERNATIONAL SYSTEMS CONFERENCE, SYSCON 2024, 2024,