Sources of Risk of AI Systems

被引:18
作者
Steimers, Andre [1 ]
Schneider, Moritz [1 ]
机构
[1] Inst Occupat Safety & Hlth German Social Accid Hl, D-53757 St Augustin, Germany
关键词
artificial intelligence; risk management; occupational safety; protective devices; assistance systems; ALGORITHM; SAFETY; HEALTH; DRIFT;
D O I
10.3390/ijerph19063641
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Artificial intelligence can be used to realise new types of protective devices and assistance systems, so their importance for occupational safety and health is continuously increasing. However, established risk mitigation measures in software development are only partially suitable for applications in AI systems, which only create new sources of risk. Risk management for systems that for systems using AI must therefore be adapted to the new problems. This work objects to contribute hereto by identifying relevant sources of risk for AI systems. For this purpose, the differences between AI systems, especially those based on modern machine learning methods, and classical software were analysed, and the current research fields of trustworthy AI were evaluated. On this basis, a taxonomy could be created that provides an overview of various AI-specific sources of risk. These new sources of risk should be taken into account in the overall risk assessment of a system based on AI technologies, examined for their criticality and managed accordingly at an early stage to prevent a later system failure.
引用
收藏
页数:32
相关论文
共 50 条
  • [1] Risk Assessment Tools on Trial: AI Systems Go?
    Chugh, Neha
    IEEE TECHNOLOGY AND SOCIETY MAGAZINE, 2022, 41 (03) : 50 - 57
  • [2] AI and Discrimination: Sources of Algorithmic Biases
    Moussawi, Sara
    Deng, Xuefei
    Joshi, K. D.
    DATA BASE FOR ADVANCES IN INFORMATION SYSTEMS, 2024, 55 (04): : 6 - 11
  • [3] AI security and cyber risk in IoT systems
    Radanliev, Petar
    De Roure, David
    Maple, Carsten
    Nurse, Jason R. C.
    Nicolescu, Razvan
    Ani, Uchenna
    FRONTIERS IN BIG DATA, 2024, 7
  • [4] Three Challenges to Secure AI Systems in the Context of AI Regulations
    Hamon, Ronan
    Junklewitz, Henrik
    Garrido, Josep Soler
    Sanchez, Ignacio
    IEEE ACCESS, 2024, 12 : 61022 - 61035
  • [5] AI Insurance: Risk Management 2.0
    Tournas, Lucille Nalbach
    Bowman, Diana M.
    IEEE TECHNOLOGY AND SOCIETY MAGAZINE, 2021, 40 (04) : 52 - 56
  • [6] Investigating Sources and Effects of Bias in AI-Based Systems - Results from an MLR
    De Buitlear, Caoimhe
    Byrne, Ailbhe
    McEvoy, Eric
    Camara, Abasse
    Yilmaz, Murat
    McCarren, Andrew
    Clarke, Paul M.
    SYSTEMS, SOFTWARE AND SERVICES PROCESS IMPROVEMENT, EUROSPI 2023, PT I, 2023, 1890 : 20 - 35
  • [7] Incorporated risk metrics and hybrid AI techniques for risk management
    Lin, Sin-Jin
    Hsu, Ming-Fu
    NEURAL COMPUTING & APPLICATIONS, 2017, 28 (11) : 3477 - 3489
  • [8] AI Living Lab: Quality Assurance for AI-based Health systems
    Lenarduzzi, Valentina
    Isomursu, Minna
    2023 IEEE/ACM 2ND INTERNATIONAL CONFERENCE ON AI ENGINEERING - SOFTWARE ENGINEERING FOR AI, CAIN, 2023, : 86 - 87
  • [9] Explainable AI: The Effect of Contradictory Decisions and Explanations on Users' Acceptance of AI Systems
    Ebermann, Carolin
    Selisky, Matthias
    Weibelzahl, Stephan
    INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2023, 39 (09) : 1807 - 1826
  • [10] Trustworthy AI: Closing the gap between development and integration of AI systems in ophthalmic practice
    Gonzalez-Gonzalo, Cristina
    Thee, Eric F.
    Klaver, Caroline C. W.
    Lee, Aaron Y.
    Schlingemann, Reinier O.
    Tufail, Adnan
    Verbraak, Frank
    Sanchez, Clara, I
    PROGRESS IN RETINAL AND EYE RESEARCH, 2022, 90