Safety Challenges of AI in Autonomous Systems Design - Solutions from Human Factors Perspective Emphasizing AI Awareness

被引：7

作者：

Karvonen, Hannu ^{[1
]}

Heikkila, Eetu ^{[1
]}

Wahlstrom, Mikael ^{[1
]}

机构：

[1] VTT Tech Res Ctr Finland Ltd, POB 1000, Espoo 02044, Finland

来源：

ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS. COGNITION AND DESIGN, EPCE 2020, PT II | 2020年 / 12187卷

关键词：

Artificial intelligence; Autonomous systems; Human factors; Safety; Systems engineering; NETWORKS;

D O I：

10.1007/978-3-030-49183-3_12

中图分类号：

T [工业技术];

学科分类号：

08 ;

摘要：

Artificial intelligence (AI) is a key technology that is utilized in autonomous systems. However, using AI in such systems introduces also several safety challenges, many of which are related to complex human-AI interactions. In general, these challenges relate to the changing roles of the people who interact with the increasingly autonomous systems in various ways. In this paper, we consider a set of practical safety challenges related to applying advanced AI to autonomous machine systems and present solutions from the perspective of human factors. We apply the novel concept of AI awareness (AIA) to discuss the challenges in detail, and based on this, provide suggestions and guidelines for mitigating the AI safety risks with autonomous systems. In addition, we briefly consider the system design process to identify the actions that should be taken to ensure AIA throughout the different systems engineering design phases. The theoretical research presented in this paper aims to provide the first steps towards considering AIA in autonomous systems and understanding the human factors perspective viewpoint on AI safety for autonomous systems.

引用

页码：147 / 160

页数：14

共 29 条

[1]

Amodei D, 2016, Arxiv, DOI [arXiv:1606.06565, DOI 10.48550/ARXIV.1606.06565]

[2]

[Anonymous], 2015, NASA TECHNOLOGY ROAD

[3]

[Anonymous], 2014, SAE J3016 Taxonomy and Definitions for Terms Related to On-Road Motor Vehicles Automated Driving Systems

[4]

Banks, 2018, STATE SOLUTIONS AUTO

[5]

Cummings ML, 2020, LIVING WITH ROBOTS: EMERGING ISSUES ON THE PSYCHOLOGICAL AND SOCIAL IMPLICATIONS OF ROBOTICS, P119, DOI 10.1016/B978-0-12-815367-3.00006-2

[6]

Doran D, 2017, Arxiv, DOI arXiv:1710.00794

[7]

Endsley M. R., 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference: NAECON 1988 (Cat. No.88CH2596-5), P789, DOI 10.1109/NAECON.1988.195097

[8] TOWARD A THEORY OF SITUATION AWARENESS IN DYNAMIC-SYSTEMS [J].

ENDSLEY, MR .

HUMAN FACTORS, 1995, 37 (01) :32-64

[9] The concept of operations: The bridge from operational requirements to technical specifications [J].

Fairley, RE ;

Thayer, RH .

ANNALS OF SOFTWARE ENGINEERING, 1997, 3 :417-432

[10]

Fong T., 2018, Autonomous Systems: NASA Capability Overview

← 1 2 3 →