Mind the gaps: Assuring the safety of autonomous systems from an engineering, ethical, and legal perspective

被引:66
作者
Burton, Simon [1 ]
Habli, Ibrahim [2 ]
Lawton, Tom [3 ,4 ]
McDermid, John [2 ]
Morgan, Phillip [5 ]
Porter, Zoe [6 ]
机构
[1] Robert Bosch GmbH, Gerlingen, Germany
[2] Univ York, Dept Comp Sci, York, N Yorkshire, England
[3] Bradford Royal Infirm, Bradford, W Yorkshire, England
[4] Bradford Inst Hlth Res, Bradford, W Yorkshire, England
[5] Univ York, York Law Sch, York, N Yorkshire, England
[6] Univ York, Dept Philosophy, York, N Yorkshire, England
基金
英国工程与自然科学研究理事会;
关键词
Safety; Autonomous systems; Artificial intelligence; Law; Ethics; RESPONSIBILITY; SEPSIS; ROBOTS;
D O I
10.1016/j.artint.2019.103201
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper brings together a multi-disciplinary perspective from systems engineering, ethics, and law to articulate a common language in which to reason about the multifaceted problem of assuring the safety of autonomous systems. The paper's focus is on the "gaps" that arise across the development process: the semantic gap, where normal conditions for a complete specification of intended functionality are not present; the responsibility gap, where normal conditions for holding human actors morally responsible for harm are not present; and the liability gap, where normal conditions for securing compensation to victims of harm are not present. By categorising these "gaps" we can expose with greater precision key sources of uncertainty and risk with autonomous systems. This can inform the development of more detailed models of safety assurance and contribute to more effective risk control. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:16
相关论文
共 59 条
[21]  
Ashmore R., 2019, ARXIV PREPRINT ARXIV
[22]   The Moral Machine experiment [J].
Awad, Edmond ;
Dsouza, Sohan ;
Kim, Richard ;
Schulz, Jonathan ;
Henrich, Joseph ;
Shariff, Azim ;
Bonnefon, Jean-Francois ;
Rahwan, Iyad .
NATURE, 2018, 563 (7729) :59-+
[23]   The problem of ascribing legal responsibility in the case of robotics [J].
Beck, Susanne .
AI & SOCIETY, 2016, 31 (04) :473-481
[24]  
BERGENHEM C., 2015, CARS 2015 CRITICAL A
[25]   Liability for damages caused by artificial intelligence [J].
Cerka, Paulius ;
Grigiene, Jurgita ;
Sirbikyte, Gintare .
COMPUTER LAW & SECURITY REVIEW, 2015, 31 (03) :376-389
[26]   Responsibility and the Moral Phenomenology of Using Self-Driving Cars [J].
Coeckelbergh, Mark .
APPLIED ARTIFICIAL INTELLIGENCE, 2016, 30 (08) :748-757
[27]  
Daniels N., 2018, The Stanford Encyclopedia of Philosophy
[28]   Meaningful Human Control over Autonomous Systems: A Philosophical Account [J].
de Sio, Filippo Santoni ;
van den Hoven, Jeroen .
FRONTIERS IN ROBOTICS AND AI, 2018, 5
[29]  
Dewees DonaldN., 1996, EXPLORING THE DOMAIN OF ACCIDENT LAW: TAKING THE FACTS SERIOUSLY
[30]   Multi-aspect Safety Engineering for Highly Automated Driving Looking Beyond Functional Safety and Established Standards and Methodologies [J].
Feth, Patrik ;
Adler, Rasmus ;
Fukuda, Takeshi ;
Ishigooka, Tasuku ;
Otsuka, Satoshi ;
Schneider, Daniel ;
Uecker, Denis ;
Yoshimura, Kentaro .
COMPUTER SAFETY, RELIABILITY, AND SECURITY (SAFECOMP 2018), 2018, 11093 :59-72