Mind the gaps: Assuring the safety of autonomous systems from an engineering, ethical, and legal perspective

被引:66
作者
Burton, Simon [1 ]
Habli, Ibrahim [2 ]
Lawton, Tom [3 ,4 ]
McDermid, John [2 ]
Morgan, Phillip [5 ]
Porter, Zoe [6 ]
机构
[1] Robert Bosch GmbH, Gerlingen, Germany
[2] Univ York, Dept Comp Sci, York, N Yorkshire, England
[3] Bradford Royal Infirm, Bradford, W Yorkshire, England
[4] Bradford Inst Hlth Res, Bradford, W Yorkshire, England
[5] Univ York, York Law Sch, York, N Yorkshire, England
[6] Univ York, Dept Philosophy, York, N Yorkshire, England
基金
英国工程与自然科学研究理事会;
关键词
Safety; Autonomous systems; Artificial intelligence; Law; Ethics; RESPONSIBILITY; SEPSIS; ROBOTS;
D O I
10.1016/j.artint.2019.103201
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper brings together a multi-disciplinary perspective from systems engineering, ethics, and law to articulate a common language in which to reason about the multifaceted problem of assuring the safety of autonomous systems. The paper's focus is on the "gaps" that arise across the development process: the semantic gap, where normal conditions for a complete specification of intended functionality are not present; the responsibility gap, where normal conditions for holding human actors morally responsible for harm are not present; and the liability gap, where normal conditions for securing compensation to victims of harm are not present. By categorising these "gaps" we can expose with greater precision key sources of uncertainty and risk with autonomous systems. This can inform the development of more detailed models of safety assurance and contribute to more effective risk control. (C) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页数:16
相关论文
共 59 条
[1]  
Amodei D., 2016, PREPRINT, DOI 10.48550/ARXIV.1606.06565
[2]  
Anderson J. M., 2014, AUTONOMOMOUS VEHICLE
[3]  
[Anonymous], AUT VEH
[4]  
[Anonymous], EX SUMM COLL CAR OP
[5]  
[Anonymous], 1987, EC STRUCTURE TORT LA
[6]  
[Anonymous], OXFORD HDB LAW REGUL
[7]  
[Anonymous], LAWS ROBOTS CRIMES C
[8]  
[Anonymous], ATIYAHS ACCIDENTS CO
[9]  
[Anonymous], 21448 ISOPRF PAS
[10]  
[Anonymous], ETH ISS ROB AUT SYST