Allocation of Moral Decision-Making in Human-Agent Teams: A Pattern Approach

被引:11
作者
van der Waa, Jasper [1 ,2 ]
van Diggelen, Jurriaan [1 ]
Siebert, Luciano Cavalcante [2 ]
Neerincx, Mark [1 ,2 ]
Jonker, Catholijn [2 ]
机构
[1] TNO, Perceptual & Cognit Syst, Soesterberg, Netherlands
[2] Delft Univ Technol, AiTech, Interact Intelligence Grp, Delft, Netherlands
来源
ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS. COGNITION AND DESIGN, EPCE 2020, PT II | 2020年 / 12187卷
关键词
Team Design Patterns; Dynamic task allocation; Moral; decision-making; Human-Agent Teaming; Machine Ethics; Human; Factors; Meaningful human control; MACHINE; ETHICS;
D O I
10.1007/978-3-030-49183-3_16
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Artificially intelligent agents will deal with more morally sensitive situations as the field of AI progresses. Research efforts are made to regulate, design and build Artificial Moral Agents (AMAs) capable of making moral decisions. This research is highly multidisciplinary with each their own jargon and vision, and so far it is unclear whether a fully autonomous AMA can be achieved. To specify currently available solutions and structure an accessible discussion around them, we propose to apply Team Design Patterns (TDPs). The language of TDPs describe (visually, textually and formally) a dynamic allocation of tasks for moral decision making in a human-agent team context. A task decomposition is proposed on moral decision-making and AMA capabilities to help define such TDPs. Four TDPs are given as examples to illustrate the versatility of the approach. Two problem scenarios (surgical robots and drone surveillance) are used to illustrate these patterns. Finally, we discuss in detail the advantages and disadvantages of a TDP approach to moral decision making.
引用
收藏
页码:203 / 220
页数:18
相关论文
共 32 条
[1]   A Topology of Shared Control Systems-Finding Common Ground in Diversity [J].
Abbink, David A. ;
Carlson, Tom ;
Mulder, Mark ;
de Winter, Joost C. F. ;
Aminravan, Farzad ;
Gibo, Tricia L. ;
Boer, Erwin R. .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2018, 48 (05) :509-525
[2]  
Anderson M, 2007, AI MAG, V28, P15
[3]  
Anderson M, 2014, AAAI CONF ARTIF INTE, P253
[4]  
[Anonymous], CRS Report R42701
[5]  
Arnold Thomas, 2017, AAAI WORKSHOPS 2017
[6]   Intelligent autonomous vehicles with an extendable knowledge base under meaningful human control [J].
Beckers, Guus ;
Sijs, Joris ;
van Diggelen, Jurriaan ;
van Dijk, Roelof J. E. ;
Bouma, Henri ;
Lomme, Mathijs ;
Hommes, Rutger ;
Hillerstrom, Fieke ;
van der Waa, Jasper ;
van Velsen, Anna ;
Mannucci, Tommaso ;
Voogd, Jeroen ;
van Staal, Wessel ;
Veltman, Kim ;
Wessels, Peter ;
Huizing, Albert .
COUNTERTERRORISM, CRIME FIGHTING, FORENSICS, AND SURVEILLANCE TECHNOLOGIES III, 2019, 11166
[7]   Models of moral decision making: Literature review and research agenda for discrete choice analysis [J].
Chorus, Caspar G. .
JOURNAL OF CHOICE MODELLING, 2015, 16 :69-85
[9]  
Conitzer V, 2017, AAAI CONF ARTIF INTE, P4831
[10]   Meaningful Human Control over Autonomous Systems: A Philosophical Account [J].
de Sio, Filippo Santoni ;
van den Hoven, Jeroen .
FRONTIERS IN ROBOTICS AND AI, 2018, 5