Certifiable Trust in Autonomous Systems: Making the Intractable Tangible

被引:22
作者
Lyons, Joseph B. [1 ,2 ,3 ]
Clark, Matthew A. [2 ,4 ]
Wagner, Alan R. [5 ,6 ]
Schuelke, Matthew J. [7 ]
机构
[1] Human Trust & Interact Branch, 711 Human Performance Wing, Wright Patterson AFB, OH 45433 USA
[2] Air Force Res Lab, Wright Patterson AFB, OH USA
[3] Air Force Off Sci Res, Wright Patterson AFB, OH USA
[4] AFRL RQQA, Autonomous Controls Branch, Wright Patterson AFB, OH USA
[5] Georgia Inst Technol, Res Inst, Atlanta, GA 30332 USA
[6] Inst Robot & Intelligent Machines, Atlanta, GA USA
[7] SRA Int, Wright Patterson AFB, OH USA
关键词
AGENT TRANSPARENCY; TEAM PERFORMANCE; AUTOMATION; COMPLEX; IMPACT; METAANALYSIS; EDUCATION; SUPPORT;
D O I
10.1609/aimag.v38i3.2717
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This article discusses verification and validation (V&V) of autonomous systems, a concept that will prove to be difficult for systems that were designed to execute decision initiative. V&V of such systems should include evaluations of the trustworthiness of the system based on transparency inputs and scenario based training. Transparency facets should be used to establish shared awareness and shared intent among the designer, tester, and user of the system. The transparency facets will allow the human to understand the goals, social intent, contextual awareness, task limitations, analytical underpinnings, and team-based orientation of the system in an attempt to verify its trustworthiness. Scenario-based training can then be used to validate that programming in a variety of situations that test the behavioral repertoire of the system. This novel method should be used to analyze behavioral adherence to a set of governing principles coded into the system.
引用
收藏
页码:37 / 49
页数:13
相关论文
共 66 条
[1]  
[Anonymous], AISB CONV NEW FRONT
[2]  
Arkin RC., 2009, Governing lethal behaviour in autonomous robots, DOI [10.1201/9781420085952, DOI 10.1201/9781420085952]
[3]   Moral Decision Making in Autonomous Systems: Enforcement, Moral Emotions, Dignity, Trust, and Deception [J].
Arkin, Ronald Craig ;
Ulam, Patrick ;
Wagner, Alan R. .
PROCEEDINGS OF THE IEEE, 2012, 100 (03) :571-589
[4]  
BAKER CV, 1992, ANN M SOC IND ORG PS
[5]  
Blickensderfer E., 1998, MAKING DECISIONS STR, P299, DOI DOI 10.1037/10278-011
[6]   Understanding team adaptation: A conceptual analysis and model [J].
Burke, C. Shawn ;
Stagl, Kevin C. ;
Salas, Eduardo ;
Pierce, Linda ;
Kendall, Dana .
JOURNAL OF APPLIED PSYCHOLOGY, 2006, 91 (06) :1189-1207
[7]  
Cannon-Bowers J. A., 1995, Team Effectiveness and Decision Making in Organizations, V333, P380
[8]   Team performance and training in complex environments: Recent findings from applied research [J].
Cannon-Bowers, JA ;
Salas, E .
CURRENT DIRECTIONS IN PSYCHOLOGICAL SCIENCE, 1998, 7 (03) :83-87
[9]   The impact of cross-training and work-load on team functioning: A replication and extension of initial findings [J].
Cannon-Bowers, JA ;
Salas, E ;
Blickensderfer, E ;
Bowers, CA .
HUMAN FACTORS, 1998, 40 (01) :92-101
[10]   A multilevel examination of the relationships among training outcomes, mediating regulatory processes, and adaptive performance [J].
Chen, G ;
Thomas, B ;
Wallace, JC .
JOURNAL OF APPLIED PSYCHOLOGY, 2005, 90 (05) :827-841