Explanations and trust: What happens to trust when a robot partner does something unexpected?

被引:45
作者
Lyons, Joseph B. [1 ]
Hamdan, Izz Aldin [2 ]
Vo, Thy Q. [3 ]
机构
[1] Air Force Res Lab, Wright Patterson AFB, OH USA
[2] GDIT, Falls Church, VA USA
[3] Ball Aerosp, Boulder, CO USA
关键词
Trust in human -robot interaction; Human-autonomy teams (HATs); Autonomous robots; Trust repair; Violated expectations; ANTHROPOMORPHISM INCREASES TRUST; AUTOMATION; AGENT; ORGANIZATIONS; PERFORMANCE; VIOLATION;
D O I
10.1016/j.chb.2022.107473
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Performance within Human-Autonomy Teams (HATs) is influenced by the effectiveness of communication be-tween humans and robots. Communication is particularly important when robot teammates engage in behaviors that were not anticipated by the human teammate which could degrade trust. However, the literature on trust repair focuses on the role of apologies which may not be appropriate for an unexpected behavior since this behavior may not be an error. Explanations are one method that can be used by robot teammates to avoid costly trust degradation when human expectations are violated. The current study used an Urban Search and Rescue (USAR) scenario to examine the role of explanation in a context wherein a robot teammate deviated from an expected behavior. The current study examined how trust, trustworthiness, and responsibility attribution were influenced by observing the robot teammate deviate from an expected behavior. Participants (N = 148) used an online platform to view videos of the robot: 1) following a planned search path, and 2) deviating from a planned search path. A debriefing event between the human and the robot followed each search activity. Four expla-nation conditions were tested in the debriefing phase following the behavioral violation. Results showed that trust and trustworthiness (ability, benevolence, and integrity) declined following the unexpected behavior. Accordingly, responsibility attribution shifted from the human to the robot following the unexpected behavior. Explanation strategies that focused on communicating why the event occurred by highlighting the robot's environmental awareness were most effective at buffering the decline in trust and trustworthiness.
引用
收藏
页数:11
相关论文
共 53 条
[1]  
[Anonymous], 2017, 19 INT S AVIATION PS
[2]   The Moral Machine experiment [J].
Awad, Edmond ;
Dsouza, Sohan ;
Kim, Richard ;
Schulz, Jonathan ;
Henrich, Joseph ;
Shariff, Azim ;
Bonnefon, Jean-Francois ;
Rahwan, Iyad .
NATURE, 2018, 563 (7729) :59-+
[3]   Repairing Trust in Organizations and Institutions: Toward a Conceptual Framework [J].
Bachmann, Reinhard ;
Gillespie, Nicole ;
Priem, Richard .
ORGANIZATION STUDIES, 2015, 36 (09) :1123-1142
[4]   Holding Robots Responsible: The Elements of Machine Morality [J].
Bigman, Yochanan E. ;
Waytz, Adam ;
Alterovitz, Ron ;
Gray, Kurt .
TRENDS IN COGNITIVE SCIENCES, 2019, 23 (05) :365-368
[5]   People are averse to machines making moral decisions [J].
Bigman, Yochanan E. ;
Gray, Kurt .
COGNITION, 2018, 181 :21-34
[6]   Communication after an integrity-based trust violation: How organizational account giving affects trust [J].
Bruehl, Rolf ;
Basel, Jorn S. ;
Kury, Max F. .
EUROPEAN MANAGEMENT JOURNAL, 2018, 36 (02) :161-170
[7]   Guest Editorial: Agent and System Transparency [J].
Chen, Jessie Y. C. ;
Flemisch, Frank Ole ;
Lyons, Joseph B. ;
Neerincx, Mark A. .
IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2020, 50 (03) :189-193
[8]  
Chen JYC, 2014, IEEE T HUM-MACH SYST, V44, P13, DOI [10.1109/THMS.2013.2293535, 10.1504/IJMIC.2014.063872]
[9]   Towards Human-Robot Teaming: Tradeoffs of Explanation-Based Communication Strategies in a Virtual Search and Rescue Task [J].
Chiou, Erin K. ;
Demir, Mustafa ;
Buchanan, Verica ;
Corral, Christopher C. ;
Endsley, Mica R. ;
Lematta, Glenn J. ;
Cooke, Nancy J. ;
McNeese, Nathan J. .
INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2022, 14 (05) :1117-1136
[10]   Trusting Automation: Designing for Responsivity and Resilience [J].
Chiou, Erin K. ;
Lee, John D. .
HUMAN FACTORS, 2023, 65 (01) :137-165