The Impact of Training on Human-Autonomy Team Communications and Trust Calibration

被引:15
作者
Johnson, Craig J. [1 ]
Demir, Mustafa [1 ]
McNeese, Nathan J. [2 ]
Gorman, Jamie C. [3 ]
Wolff, Alexandra T. [1 ]
Cooke, Nancy J. [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85212 USA
[2] Clemson Univ, Clemson, SC 29631 USA
[3] Georgia Inst Technol, Atlanta, GA 30332 USA
关键词
human-agent teaming; command and control; collaboration; intelligent systems; artificial intelligence; AUTOMATION; PERFORMANCE; METAANALYSIS; METHODOLOGY; ENTRAINMENT; ADAPTATION; MANAGEMENT; POWER;
D O I
10.1177/00187208211047323
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Objective This work examines two human-autonomy team (HAT) training approaches that target communication and trust calibration to improve team effectiveness under degraded conditions. Background Human-autonomy teaming presents challenges to teamwork, some of which may be addressed through training. Factors vital to HAT performance include communication and calibrated trust. Method Thirty teams of three, including one confederate acting as an autonomous agent, received either entrainment-based coordination training, trust calibration training, or control training before executing a series of missions operating a simulated remotely piloted aircraft. Automation and autonomy failures simulating degraded conditions were injected during missions, and measures of team communication, trust, and task efficiency were collected. Results Teams receiving coordination training had higher communication anticipation ratios, took photos of targets faster, and overcame more autonomy failures. Although autonomy failures were introduced in all conditions, teams receiving the calibration training reported that their overall trust in the agent was more robust over time. However, they did not perform better than the control condition. Conclusions Training based on entrainment of communications, wherein introduction of timely information exchange through one team member has lasting effects throughout the team, was positively associated with improvements in HAT communications and performance under degraded conditions. Training that emphasized the shortcomings of the autonomous agent appeared to calibrate expectations and maintain trust. Applications Team training that includes an autonomous agent that models effective information exchange may positively impact team communication and coordination. Training that emphasizes the limitations of an autonomous agent may help calibrate trust.
引用
收藏
页码:1554 / 1570
页数:17
相关论文
共 50 条
  • [21] A Robust Human-Autonomy Collaboration Framework With Experimental Validation
    Uzun, M. Yusuf
    Inanc, Emirhan
    Yildiz, Yildiray
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 2313 - 2318
  • [22] Human-Autonomy Teaming: A Review and Analysis of the Empirical Literature
    O'Neill, Thomas
    McNeese, Nathan
    Barron, Amy
    Schelble, Beau
    HUMAN FACTORS, 2022, 64 (05) : 904 - 938
  • [23] Human-autonomy teaming in military settings
    Chen, Jessie Y. C.
    THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2018, 19 (03) : 255 - 258
  • [24] Assessing Multi-Agent Human-Autonomy Teams: US Army Robotic Wingman Gunnery Operations
    Schaefer, Kristin E.
    Baker, Anthony L.
    Brewer, Ralph W.
    Patton, Debra
    Canady, Jonroy
    Metcalfe, Jason S.
    MICRO- AND NANOTECHNOLOGY SENSORS, SYSTEMS, AND APPLICATIONS XI, 2019, 10982
  • [25] Stepping out of the shadow of human-human teaming: Crafting a unique identity for human-autonomy teams
    McNeese, Nathan J.
    Flathmann, Christopher
    O'Neill, Thomas A.
    Salas, Eduardo
    COMPUTERS IN HUMAN BEHAVIOR, 2023, 148
  • [26] Designing High-Impact Experiments for Human-Autonomy / AI Teaming
    Flathmann, Christopher
    Mcneese, Nathan J.
    O'Neill, Thomas A.
    JOURNAL OF COGNITIVE ENGINEERING AND DECISION MAKING, 2025,
  • [27] A Model of Team Trust in Human-Agent Teams
    Ulfert, Anna-Sophie
    Georganta, Eleni
    COMPANION PUBLICATON OF THE 2020 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION (ICMI '20 COMPANION), 2020, : 171 - 175
  • [28] Confidence Metrics Improve Human-Autonomy Integration
    Marathe, Amar R.
    Lance, Brent J.
    McDowell, Kaleb
    Nothwang, William D.
    Metcalfe, Jason S.
    HRI'14: PROCEEDINGS OF THE 2014 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2014, : 240 - 241
  • [29] Cohesion in human-autonomy teams: an approach for future research
    Lakhmani, Shan G.
    Neubauer, Catherine
    Krausman, Andrea
    Fitzhugh, Sean M.
    Berg, Samantha K.
    Wright, Julia L.
    Rovira, Ericka
    Blackman, Jordan J.
    Schaefer, Kristin E.
    THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2022, 23 (06) : 687 - 724
  • [30] A supportive situation awareness model for human-autonomy teaming in collaborative driving
    Kridalukmana, Rinta
    Lu, Hai Yan
    Naderpour, Mohsen
    THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2020, 21 (06) : 658 - 683