The Impact of Training on Human-Autonomy Team Communications and Trust Calibration

被引:15
作者
Johnson, Craig J. [1 ]
Demir, Mustafa [1 ]
McNeese, Nathan J. [2 ]
Gorman, Jamie C. [3 ]
Wolff, Alexandra T. [1 ]
Cooke, Nancy J. [1 ]
机构
[1] Arizona State Univ, Tempe, AZ 85212 USA
[2] Clemson Univ, Clemson, SC 29631 USA
[3] Georgia Inst Technol, Atlanta, GA 30332 USA
关键词
human-agent teaming; command and control; collaboration; intelligent systems; artificial intelligence; AUTOMATION; PERFORMANCE; METAANALYSIS; METHODOLOGY; ENTRAINMENT; ADAPTATION; MANAGEMENT; POWER;
D O I
10.1177/00187208211047323
中图分类号
B84 [心理学]; C [社会科学总论]; Q98 [人类学];
学科分类号
03 ; 0303 ; 030303 ; 04 ; 0402 ;
摘要
Objective This work examines two human-autonomy team (HAT) training approaches that target communication and trust calibration to improve team effectiveness under degraded conditions. Background Human-autonomy teaming presents challenges to teamwork, some of which may be addressed through training. Factors vital to HAT performance include communication and calibrated trust. Method Thirty teams of three, including one confederate acting as an autonomous agent, received either entrainment-based coordination training, trust calibration training, or control training before executing a series of missions operating a simulated remotely piloted aircraft. Automation and autonomy failures simulating degraded conditions were injected during missions, and measures of team communication, trust, and task efficiency were collected. Results Teams receiving coordination training had higher communication anticipation ratios, took photos of targets faster, and overcame more autonomy failures. Although autonomy failures were introduced in all conditions, teams receiving the calibration training reported that their overall trust in the agent was more robust over time. However, they did not perform better than the control condition. Conclusions Training based on entrainment of communications, wherein introduction of timely information exchange through one team member has lasting effects throughout the team, was positively associated with improvements in HAT communications and performance under degraded conditions. Training that emphasized the shortcomings of the autonomous agent appeared to calibrate expectations and maintain trust. Applications Team training that includes an autonomous agent that models effective information exchange may positively impact team communication and coordination. Training that emphasizes the limitations of an autonomous agent may help calibrate trust.
引用
收藏
页码:1554 / 1570
页数:17
相关论文
共 50 条
[41]   Human-Autonomy Teaming and Explainable AI Capabilities in RTS Games [J].
Lucero, Crisrael ;
Izumigawa, Christianne ;
Frederiksen, Kurt ;
Nans, Lena ;
Iden, Rebecca ;
Lange, Douglas S. .
ENGINEERING PSYCHOLOGY AND COGNITIVE ERGONOMICS. COGNITION AND DESIGN, EPCE 2020, PT II, 2020, 12187 :161-171
[42]   Do You Trust Me? Measuring People's Perception of Being Trusted by AI in a Human-Agent Team [J].
Xie, Yubin ;
Zhou, Ronggang ;
Chan, Alan Hoi Shou ;
Xiong, Duanqin .
INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION, 2025,
[43]   A Human-Autonomy Teaming Approach for a Flight-Following Task [J].
Brandt, Summer L. ;
Lachter, Joel ;
Russell, Ricky ;
Shively, Robert Jay .
ADVANCES IN NEUROERGONOMICS AND COGNITIVE ENGINEERING (AHFE 2017), 2018, 586 :12-22
[44]   Enabling Digital Air Traffic Controller Assistant through Human-Autonomy Teaming Design [J].
Jameel, Mohsan ;
Tyburzy, Lukas ;
Gerdes, Ingrid ;
Pick, Andreas ;
Hunger, Robert ;
Christoffels, Lothar .
2023 IEEE/AIAA 42ND DIGITAL AVIONICS SYSTEMS CONFERENCE, DASC, 2023,
[45]   Shaping a multidisciplinary understanding of team trust in human-AI teams: a theoretical framework [J].
Ulfert, Anna-Sophie ;
Georganta, Eleni ;
Centeio Jorge, Carolina ;
Mehrotra, Siddharth ;
Tielman, Myrthe .
EUROPEAN JOURNAL OF WORK AND ORGANIZATIONAL PSYCHOLOGY, 2024, 33 (02) :158-171
[46]   Modelling situated intent for human-autonomy teaming: a human-centric approach [J].
Hammarback, Jimmy ;
Johansson, Bjoern J. E. ;
Alfredson, Jens ;
Lundberg, Jonas .
THEORETICAL ISSUES IN ERGONOMICS SCIENCE, 2024, 25 (06) :731-752
[47]   Understanding Human-Autonomy Teams Through a Human-Animal Teaming Model [J].
Lum, Heather C. ;
Phillips, Elizabeth K. .
TOPICS IN COGNITIVE SCIENCE, 2024, 16 (03) :554-567
[48]   The Evaluation of a Playbook Interface for Human-Autonomy Teaming in Single Pilot Operations [J].
Tokadli, Guliz ;
Dorneich, Michael C. ;
Matessa, Michael ;
Eda, Seiya .
2019 IEEE/AIAA 38TH DIGITAL AVIONICS SYSTEMS CONFERENCE (DASC), 2019,
[49]   Flight-Based Control Allocation: Towards Human-Autonomy Teaming in Air Traffic Control [J].
de Rooij, Gijs ;
Tisza, Adam Balint ;
Borst, Clark .
AEROSPACE, 2024, 11 (11)
[50]   Human-Autonomy Teaming Interface Design for Multiple-UAV Control [J].
Fedulin A.M. ;
Evstaf’ev D.V. ;
Kondrashova G.L. ;
Artemenko N.V. .
Russian Aeronautics, 2022, 65 (02) :419-424