Should we Make AI More Tool-like or Teammate-Like?

被引:0
作者
Naikar, Neelam [1 ]
Hoffman, Robert [2 ]
Roth, Emilie M. [3 ]
Klein, Gary [4 ]
Militello, Laura G. [5 ]
Dominguez, Cindy [6 ]
机构
[1] Def Sci & Technol Grp, Melbourne, Vic, Australia
[2] Inst Human & Machine Cognit, Pensacola, FL USA
[3] Roth Cognit Engn, Stanford, CA USA
[4] MacroCognition LLC, Arlington, MA USA
[5] Appl Decis Sci LLC, Dayton, OH USA
[6] MITRE Corp, Bedford, MA USA
关键词
design metaphors; human-machine teaming; human-AI interaction; macrocognition; expertise; human-centered AI; anthropomorphism; joint cognitive systems; AUTOMATION; DESIGN; TEAMS; SYSTEM; AGENT; MODEL;
D O I
10.1177/15553434251346904
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Recent successes in artificial intelligence (AI) have ignited debate over its role in human-machine systems-specifically, whether an AI system should be viewed as a tool or a teammate. This article consists of a set of essays that explore this question from a macrocognitive viewpoint. These essays reveal similarities across stances, and divergences regarding interpretations of the teammate metaphor. Discussions include concerns about potential risks and effects of the teammate metaphor on users, in addition to expressions of the value of the metaphor for work system design. The essays highlight the role of metaphors in both enhancing and stifling design creativity, the blending of metaphors in design, and the need for empirical evaluation to guide clear design choices. Moreover, regardless of which approach is adopted, the "technology-first" mindset of system developers, the emphasis on relatively simple human-machine interactions over complex, evolving work systems, and the insidious effects of AI on human expertise all challenge progress in the design of macrocognitive work systems. The essays present some specific research directions.
引用
收藏
页数:21
相关论文
共 91 条
[1]  
[Anonymous], 1993, Things that make us smart
[2]   IRONIES OF AUTOMATION [J].
BAINBRIDGE, L .
AUTOMATICA, 1983, 19 (06) :775-779
[3]  
Bansal Gagan, 2021, CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, DOI 10.1145/3411764.3445717
[4]   THE ALIGNMENT OF TECHNOLOGY AND STRUCTURE THROUGH ROLES AND NETWORKS [J].
BARLEY, SR .
ADMINISTRATIVE SCIENCE QUARTERLY, 1990, 35 (01) :61-103
[5]  
Bartlett Megan L., 2024, Proceedings of the Human Factors and Ergonomics Society Annual Meeting, V68, P98, DOI 10.1177/10711813241275516
[6]   EXPECTING THE UNEXPECTED? HOW SWAT OFFICERS AND FILM CREWS HANDLE SURPRISES [J].
Bechky, Beth A. ;
Okhuysen, Gerardo A. .
ACADEMY OF MANAGEMENT JOURNAL, 2011, 54 (02) :239-261
[7]   The incident command system: High-reliability organizing for complex and volatile task environments [J].
Bigley, GA ;
Roberts, KH .
ACADEMY OF MANAGEMENT JOURNAL, 2001, 44 (06) :1281-1299
[8]   Adaptive coordination in surgical teams: an interview study [J].
Bogdanovic, Jasmina ;
Perry, Juliana ;
Guggenheim, Merlin ;
Manser, Tanja .
BMC HEALTH SERVICES RESEARCH, 2015, 15
[9]  
Broussard M, 2018, ARTIFICIAL UNINTELLIGENCE: HOW COMPUTERS MISUNDERSTAND THE WORLD
[10]   To Trust or to Think: Cognitive Forcing Functions Can Reduce Overreliance on AI in AI-assisted Decision-making [J].
Buçinca Z. ;
Malaya M.B. ;
Gajos K.Z. .
Proceedings of the ACM on Human-Computer Interaction, 2021, 5 (CSCW1)