Effects of Communication Directionality and AI Agent Differences in Human-AI Interaction

被引:15
作者
Ashktorab, Zahra [1 ]
Dugan, Casey [1 ]
Johnson, James [2 ]
Pan, Qian [2 ]
Zhang, Wei [1 ]
Kumaravel, Sadhana [1 ]
Campbell, Murray [1 ]
机构
[1] IBM Res AI, Yorktown Hts, NY 10598 USA
[2] IBM Res AI, Cambridge, MA USA
来源
CHI '21: PROCEEDINGS OF THE 2021 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS | 2021年
关键词
human-AI interaction; games; collaboration; social perception; REINFORCEMENT; GO;
D O I
10.1145/3411764.3445256
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In Human-AI collaborative settings that are inherently interactive, direction of communication plays a role in how users perceive their AI partners. In an AI-driven cooperative game with partially observable information, players (be it the AI or the human player) require their actions to be interpreted accurately by the other player to yield a successful outcome. In this paper, we investigate social perceptions of AI agents with various directions of communication in a cooperative game setting. We measure subjective social perceptions (rapport, intelligence, and likeability) of participants towards their partners when participants believe they are playing with an AI or with a human and the nature of the communication (responsiveness and leading roles). We ran a large scale study on Mechanical Turk (n=199) of this collaborative game and find significant differences in gameplay outcome and social perception across different AI agents, different directions of communication and when the agent is perceived to be an AI/Human. We find that the bias against the AI that has been demonstrated in prior studies varies with the direction of the communication and with the AI agent.
引用
收藏
页数:15
相关论文
共 68 条
  • [1] Adrian Kemo, 2016, DIVERSITY ECAI, P33
  • [2] [Anonymous], 2004, PROCEEDING 19 NATL C, DOI DOI 10.3115/1614025.1614037
  • [3] [Anonymous], 2019, INDIAN J SCI TECHNOL, DOI DOI 10.17485/ijst/2019/v12i34/146150
  • [4] [Anonymous], 1988, Sage Annual Review of Communication Research: Advancing Communication Science
  • [5] [Anonymous], 2019, AAAI CONF ARTIF INTE
  • [6] OpenCrowd: A Human-Al Collaborative Approach for Finding Social Influencers via Open-Ended Answers Aggregation
    Arous, Ines
    Yang, Jie
    Khayati, Mourad
    Cudre-Mauroux, Philippe
    [J]. WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, : 1851 - 1862
  • [7] Human-AI Collaboration in a Cooperative Game Setting: Measuring Social Perception and Outcomes
    Ashktorab Z.
    Liao Q.V.
    Dugan C.
    Johnson J.
    Pan Q.
    Zhang W.
    Kumaravel S.
    Campbell M.
    [J]. Proceedings of the ACM on Human-Computer Interaction, 2020, 4 (CSCW2)
  • [8] The Hanabi challenge: A new frontier for AI research
    Bard, Nolan
    Foerster, Jakob N.
    Chandar, Sarath
    Burch, Neil
    Lanctot, Marc
    Song, H. Francis
    Parisotto, Emilio
    Dumoulin, Vincent
    Moitra, Subhodeep
    Hughes, Edward
    Dunning, Iain
    Mourad, Shibl
    Larochelle, Hugo
    Bellemare, Marc G.
    Bowling, Michael
    [J]. ARTIFICIAL INTELLIGENCE, 2020, 280
  • [9] Bard Nolan, 2019, ARXIV190200506
  • [10] Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots
    Bartneck, Christoph
    Kulic, Dana
    Croft, Elizabeth
    Zoghbi, Susana
    [J]. INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2009, 1 (01) : 71 - 81