Predicting Trust in Human Control of Swarms via Inverse Reinforcement Learning

被引:0
|
作者
Nam, Changjoo [1 ]
Walker, Phillip [2 ]
Lewis, Michael [2 ]
Sycara, Katia [1 ]
机构
[1] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
[2] Univ Pittsburgh, Sch Informat Sci, Pittsburgh, PA 15260 USA
来源
2017 26TH IEEE INTERNATIONAL SYMPOSIUM ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN) | 2017年
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we study the model of human trust where an operator controls a robotic swarm remotely for a search mission. Existing trust models in human-in the-loop systems are based on task performance of robots. However, we find that humans tend to make their decisions based on physical characteristics of the swarm rather than its performance since task performance of swarms is not clearly perceivable by humans. We formulate trust as a Markov decision process whose state space includes physical parameters of the swarm. We employ an inverse reinforcement learning algorithm to learn behaviors of the operator from a single demonstration. The learned behaviors are used to predict the trust level of the operator based on the features of the swarm.
引用
收藏
页码:528 / 533
页数:6
相关论文
共 50 条
  • [1] An Application of Inverse Reinforcement Learning to Estimate Interference in Drone Swarms
    Kim, Keum Joo
    Santos, Eugene
    Nguyen, Hien
    Pieper, Shawn
    ENTROPY, 2022, 24 (10)
  • [2] Trust-Region Inverse Reinforcement Learning
    Cao, Kun
    Xie, Lihua
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (02) : 1037 - 1044
  • [3] Predicting Goal-directed Human Attention Using Inverse Reinforcement Learning
    Yang, Zhibo
    Huang, Lihan
    Chen, Yupei
    Wei, Zijun
    Ahn, Seoyoung
    Zelinsky, Gregory
    Samaras, Dimitris
    Hoai, Minh
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 190 - 199
  • [4] Machining sequence learning via inverse reinforcement learning
    Sugisawa, Yasutomo
    Takasugi, Keigo
    Asakawa, Naoki
    PRECISION ENGINEERING-JOURNAL OF THE INTERNATIONAL SOCIETIES FOR PRECISION ENGINEERING AND NANOTECHNOLOGY, 2022, 73 : 477 - 487
  • [5] Reinforcement learning in swarms that learn
    Peters, JF
    Henry, C
    Ramanna, S
    2005 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON INTELLIGENT AGENT TECHNOLOGY, PROCEEDINGS, 2005, : 400 - 406
  • [6] Flocking Control of UAV Swarms with Deep Reinforcement Learning Approach
    Yan, Peng
    Bai, Chengchao
    Zheng, Hongxing
    Guo, Jifeng
    PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 592 - 599
  • [7] Inverse Reinforcement Learning in Tracking Control Based on Inverse Optimal Control
    Xue, Wenqian
    Kolaric, Patrik
    Fan, Jialu
    Lian, Bosen
    Chai, Tianyou
    Lewis, Frank L.
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) : 10570 - 10581
  • [8] Haptic Assistance via Inverse Reinforcement Learning
    Scobee, Dexter R. R.
    Royo, Vicenc Rubies
    Tomlin, Claire J.
    Sastry, S. Shankar
    2018 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2018, : 1510 - 1517
  • [9] Towards Interpretable Deep Reinforcement Learning Models via Inverse Reinforcement Learning
    Xie, Yuansheng
    Vosoughi, Soroush
    Hassanpour, Saeed
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 5067 - 5074
  • [10] Models of Trust in Human Control of Swarms With Varied Levels of Autonomy
    Nam, Changjoo
    Walker, Phillip
    Li, Huao
    Lewis, Michael
    Sycara, Katia
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2020, 50 (03) : 194 - 204