Intention estimation from gaze and motion features for human-robot shared-control object manipulation

被引:3
|
作者
Belardinelli, Anna [1 ]
Kondapally, Anirudh Reddy [2 ]
Ruiken, Dirk [1 ]
Tanneberg, Daniel [1 ]
Watabe, Tomoki [2 ]
机构
[1] Honda Res Inst EU, Offenbach, Germany
[2] Honda Res & Dev Co Ltd, Innovat Res Excellence, Wako, Saitama, Japan
来源
2022 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS) | 2022年
关键词
EYE-HAND COORDINATION; AUTONOMY CONTROL; RECOGNITION; SYSTEMS;
D O I
10.1109/IROS47612.2022.9982249
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Shared control can help in teleoperated object manipulation by assisting with the execution of the user's intention. To this end, robust and prompt intention estimation is needed, which relies on behavioral observations. Here, an intention estimation framework is presented, which uses natural gaze and motion features to predict the current action and the target object. The system is trained and tested in a simulated environment with pick and place sequences produced in a relatively cluttered scene and with both hands, with possible hand-over to the other hand. Validation is conducted across different users and hands, achieving good accuracy and earliness of prediction. An analysis of the predictive power of single features shows the predominance of the grasping trigger and the gaze features in the early identification of the current action. In the current framework, the same probabilistic model can be used for the two hands working in parallel and independently, while a rule-based model is proposed to identify the resulting bimanual action. Finally, limitations and perspectives of this approach to more complex, full-bimanual manipulations are discussed.
引用
收藏
页码:9806 / 9813
页数:8
相关论文
共 50 条
  • [31] Human-Robot Cooperative Object Manipulation with Contact Changes
    Gienger, Michael
    Ruiken, Dirk
    Bates, Tamas
    Regaieg, Mohamed
    Meissner, Michael
    Kober, Jens
    Seiwald, Philipp
    Hildebrandt, Arne-Christoph
    2018 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2018, : 1354 - 1360
  • [32] The Impacts of Unreliable Autonomy in Human-Robot Collaboration on Shared and Supervisory Control for Remote Manipulation
    Lin, Tsung-Chi
    Krishnan, Achyuthan Unni
    Li, Zhi
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (08) : 4641 - 4648
  • [33] Motion planning for human-robot interaction in manipulation tasks
    Esteves, Claudia
    Arechavaleta, Gustavo
    Laumond, Jean-Paul
    2005 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATIONS, VOLS 1-4, CONFERENCE PROCEEDINGS, 2005, : 1766 - 1771
  • [34] Natural Grasp Intention Recognition Based on Gaze in Human-Robot Interaction
    Yang, Bo
    Huang, Jian
    Chen, Xinxing
    Li, Xiaolong
    Hasegawa, Yasuhisa
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (04) : 2059 - 2070
  • [35] Eye-Hand Behavior in Human-Robot Shared Manipulation
    Aronson, Reuben M.
    Santini, Thiago
    Kuebler, Thomas C.
    Kasneci, Enkelejda
    Srinivasa, Siddhartha
    Admoni, Henny
    HRI '18: PROCEEDINGS OF THE 2018 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, 2018, : 4 - 13
  • [36] Grasp pose estimation in human-robot manipulation tasks using wearable motion sensors
    Cehajic, Denis
    Erhart, Sebastian
    Hirche, Sandra
    2015 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2015, : 1031 - 1036
  • [37] Human-robot cooperative manipulation with motion estimation using minimum-jerk model
    Maeda, Yusuke
    Hara, Takayuki
    Arai, Tamio
    Nippon Kikai Gakkai Ronbunshu, C Hen/Transactions of the Japan Society of Mechanical Engineers, Part C, 2002, 68 (11): : 3367 - 3372
  • [38] Engagement Intention Estimation in Multiparty Human-Robot Interaction
    Zhang, Zhijie
    Zheng, Jianmin
    Thalmann, Nadia Magnenat
    2021 30TH IEEE INTERNATIONAL CONFERENCE ON ROBOT AND HUMAN INTERACTIVE COMMUNICATION (RO-MAN), 2021, : 117 - 122
  • [39] Stiffness Estimation and Intention Detection for Human-Robot Collaboration
    Chen, Xiongjun
    Jiang, Yiming
    Yang, Chenguang
    PROCEEDINGS OF THE 15TH IEEE CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS (ICIEA 2020), 2020, : 1802 - 1807
  • [40] HUMAN INTENTION ESTIMATION WITH TACTILE SENSORS IN HUMAN-ROBOT COLLABORATION
    Wang, Yiwei
    Sheng, Yixuan
    Wang, Ji
    Zhang, Wenlong
    PROCEEDINGS OF THE ASME 10TH ANNUAL DYNAMIC SYSTEMS AND CONTROL CONFERENCE, 2017, VOL 2, 2017,