Turn-Taking Prediction for Human-Robot Collaborative Assembly Considering Human Uncertainty

被引:4
|
作者
Xu, Wenjun [1 ,2 ]
Feng, Siqi [1 ,2 ]
Yao, Bitao [3 ]
Ji, Zhenrui [1 ,2 ]
Liu, Zhihao [1 ,2 ]
机构
[1] Wuhan Univ Technol, Sch Informat Engn, Wuhan 430070, Peoples R China
[2] Wuhan Univ Technol, Hubei Key Lab Broadband Wireless Commun & Sensor N, Wuhan 430070, Peoples R China
[3] Wuhan Univ Technol, Sch Mech & Elect Engn, Wuhan 430070, Peoples R China
来源
JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME | 2023年 / 145卷 / 12期
基金
中国国家自然科学基金;
关键词
human-robot collaboration; human uncertainty; spiking neural network; turn-taking; dynamic motion primitives; SPIKING NEURONS; NETWORKS; MODEL;
D O I
10.1115/1.4063231
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Human-robot collaboration (HRC) combines the repeatability and strength of robots and human's ability of cognition and planning to enable a flexible and efficient production mode. The ideal HRC process is that robots can smoothly assist workers in complex environments. This means that robots need to know the process's turn-taking earlier, adapt to the operating habits of different workers, and make reasonable plans in advance to improve the fluency of HRC. However, many of the current HRC systems ignore the fluent turn-taking between robots and humans, which results in unsatisfactory HRC and affects productivity. Moreover, there are uncertainties in humans as different humans have different operating proficiency, resulting in different operating speeds. This requires the robots to be able to make early predictions of turn-taking even when human is uncertain. Therefore, in this paper, an early turn-taking prediction method in HRC assembly tasks with Izhi neuron model-based spiking neural networks (SNNs) is proposed. On this basis, dynamic motion primitives (DMP) are used to establish trajectory templates at different operating speeds. The length of the sequence sent to the SNN network is judged by the matching degree between the observed data and the template, so as to adjust to human uncertainty. The proposed method is verified by the gear assembly case. The results show that our method can shorten the human-robot turn-taking recognition time under human uncertainty.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] Timing Multimodal Turn-Taking for Human-Robot Cooperation
    Chao, Crystal
    ICMI '12: PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2012, : 309 - 312
  • [2] Turn-taking in Conversational Systems and Human-Robot Interaction: A Review
    Skantze, Gabriel
    COMPUTER SPEECH AND LANGUAGE, 2021, 67
  • [3] GATED MULTIMODAL FUSION WITH CONTRASTIVE LEARNING FOR TURN-TAKING PREDICTION IN HUMAN-ROBOT DIALOGUE
    Yang, Jiudong
    Wang, Peiying
    Zhu, Yi
    Feng, Mingchao
    Chen, Meng
    He, Xiaodong
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 7747 - 7751
  • [4] Turn-taking, feedback and joint attention in situated human-robot interaction
    Skantze, Gabriel
    Hjalmarsson, Anna
    Oertel, Catharine
    SPEECH COMMUNICATION, 2014, 65 : 50 - 66
  • [5] Timed Petri nets for fluent turn-taking over multimodal interaction resources in human-robot collaboration
    Chao, Crystal
    Thomaz, Andrea
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2016, 35 (11) : 1371 - 1394
  • [6] Analysis of Timing and Effect of Visual Cue on Turn-Taking in Human-Robot Interaction
    Obo, Takenori
    Takizawa, Kazuma
    JOURNAL OF ROBOTICS AND MECHATRONICS, 2022, 34 (01) : 55 - 63
  • [7] Sensorless Human-Robot Collaborative Assembly Considering Load and Friction Compensation
    Xiao, Juliang
    Dou, Saixiong
    Zhao, Wei
    Liu, Haitao
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (03): : 5945 - 5952
  • [8] Turn-Taking Intention Recognition using Multimodal Cues in Social Human-Robot Interaction
    Park, Cheonshu
    Kim, Jaehong
    Kang, Ji-Hoon
    2017 17TH INTERNATIONAL CONFERENCE ON CONTROL, AUTOMATION AND SYSTEMS (ICCAS), 2017, : 1300 - 1302
  • [9] Early Turn-taking Prediction with Spiking Neural Networks for Human Robot Collaboration
    Zhou, Tian
    Wachs, Juan P.
    2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, : 3250 - 3256
  • [10] Symbiotic human-robot collaborative assembly
    Wang, L.
    Gao, R.
    Vancza, J.
    Krueger, J.
    Wang, X., V
    Makris, S.
    Chryssolouris, G.
    CIRP ANNALS-MANUFACTURING TECHNOLOGY, 2019, 68 (02) : 701 - 726