Turn-Taking Prediction for Human-Robot Collaborative Assembly Considering Human Uncertainty

被引:4
|
作者
Xu, Wenjun [1 ,2 ]
Feng, Siqi [1 ,2 ]
Yao, Bitao [3 ]
Ji, Zhenrui [1 ,2 ]
Liu, Zhihao [1 ,2 ]
机构
[1] Wuhan Univ Technol, Sch Informat Engn, Wuhan 430070, Peoples R China
[2] Wuhan Univ Technol, Hubei Key Lab Broadband Wireless Commun & Sensor N, Wuhan 430070, Peoples R China
[3] Wuhan Univ Technol, Sch Mech & Elect Engn, Wuhan 430070, Peoples R China
来源
JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME | 2023年 / 145卷 / 12期
基金
中国国家自然科学基金;
关键词
human-robot collaboration; human uncertainty; spiking neural network; turn-taking; dynamic motion primitives; SPIKING NEURONS; NETWORKS; MODEL;
D O I
10.1115/1.4063231
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Human-robot collaboration (HRC) combines the repeatability and strength of robots and human's ability of cognition and planning to enable a flexible and efficient production mode. The ideal HRC process is that robots can smoothly assist workers in complex environments. This means that robots need to know the process's turn-taking earlier, adapt to the operating habits of different workers, and make reasonable plans in advance to improve the fluency of HRC. However, many of the current HRC systems ignore the fluent turn-taking between robots and humans, which results in unsatisfactory HRC and affects productivity. Moreover, there are uncertainties in humans as different humans have different operating proficiency, resulting in different operating speeds. This requires the robots to be able to make early predictions of turn-taking even when human is uncertain. Therefore, in this paper, an early turn-taking prediction method in HRC assembly tasks with Izhi neuron model-based spiking neural networks (SNNs) is proposed. On this basis, dynamic motion primitives (DMP) are used to establish trajectory templates at different operating speeds. The length of the sequence sent to the SNN network is judged by the matching degree between the observed data and the template, so as to adjust to human uncertainty. The proposed method is verified by the gear assembly case. The results show that our method can shorten the human-robot turn-taking recognition time under human uncertainty.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Learn How to Assist Humans Through Human Teaching and Robot Learning in Human-Robot Collaborative Assembly
    Sun, Yi
    Wang, Weitian
    Chen, Yi
    Jia, Yunyi
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2022, 52 (02): : 728 - 738
  • [32] Are we 'in sync': Turn-taking in collaborative dialogues
    Benus, Stefan
    INTERSPEECH 2009: 10TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2009, VOLS 1-5, 2009, : 2135 - 2138
  • [33] A method for human-robot complementary collaborative assembly based on knowledge graph
    Lv, Meng
    Feng, Zhiquan
    Yang, Xiaohui
    Liu, Baizhou
    CCF TRANSACTIONS ON PERVASIVE COMPUTING AND INTERACTION, 2025, 7 (01) : 70 - 86
  • [34] Monitoring model for enhancing adaptability in human-robot collaborative mold assembly
    Liau, Yee Yeng
    Ryu, Kwangyeol
    INTERNATIONAL JOURNAL OF COMPUTER INTEGRATED MANUFACTURING, 2024,
  • [35] Development and validation of guidelines for safety in human-robot collaborative assembly systems
    Gualtieri, Luca
    Rauch, Erwin
    Vidoni, Renato
    COMPUTERS & INDUSTRIAL ENGINEERING, 2022, 163
  • [36] Digital Twin for Designing and Reconfiguring Human-Robot Collaborative Assembly Lines
    Kousi, Niki
    Gkournelos, Christos
    Aivaliotis, Sotiris
    Lotsaris, Konstantinos
    Bavelos, Angelos Christos
    Baris, Panagiotis
    Michalos, George
    Makris, Sotiris
    APPLIED SCIENCES-BASEL, 2021, 11 (10):
  • [37] Complexity-based task allocation in human-robot collaborative assembly
    Malik, Ali Ahmad
    Bilberg, Arne
    INDUSTRIAL ROBOT-THE INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH AND APPLICATION, 2019, 46 (04): : 471 - 480
  • [38] Design of Advanced Human-Robot Collaborative Cells for Personalized Human-Robot Collaborations
    Umbrico, Alessandro
    Orlandini, Andrea
    Cesta, Amedeo
    Faroni, Marco
    Beschi, Manuel
    Pedrocchi, Nicola
    Scala, Andrea
    Tavormina, Piervincenzo
    Koukas, Spyros
    Zalonis, Andreas
    Fourtakas, Nikos
    Kotsaris, Panagiotis Stylianos
    Andronas, Dionisis
    Makris, Sotiris
    APPLIED SCIENCES-BASEL, 2022, 12 (14):
  • [39] The additive effect of turn-taking cues in human and synthetic voice
    Hjalmarsson, Anna
    SPEECH COMMUNICATION, 2011, 53 (01) : 23 - 35
  • [40] Human-robot collaborative disassembly line balancing considering the safe strategy in remanufacturing
    Xu, Wenjun
    Cui, Jia
    Liu, Bin
    Liu, Jiayi
    Yao, Bitao
    Zhou, Zude
    JOURNAL OF CLEANER PRODUCTION, 2021, 324