Turn-Taking Prediction for Human-Robot Collaborative Assembly Considering Human Uncertainty

被引:4
|
作者
Xu, Wenjun [1 ,2 ]
Feng, Siqi [1 ,2 ]
Yao, Bitao [3 ]
Ji, Zhenrui [1 ,2 ]
Liu, Zhihao [1 ,2 ]
机构
[1] Wuhan Univ Technol, Sch Informat Engn, Wuhan 430070, Peoples R China
[2] Wuhan Univ Technol, Hubei Key Lab Broadband Wireless Commun & Sensor N, Wuhan 430070, Peoples R China
[3] Wuhan Univ Technol, Sch Mech & Elect Engn, Wuhan 430070, Peoples R China
来源
JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME | 2023年 / 145卷 / 12期
基金
中国国家自然科学基金;
关键词
human-robot collaboration; human uncertainty; spiking neural network; turn-taking; dynamic motion primitives; SPIKING NEURONS; NETWORKS; MODEL;
D O I
10.1115/1.4063231
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Human-robot collaboration (HRC) combines the repeatability and strength of robots and human's ability of cognition and planning to enable a flexible and efficient production mode. The ideal HRC process is that robots can smoothly assist workers in complex environments. This means that robots need to know the process's turn-taking earlier, adapt to the operating habits of different workers, and make reasonable plans in advance to improve the fluency of HRC. However, many of the current HRC systems ignore the fluent turn-taking between robots and humans, which results in unsatisfactory HRC and affects productivity. Moreover, there are uncertainties in humans as different humans have different operating proficiency, resulting in different operating speeds. This requires the robots to be able to make early predictions of turn-taking even when human is uncertain. Therefore, in this paper, an early turn-taking prediction method in HRC assembly tasks with Izhi neuron model-based spiking neural networks (SNNs) is proposed. On this basis, dynamic motion primitives (DMP) are used to establish trajectory templates at different operating speeds. The length of the sequence sent to the SNN network is judged by the matching degree between the observed data and the template, so as to adjust to human uncertainty. The proposed method is verified by the gear assembly case. The results show that our method can shorten the human-robot turn-taking recognition time under human uncertainty.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] Human Uncertainty-Aware MPC for Enhanced Human-Robot Collaborative Manipulation
    Mahmud, Al Jaber
    Nguyen, Duc M.
    Veiga, Filipe
    Xiao, Xuesu
    Wang, Xuan
    2024 IEEE 7TH INTERNATIONAL CONFERENCE ON INDUSTRIAL CYBER-PHYSICAL SYSTEMS, ICPS 2024, 2024,
  • [22] Editorial: Turn-Taking in Human Communicative Interaction
    Holler, Judith
    Kendrick, Kobin H.
    Casillas, Marisa
    Levinson, Stephen C.
    FRONTIERS IN PSYCHOLOGY, 2015, 6
  • [23] An Accurate Prediction Method of Human Assembly Motion for Human-Robot Collaboration
    Zhou, Yangzheng
    Luo, Liang
    Li, Pengzhong
    SYMMETRY-BASEL, 2024, 16 (01):
  • [24] KoPro - Configurable Process Chains for Human-Robot Collaborative Assembly
    Kranz, Philipp
    Schirmer, Fabian
    Mueller, Adrian
    Ali, Usama
    Schmitt, Jan
    Kaupp, Tobias
    COMPANION OF THE 2024 ACM/IEEE INTERNATIONAL CONFERENCE ON HUMAN-ROBOT INTERACTION, HRI 2024 COMPANION, 2024, : 1287 - 1289
  • [25] A strategy transfer approach for intelligent human-robot collaborative assembly
    Lv, Qibing
    Zhang, Rong
    Liu, Tianyuan
    Zheng, Pai
    Jiang, Yanan
    Li, Jie
    Bao, Jinsong
    Xiao, Lei
    COMPUTERS & INDUSTRIAL ENGINEERING, 2022, 168
  • [26] Worker in the Loop: A Framework for Enabling Human-Robot Collaborative Assembly
    Tzavara, Eleni
    Angelakis, Panagiotis
    Veloudis, George
    Gkournelos, Christos
    Makris, Sotiris
    ADVANCES IN PRODUCTION MANAGEMENT SYSTEMS: ARTIFICIAL INTELLIGENCE FOR SUSTAINABLE AND RESILIENT PRODUCTION SYSTEMS, APMS 2021, PT I, 2021, 630 : 275 - 283
  • [27] A structured methodology for the design of a human-robot collaborative assembly workplace
    João Costa Mateus
    Dieter Claeys
    Veronique Limère
    Johannes Cottyn
    El-Houssaine Aghezzaf
    The International Journal of Advanced Manufacturing Technology, 2019, 102 : 2663 - 2681
  • [28] A structured methodology for the design of a human-robot collaborative assembly workplace
    Mateus, Joao Costa
    Claeys, Dieter
    Limere, Veronique
    Cottyn, Johannes
    Aghezzaf, El-Houssaine
    INTERNATIONAL JOURNAL OF ADVANCED MANUFACTURING TECHNOLOGY, 2019, 102 (5-8) : 2663 - 2681
  • [29] Smooth Turn-taking by a Robot Using an Online Continuous Model to Generate Turn-taking Cues
    Lala, Divesh
    Inoue, Koji
    Kawahara, Tatsuya
    ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019, : 226 - 234
  • [30] Multimodal Data-Driven Robot Control for Human-Robot Collaborative Assembly
    Liu, Sichao
    Wang, Lihui
    Wang, Xi Vincent
    JOURNAL OF MANUFACTURING SCIENCE AND ENGINEERING-TRANSACTIONS OF THE ASME, 2022, 144 (05):