An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction

被引:52
作者
Li, Chengxi [1 ,2 ]
Zheng, Pai [1 ,2 ]
Yin, Yue [1 ]
Pang, Yat Ming [1 ,2 ]
Huo, Shengzeng [1 ,3 ]
机构
[1] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
[2] Hong Kong Sci Pk, Lab Artificial Intelligence Design, Hong Kong, Peoples R China
[3] Hong Kong Polytech Univ, Dept Mech Engn, Hong Kong, Peoples R China
关键词
Smart manufacturing; Human robot interaction; Augmented reality; Deep reinforcement learning; Manufacturing safety;
D O I
10.1016/j.rcim.2022.102471
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the emergence of Industry 5.0, the human-centric manufacturing paradigm requires manufacturing equipment (robots, etc.) interactively assist human workers to deal with dynamic and complex production tasks. To achieve symbiotic human-robot interaction (HRI), the safety issue serves as a prerequisite foundation. Regarding the growing individualized demand of manufacturing tasks, the conventional rule-based safe HRI measures could not well address the safety requirements due to inflexibility and lacking synergy. To fill the gap, this work proposes a mutual-cognitive safe HRI approach including worker visual augmentation, robot velocity control, Digital Twin-enabled motion preview and collision detection, and Deep Reinforcement Learning-based robot collision avoidance motion planning in the Augmented Reality-assisted manner. Finally, the feasibility of the system design and the performance of the proposed approach are validated by establishing and executing the prototype HRI system in a practical scene.
引用
收藏
页数:12
相关论文
共 40 条
  • [1] Systematic literature review on augmented reality in smart manufacturing: Collaboration between human and computational intelligence
    Baroroh, Dawi Karomati
    Chu, Chih-Hsing
    Wang, Lihui
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2021, 61 (61) : 696 - 711
  • [2] Bengio Y., 2009, P 26 ANN INT C MACH, P41, DOI DOI 10.1145/1553374.1553380
  • [3] Dynamic control model of a cobot with three omni-wheels
    Bi, Z. M.
    Wang, Lihui
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2010, 26 (06) : 558 - 563
  • [4] An integrated mixed reality system for safety-aware human-robot collaboration using deep learning and digital twin generation
    Choi, Sung Ho
    Park, Kyeong-Beom
    Roh, Dong Hyeon
    Lee, Jae Yeol
    Mohammed, Mustafa
    Ghasemi, Yalda
    Jeong, Heejin
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 73
  • [5] El-Shamouty M, 2020, IEEE INT CONF ROBOT, P4899, DOI [10.1109/icra40945.2020.9196924, 10.1109/ICRA40945.2020.9196924]
  • [6] Vision-based holistic scene understanding towards proactive human-robot collaboration
    Fan, Junming
    Zheng, Pai
    Li, Shufei
    [J]. ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2022, 75
  • [7] Planning and control of autonomous mobile robots for intralogistics: Literature review and research agenda
    Fragapane, Giuseppe
    de Koster, Rene
    Sgarbossa, Fabio
    Strandhagen, Jan Ola
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2021, 294 (02) : 405 - 426
  • [8] Fryman Jeff., 2012, ROBOTIK 2012
  • [9] 7th German Conference on Robotics, P1
  • [10] Haarnoja T, 2018, IEEE INT CONF ROBOT, P6244