Collision Avoidance in Collaborative Robotics Based on Real-Time Skeleton Tracking

被引:4
|
作者
Forlini, Matteo [1 ]
Neri, Federico [1 ]
Scoccia, Cecilia [1 ]
Carbonari, Luca [1 ]
Palmieri, Giacomo [1 ]
机构
[1] Polytech Marche Univ, Dept Ind Engn & Math Sci, Ancona, Italy
来源
ADVANCES IN SERVICE AND INDUSTRIAL ROBOTICS, RAAD 2023 | 2023年 / 135卷
关键词
Collaborative Robotics; Human Robot Interaction; Obstacle Avoidance; Machine Learning; Computer Vision; Deep Learning;
D O I
10.1007/978-3-031-32606-6_10
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human-robot interaction in manufacturing is increasing more and more due to the spread of collaborative robots. However, it is important to ensure operator safety and improve the operator's physical and mental well-being. In this paper, an obstacle avoidance algorithm is implemented exploiting a vision system for human motion tracking. Once the positions of the human body joints relative to the robot's base are known in real time, the manipulator is able to avoid collisions by changing the trajectory and ensuring task execution at the same time. The motion tracking system is realized with three RGB-D cameras and customized software based on artificial intelligence and machine learning techniques. The whole system was tested in a real human-robot interaction scenario with the Universal Robot UR5e manipulator. The robot is able to avoid collisions over its entire kinematic chain. The distance between the human body and the manipulator always remains above a safety distance that is a settable parameter of the algorithm.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [41] Study on Real-Time Obstacle Avoidance of Mobile Robot Based on Vision Sensor
    Wen, Fan
    Qu, Zhenshen
    Wang, Changhong
    Hu, Bin
    2008 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS, VOLS 1-6, 2008, : 2438 - 2442
  • [42] A comparison of human skeleton extractors for real-time human-robot interaction
    Li, Wanchen
    Passama, Robin
    Bonnet, Vincent
    Cherubini, Andrea
    2023 IEEE INTERNATIONAL CONFERENCE ON ADVANCED ROBOTICS AND ITS SOCIAL IMPACTS, ARSO, 2023, : 159 - 165
  • [43] Real-Time Lane/Pothole Detection and Collision Avoidance Algorithm for Low-cost Autonomous Driving Systems
    Shin, Hyunjun
    Yeom, Taesun
    Lee, Seokwon
    TRANSACTIONS OF THE KOREAN SOCIETY OF MECHANICAL ENGINEERS A, 2023, 47 (11) : 901 - 909
  • [44] Real-time obstacle avoidance algorithm based on pigeon-inspired optimization
    Li S.
    He J.
    Ao H.
    Liu Y.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2021, 47 (02): : 359 - 365
  • [45] Real-time robust visual tracking based on spatial attention mechanism
    Ma S.
    Zhang Z.
    Pu L.
    Hou Z.
    Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2024, 50 (02): : 419 - 432
  • [46] Real-time Multi Pose Trajectory Tracking based on OpenPose Keypoints
    Surowka, Adam
    PROCEEDINGS OF THE 11TH IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT DATA ACQUISITION AND ADVANCED COMPUTING SYSTEMS: TECHNOLOGY AND APPLICATIONS (IDAACS'2021), VOL 2, 2021, : 813 - 817
  • [47] A Real-Time Object Tracking model based on Deeper Siamese Network
    Zou, Qijie
    Zhang, Yue
    Liu, Shihui
    Yu, Jing
    PROCEEDINGS OF 2020 3RD INTERNATIONAL CONFERENCE ON UNMANNED SYSTEMS (ICUS), 2020, : 1089 - 1094
  • [48] Real-time obstacle avoidance for multiple mobile robots
    Fahimi, Farbod
    Nataraj, C.
    Ashrafiuon, Hashem
    ROBOTICA, 2009, 27 : 189 - 198
  • [49] Design of real-time rhythm tracking system based on neural network
    Sun, Yuanyuan
    Jin, Cong
    Zhao, Wei
    Wang, Nansu
    2018 5TH INTERNATIONAL CONFERENCE ON SYSTEMS AND INFORMATICS (ICSAI), 2018, : 356 - 360
  • [50] Efficient Real-Time Tracking of Satellite Components Based on Frame Matching
    Zhang, Hao
    Zhang, Yang
    Gao, Jingmin
    Yang, Hongbo
    Zhang, Kebei
    IEEE ACCESS, 2022, 10 : 132515 - 132524