Collision Avoidance in Collaborative Robotics Based on Real-Time Skeleton Tracking

被引:4
|
作者
Forlini, Matteo [1 ]
Neri, Federico [1 ]
Scoccia, Cecilia [1 ]
Carbonari, Luca [1 ]
Palmieri, Giacomo [1 ]
机构
[1] Polytech Marche Univ, Dept Ind Engn & Math Sci, Ancona, Italy
来源
ADVANCES IN SERVICE AND INDUSTRIAL ROBOTICS, RAAD 2023 | 2023年 / 135卷
关键词
Collaborative Robotics; Human Robot Interaction; Obstacle Avoidance; Machine Learning; Computer Vision; Deep Learning;
D O I
10.1007/978-3-031-32606-6_10
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Human-robot interaction in manufacturing is increasing more and more due to the spread of collaborative robots. However, it is important to ensure operator safety and improve the operator's physical and mental well-being. In this paper, an obstacle avoidance algorithm is implemented exploiting a vision system for human motion tracking. Once the positions of the human body joints relative to the robot's base are known in real time, the manipulator is able to avoid collisions by changing the trajectory and ensuring task execution at the same time. The motion tracking system is realized with three RGB-D cameras and customized software based on artificial intelligence and machine learning techniques. The whole system was tested in a real human-robot interaction scenario with the Universal Robot UR5e manipulator. The robot is able to avoid collisions over its entire kinematic chain. The distance between the human body and the manipulator always remains above a safety distance that is a settable parameter of the algorithm.
引用
收藏
页码:81 / 88
页数:8
相关论文
共 50 条
  • [31] LiDAR and Camera Detection Fusion in a Real-Time Industrial Multi-Sensor Collision Avoidance System
    Wei, Pan
    Cagle, Lucas
    Reza, Tasmia
    Ball, John
    Gafford, James
    ELECTRONICS, 2018, 7 (06)
  • [32] A dense connection based network for real-time object tracking
    Lu, Yuwei
    Yuan, Yuan
    Wang, Qi
    NEUROCOMPUTING, 2020, 410 : 229 - 236
  • [33] Skeleton-Based Multifeatures and Multistream Network for Real-Time Action Recognition
    Deng, Zhiwen
    Gao, Qing
    Ju, Zhaojie
    Yu, Xiang
    IEEE SENSORS JOURNAL, 2023, 23 (07) : 7397 - 7409
  • [34] Bilateral symmetry detection for real-time robotics applications
    Li, Wai Ho
    Zhang, Alan M.
    Kleeman, Lindsay
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2008, 27 (07) : 785 - 814
  • [35] Real-time car tracking system based on surveillance videos
    Seungwon Jung
    Yongsung Kim
    Eenjun Hwang
    EURASIP Journal on Image and Video Processing, 2018
  • [36] Real-time Vehicle Detection and Tracking
    Arya, K. V.
    Tiwari, Shailendra
    Behwal, Saurabh
    2016 13TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2016,
  • [37] A Real-Time Pedestrian Tracking Method Based on Enhanced Tracktor
    Song, Huawei
    Li, Jian
    Wan, Fangjie
    Hong, Jiahao
    PROCEEDINGS OF 2023 7TH INTERNATIONAL CONFERENCE ON ELECTRONIC INFORMATION TECHNOLOGY AND COMPUTER ENGINEERING, EITCE 2023, 2023, : 812 - 817
  • [38] Development of an Automatic Lawnmower with Real-Time Computer Vision for Obstacle Avoidance
    Duan, Shuyong
    Ma, Honglei
    Zhang, Jialin
    Liu, Guirong
    INTERNATIONAL JOURNAL OF COMPUTATIONAL METHODS, 2022, 19 (08)
  • [39] Trajectory Planning with Collision Avoidance for Redundant Robots Using Jacobian and Artificial Potential Field-based Real-time Inverse Kinematics
    Park, Sun-Oh
    Lee, Min Cheol
    Kim, Jaehyung
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2020, 18 (08) : 2095 - 2107
  • [40] Trajectory Planning with Collision Avoidance for Redundant Robots Using Jacobian and Artificial Potential Field-based Real-time Inverse Kinematics
    Sun-Oh Park
    Min Cheol Lee
    Jaehyung Kim
    International Journal of Control, Automation and Systems, 2020, 18 : 2095 - 2107