RT-DLO: Real-Time Deformable Linear Objects Instance Segmentation

被引:17
作者
Caporali, Alessio [1 ]
Galassi, Kevin [1 ]
Zagar, Bare Luka [2 ]
Zanella, Riccardo [1 ]
Palli, Gianluca [1 ]
Knoll, Alois C. [2 ]
机构
[1] Univ Bologna, Dept Elect Elect & Informat Engn, I-40136 Bologna, Italy
[2] Tech Univ Munich, Chair Robot Artificial Intelligence & Real Time S, D-85748 Munich, Germany
关键词
Computer vision; deformable linear objects (DLO); industrial manufacturing; instance segmentation;
D O I
10.1109/TII.2023.3245641
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deformable linear objects (DLOs), such as cables, wires, ropes, and elastic tubes, are numerously present both in domestic and industrial environments. Unfortunately, robotic systems handling DLOs are rare and have limited capabilities due to the challenging nature of perceiving them. Hence, we propose a novel approach named RT-DLO for real-time instance segmentation of DLOs. First, the DLOs are semantically segmented from the background. Afterward, a novel method to separate the DLO instances is applied. It employs the generation of a graph representation of the scene given the semantic mask where the graph nodes are sampled from the DLOs center-lines whereas the graph edges are selected based on topological reasoning. RT-DLO is experimentally evaluated against both DLO-specific and general-purpose instance segmentation deep learning approaches, achieving overall better performances in terms of accuracy and inference time.
引用
收藏
页码:11333 / 11342
页数:10
相关论文
共 26 条
[1]   YOLACT plus plus Better Real-Time Instance Segmentation [J].
Bolya, Daniel ;
Zhou, Chong ;
Xiao, Fanyi ;
Lee, Yong Jae .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (02) :1108-1121
[2]   YOLACT Real-time Instance Segmentation [J].
Bolya, Daniel ;
Zhou, Chong ;
Xiao, Fanyi ;
Lee, Yong Jae .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9156-9165
[3]   DISTANCE TRANSFORMATIONS IN DIGITAL IMAGES [J].
BORGEFORS, G .
COMPUTER VISION GRAPHICS AND IMAGE PROCESSING, 1986, 34 (03) :344-371
[4]   Ariadne plus : Deep Learning--Based Augmented Framework for the Instance Segmentation of Wires [J].
Caporali, Alessio ;
Zanella, Riccardo ;
De Greogrio, Daniele ;
Palli, Gianluca .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (12) :8607-8617
[5]   FASTDLO: Fast Deformable Linear Objects Instance Segmentation [J].
Caporali, Alessio ;
Galassi, Kevin ;
Zanella, Riccardo ;
Palli, Gianluca .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) :9075-9082
[6]  
Chen LCE, 2018, PROC EUR C COMPUT VI, V11211, P833, DOI [10.1007/978-3-030-01234-2_49, DOI 10.1007/978-3-030-01234-249, DOI 10.1007/978-3-030-01234-2_49]
[7]   New Metrics for Industrial Depth Sensors Evaluation for Precise Robotic Applications [J].
Cop, Konrad P. ;
Peters, Arne ;
Zagar, Bare L. ;
Hettegger, Daniel ;
Knoll, Alois C. .
2021 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2021, :5350-5356
[8]   Let's Take a Walk on Superpixels Graphs: Deformable Linear Objects Segmentation and Model Estimation [J].
De Gregorio, Daniele ;
Palli, Gianluca ;
Di Stefano, Luigi .
COMPUTER VISION - ACCV 2018, PT II, 2019, 11362 :662-677
[9]   BlendMask: Top-Down Meets Bottom-Up for Instance Segmentation [J].
Chen, Hao ;
Sun, Kunyang ;
Tian, Zhi ;
Shen, Chunhua ;
Huang, Yongming ;
Yan, Youliang .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :8570-8578
[10]  
He KM, 2017, IEEE I CONF COMP VIS, P2980, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]