Deformable One-Dimensional Object Detection for Routing and Manipulation

被引:17
作者
Keipour, Azarakhsh [1 ]
Bandari, Maryam [2 ]
Schaal, Stefan [2 ]
机构
[1] Carnegie Mellon Univ, Robot Inst, Pittsburgh, PA 15213 USA
[2] Google, Mountain View, CA 94040 USA
关键词
Image segmentation; Skeleton; Cameras; Shape; Deformable models; Routing; Predictive models; Computer vision for automation; computer vision for medical robotics; deformable object detection; object detection; perception for grasping and manipulation; segmentation and categorization;
D O I
10.1109/LRA.2022.3146920
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Many methods exist to model and track deformable one-dimensional objects (e.g., cables, ropes, and threads) across a stream of video frames. However, these methods depend on the existence of some initial conditions. To the best of our knowledge, the topic of detection methods that can extract those initial conditions in non-trivial situations has hardly been addressed. The lack of detection methods limits the use of the tracking methods in real-world applications and is a bottleneck for fully autonomous applications that work with these objects. This letter proposes an approach for detecting deformable one-dimensional objects which can handle crossings and occlusions. It can be used for tasks such as routing and manipulation and automatically provides the initialization required by the tracking methods. Our algorithm takes an image containing a deformable object and outputs a chain of fixed-length cylindrical segments connected with passive spherical joints. The chain follows the natural behavior of the deformable object and fills the gaps and occlusions in the original image. Our tests and experiments have shown that the method can correctly detect deformable one-dimensional objects in various complex conditions.
引用
收藏
页码:4329 / 4336
页数:8
相关论文
共 30 条
[1]   Modeling of Deformable Objects for Robotic Manipulation: A Tutorial and Review [J].
Arriola-Rios, Veronica E. ;
Guler, Puren ;
Ficuciello, Fanny ;
Kragic, Danica ;
Siciliano, Bruno ;
Wyatt, Jeremy L. .
FRONTIERS IN ROBOTICS AND AI, 2020, 7
[2]  
Frangi AF, 1998, LECT NOTES COMPUT SC, V1496, P130, DOI 10.1007/BFb0056195
[3]   An Overview of Contour Detection Approaches [J].
Gong X.-Y. ;
Su H. ;
Xu D. ;
Zhang Z.-T. ;
Shen F. ;
Yang H.-B. .
International Journal of Automation and Computing, 2018, 15 (06) :656-672
[4]  
Hachaj T, 2012, LECT NOTES ARTIF INT, V7198, P495, DOI 10.1007/978-3-642-28493-9_52
[5]  
Javdani S, 2011, IEEE INT CONF ROBOT, P1607
[6]  
Keipour A, ARXIV220206172, V2022
[7]  
Keipour A, 2013, ARXIV220206371
[8]   Real-Time Ellipse Detection for Robotics Applications [J].
Keipour, Azarakhsh ;
Pereira, Guilherme A. S. ;
Scherer, Sebastian .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) :7009-7016
[9]   Model-based detection of tubular structures in 3D images [J].
Krissian, K ;
Malandain, G ;
Ayache, N ;
Vaillant, R ;
Trousset, Y .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2000, 80 (02) :130-171
[10]  
Lai YJ, 2018, IEEE INT CON AUTO SC, P471, DOI 10.1109/COASE.2018.8560497