Reactive human-robot collaborative manipulation of deformable linear objects using a new topological latent control model

被引:25
作者
Zhou, Peng [1 ,3 ]
Zheng, Pai [2 ]
Qi, Jiaming [1 ]
Li, Chengxi [2 ]
Lee, Hoi-Yin [1 ]
Duan, Anqing [1 ]
Lu, Liang [3 ]
Li, Zhongxuan [3 ]
Hu, Luyin [3 ]
Navarro-Alarcon, David [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Mech Engn, Hong Kong, Peoples R China
[2] Hong Kong Polytech Univ, Dept Ind & Syst Engn, Hong Kong, Peoples R China
[3] Univ Hong Kong, Ctr Transformat Garment Prod, Hong Kong, Peoples R China
关键词
Deformable linear objects; Reactive manipulation; Latent control model; Human-robot collaboration; PERSISTENCE;
D O I
10.1016/j.rcim.2024.102727
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Real-time reactive manipulation of deformable linear objects is a challenging task that requires robots to quickly and adaptively respond to changes in the object's deformed shape that result from external forces. In this paper, a novel approach is proposed for real-time reactive deformable linear object manipulation in the context of human-robot collaboration. The proposed approach combines a topological latent representation and a fixed -time sliding mode controller to enable seamless interaction between humans and robots. The introduced topological control model offers a framework for controlling the dynamic shape of deformable objects. By leveraging the topological representation, our approach captures the connectivity and structure of the objects' shapes within a latent space. This enables improved generalization and performance when handling complex deformable shapes. A fixed -time sliding mode controller ensures that the object is manipulated in real-time, while also ensuring that it remains accurate and stable during the manipulation process. To validate our proposed framework, we first conduct motor -robot experiments to simulate fixed human interaction processes, enabling straightforward comparisons with other approaches. We then follow up with human-robot experiments to demonstrate the effectiveness of our approach.
引用
收藏
页数:20
相关论文
共 58 条
[1]   Model-Based Robot Control for Human-Robot Flexible Material Co-Manipulation [J].
Andronas, Dionisis ;
Kampourakis, Emmanouil ;
Bakopoulou, Katerina ;
Gkournelos, Christos ;
Angelakis, Panagiotis ;
Makris, Sotiris .
2021 26TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2021,
[2]   Monocular Visual Shape Tracking and Servoing for Isometrically Deforming Objects [J].
Aranda, Miguel ;
Ramon, Juan Antonio Corrales ;
Mezouar, Youcef ;
Bartoli, Adrien ;
Ozgur, Erol .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :7542-7549
[3]  
Berenson D, 2013, IEEE INT C INT ROBOT, P4525, DOI 10.1109/IROS.2013.6697007
[4]   Quasi-static manipulation of a Kirchhoff elastic rod based on a geometric analysis of equilibrium configurations [J].
Bretl, Timothy ;
McCarthy, Zoe .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2014, 33 (01) :48-68
[5]   A Weakly Supervised Semi-Automatic Image Labeling Approach for Deformable Linear Objects [J].
Caporali, Alessio ;
Pantano, Matteo ;
Janisch, Lucas ;
Regulin, Daniel ;
Palli, Gianluca ;
Lee, Dongheui .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (02) :1013-1020
[6]   FASTDLO: Fast Deformable Linear Objects Instance Segmentation [J].
Caporali, Alessio ;
Galassi, Kevin ;
Zanella, Riccardo ;
Palli, Gianluca .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) :9075-9082
[7]   The relevance of signal timing in human-robot collaborative manipulation [J].
Cini, F. ;
Banfi, T. ;
Ciuti, G. ;
Craighero, L. ;
Controzzi, M. .
SCIENCE ROBOTICS, 2021, 6 (58)
[8]   Stability of persistence diagrams [J].
Cohen-Steiner, David ;
Edelsbrunner, Herbert ;
Harer, John .
DISCRETE & COMPUTATIONAL GEOMETRY, 2007, 37 (01) :103-120
[9]   Combining trajectory optimization, supervised machine learning, and model structure for mitigating the curse of dimensionality in the control of bipedal robots [J].
Da, Xingye ;
Grizzle, Jessy .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2019, 38 (09) :1063-1097
[10]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38