A Dynamic Movement Primitives-Based Tool Use Skill Learning and Transfer Framework for Robot Manipulation

被引:6
作者
Lu, Zhenyu [1 ]
Wang, Ning [1 ]
Yang, Chenguang [1 ,2 ]
机构
[1] Univ West England, Bristol Robot Lab, Bristol BS16 1QY, Avon, England
[2] Univ Liverpool, Dept Comp Sci, Liverpool L69 3BX, Merseyside, England
基金
英国工程与自然科学研究理事会;
关键词
Dynamic movement primitives; robot learning; skill transfer; multi-tool use skill; robot manipulation; MOTION;
D O I
10.1109/TASE.2024.3370139
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper presents a framework for learning and transferring robot tool-use skills based on Dynamic Movement Primitives (DMPs) for robot fine manipulation. DMPs and their enhanced methods are employed to acquire a specific tool-use skill applicable to tools with similar sizes, shapes, and uses. However, the acquired skills may not be transferable to other scenarios and tools with variations. The new framework introduces two new types of skills based on DMPs: Object Operating (O2) skill and Tool Flipping (TF) skill. The O2 skill enables robots to handle tools for manipulating objects to achieve desired effects. The learning process for the O2 skill considers limitations imposed by tools and the environment during human demonstrations. Distinguishing between whether constraints can be modelled or not, we propose both a model-based and a constraint-based method to separate a constraint-irrelevant (CI) skill and the constrained conditions. The CI skill is generalized using a novel method called constrained -DMP lite, enabling adaptation to new tasks with special tools. The TF skill addresses situations where tools must generate an action to alter contacting positions on both objects and tools while avoiding conflicts during movement. Finally, the TF and O2 skills are generalized to be applied in creating a continuous action chain. We conduct several experiments to compare and analyze the advantages and disadvantages of the proposed methods with other approaches in terms of generalizability and calculation complexity. Note to Practitioners-Strengthening robot tool-use ability has been a hot research topic in recent years because these tools can extend the reachability and enhance the flexibility of robots. The previous research on DMPs has been utilized for learning tool-use skills. However, the learned skills few considered the tools' special use regulations, therefore the skill of using a tool is hard to transfer to another tool-use case. This paper explores tool-use skill learning and transfer between different tools by developing a framework based on the DMPs for this problem. The framework consists of two kinds of skills: O2 skill and TF skill with different purposes as well as a series of newly developed algorithms, such as constrained -DMP lite, a model-based and a constraint-based CI skill learning methods. These methods can separate the constraints from human demonstrations of using tools to achieve a CI skill and generalize the CI skill according to the constraints generated from a new tool-use manipulation task. We verify the effectiveness of the proposed framework through some typical tool-use experiments, including pushing objects, cutting and obstacle avoidance in actuality. The development of this framework can be used in industrial and house working scenarios.
引用
收藏
页码:1748 / 1763
页数:16
相关论文
共 73 条
[51]  
Qin ZY, 2020, IEEE INT CONF ROBOT, P7278, DOI [10.1109/ICRA40945.2020.9196971, 10.1109/icra40945.2020.9196971]
[52]   Recent Advances in Robot Learning from Demonstration [J].
Ravichandar, Harish ;
Polydoros, Athanasios S. ;
Chernova, Sonia ;
Billard, Aude .
ANNUAL REVIEW OF CONTROL, ROBOTICS, AND AUTONOMOUS SYSTEMS, VOL 3, 2020, 2020, 3 :297-330
[53]   Tool-Use Model to Reproduce the Goal Situations Considering Relationship Among Tools, Objects, Actions and Effects Using Multimodal Deep Neural Networks [J].
Saito, Namiko ;
Ogata, Tetsuya ;
Mori, Hiroki ;
Murata, Shingo ;
Sugano, Shigeki .
FRONTIERS IN ROBOTICS AND AI, 2021, 8
[54]  
Seita D., 2023, C ROBOT LEARNING, P1038
[55]   Toward Teaching by Demonstration for Robot-Assisted Minimally Invasive Surgery [J].
Su, Hang ;
Mariani, Andrea ;
Ovur, Salih Ertug ;
Menciassi, Arianna ;
Ferrigno, Giancarlo ;
De Momi, Elena .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2021, 18 (02) :484-494
[56]   Tool-body assimilation model considering grasping motion through deep learning [J].
Takahashi, Kuniyuki ;
Kim, Kitae ;
Ogata, Tetsuya ;
Sugano, Shigeki .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2017, 91 :115-127
[57]   Learning to pour with a robot arm combining goal and shape learning for dynamic movement primitives [J].
Tamosiunaite, Minija ;
Nemec, Bojan ;
Ude, Ales ;
Woergoetter, Florentin .
ROBOTICS AND AUTONOMOUS SYSTEMS, 2011, 59 (11) :910-922
[58]   A framework for tool cognition in robots without prior tool learning or observation [J].
Tee, Keng Peng ;
Cheong, Samuel ;
Li, Jun ;
Ganesh, Gowrishankar .
NATURE MACHINE INTELLIGENCE, 2022, 4 (06) :533-543
[59]  
Tee KP, 2018, IEEE INT CONF ROBOT, P6439
[60]  
Umlauft J, 2014, IEEE INT CONF ROBOT, P766, DOI 10.1109/ICRA.2014.6906941