Continual learning from demonstration of robotics skills

被引:8
|
作者
Auddy, Sayantan [1 ]
Hollenstein, Jakob [1 ]
Saveriano, Matteo [2 ]
Rodriguez-Sanchez, Antonio [1 ]
Piater, Justus [1 ,3 ]
机构
[1] Univ Innsbruck, Dept Comp Sci, Innsbruck, Austria
[2] Univ Trento, Dept Ind Engn, Trento, Italy
[3] Univ Innsbruck, Digital Sci Ctr DiSC, Innsbruck, Austria
关键词
Learning from demonstration; Continual learning; Hypernetwork; Neural ordinary differential equation solver; MANIPULATION; STABILITY; IMITATION; ENSURE;
D O I
10.1016/j.robot.2023.104427
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equation solvers. We empirically demonstrate the effectiveness of this approach in remembering long sequences of trajectory learning tasks without the need to store any data from past demonstrations. Our results show that hypernetworks outperform other state-of-the-art continual learning approaches for learning from demonstration. In our experiments, we use the popular LASA benchmark, and two new datasets of kinesthetic demonstrations collected with a real robot that we introduce in this paper called the HelloWorld and RoboTasks datasets. We evaluate our approach on a physical robot and demonstrate its effectiveness in learning real-world robotic tasks involving changing positions as well as orientations. We report both trajectory error metrics and continual learning metrics, and we propose two new continual learning metrics. Our code, along with the newly collected datasets, is available at https://github.com/sayantanauddy/clfd. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
引用
收藏
页数:21
相关论文
共 50 条
  • [1] Development of a Framework for Continual Learning in Industrial Robotics
    Minh Trinh
    Moon, Jiyoung
    Gruendel, Lukas
    Hankemeier, Victoria
    Storms, Simon
    Brecher, Christian
    2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [2] Continual Learning for Affective Robotics: A Proof of Concept for Wellbeing
    Churamani, Nikhil
    Axelsson, Minja
    Caldir, Atahan
    Gunes, Hatice
    2022 10TH INTERNATIONAL CONFERENCE ON AFFECTIVE COMPUTING AND INTELLIGENT INTERACTION WORKSHOPS AND DEMOS, ACIIW, 2022,
  • [3] Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges
    Lesort, Timothee
    Lomonaco, Vincenzo
    Stoian, Andrei
    Maltoni, Davide
    Filliat, David
    Diaz-Rodriguez, Natalia
    INFORMATION FUSION, 2020, 58 : 52 - 68
  • [4] ACCUMULATING CONVERSATIONAL SKILLS USING CONTINUAL LEARNING
    Lee, Sungjin
    2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018), 2018, : 862 - 867
  • [5] Passive Bimanual Skills Learning From Demonstration With Motion Graph Attention Networks
    Dong, Zhipeng
    Li, Zhihao
    Yan, Yunhui
    Calinon, Sylvain
    Chen, Fei
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 4917 - 4923
  • [6] Learning by Demonstration for Planning Activities of Daily Living in Rehabilitation and Assistive Robotics
    Lauretti, Clemente
    Cordella, Francesca
    Guglielmelli, Eugenio
    Zollo, Loredana
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2017, 2 (03): : 1375 - 1382
  • [7] Learning Force-Relevant Skills from Human Demonstration
    Gao, Xiao
    Ling, Jie
    Xiao, Xiaohui
    Li, Miao
    COMPLEXITY, 2019, 2019
  • [8] Continual Learning From a Stream of APIs
    Yang, Enneng
    Wang, Zhenyi
    Shen, Li
    Yin, Nan
    Liu, Tongliang
    Guo, Guibing
    Wang, Xingwei
    Tao, Dacheng
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 11432 - 11445
  • [9] Fuzzy dynamical system for robot learning motion skills from human demonstration
    Teng, Tao
    Gatti, Matteo
    Poni, Stefano
    Caldwell, Darwin
    Chen, Fei
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 164
  • [10] Learning stable robotic skills on Riemannian manifolds
    Saveriano, Matteo
    Abu-Dakka, Fares J.
    Kyrki, Ville
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 169