Continual learning from demonstration of robotics skills

被引:8
|
作者
Auddy, Sayantan [1 ]
Hollenstein, Jakob [1 ]
Saveriano, Matteo [2 ]
Rodriguez-Sanchez, Antonio [1 ]
Piater, Justus [1 ,3 ]
机构
[1] Univ Innsbruck, Dept Comp Sci, Innsbruck, Austria
[2] Univ Trento, Dept Ind Engn, Trento, Italy
[3] Univ Innsbruck, Digital Sci Ctr DiSC, Innsbruck, Austria
关键词
Learning from demonstration; Continual learning; Hypernetwork; Neural ordinary differential equation solver; MANIPULATION; STABILITY; IMITATION; ENSURE;
D O I
10.1016/j.robot.2023.104427
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Methods for teaching motion skills to robots focus on training for a single skill at a time. Robots capable of learning from demonstration can considerably benefit from the added ability to learn new movement skills without forgetting what was learned in the past. To this end, we propose an approach for continual learning from demonstration using hypernetworks and neural ordinary differential equation solvers. We empirically demonstrate the effectiveness of this approach in remembering long sequences of trajectory learning tasks without the need to store any data from past demonstrations. Our results show that hypernetworks outperform other state-of-the-art continual learning approaches for learning from demonstration. In our experiments, we use the popular LASA benchmark, and two new datasets of kinesthetic demonstrations collected with a real robot that we introduce in this paper called the HelloWorld and RoboTasks datasets. We evaluate our approach on a physical robot and demonstrate its effectiveness in learning real-world robotic tasks involving changing positions as well as orientations. We report both trajectory error metrics and continual learning metrics, and we propose two new continual learning metrics. Our code, along with the newly collected datasets, is available at https://github.com/sayantanauddy/clfd. (c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/).
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Continual learning with selective nets
    Luu, Hai Tung
    Szemenyei, Marton
    APPLIED INTELLIGENCE, 2025, 55 (07)
  • [32] Advances and Trends of Continual Learning
    Li, Wenbin
    Xiong, Yakun
    Fan, Zhichen
    Deng, Bo
    Cao, Fuyuan
    Gao, Yang
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2024, 61 (06): : 1476 - 1496
  • [33] Continual Learning, Fast and Slow
    Pham, Quang
    Liu, Chenghao
    Hoi, Steven C. H.
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (01) : 134 - 149
  • [34] Continual Information Cascade Learning
    Zhou, Fan
    Jing, Xin
    Xu, Xovee
    Zhong, Ting
    Trajcevski, Goce
    Wu, Jin
    2020 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2020,
  • [35] Adaptive Progressive Continual Learning
    Xu, Ju
    Ma, Jin
    Gao, Xuesong
    Zhu, Zhanxing
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 6715 - 6728
  • [36] Continual learning in the presence of repetition
    Hemati, Hamed
    Pellegrini, Lorenzo
    Duan, Xiaotian
    Zhao, Zixuan
    Xia, Fangfang
    Masana, Marc
    Tscheschner, Benedikt
    Veas, Eduardo
    Zheng, Yuxiang
    Zhao, Shiji
    Li, Shao-Yuan
    Huang, Sheng-Jun
    Lomonaco, Vincenzo
    van de Ven, Gido M.
    NEURAL NETWORKS, 2025, 183
  • [37] Progressive learning: A deep learning framework for continual learning
    Fayek, Haytham M.
    Cavedon, Lawrence
    Wu, Hong Ren
    NEURAL NETWORKS, 2020, 128 : 345 - 357
  • [38] CONTINUAL LEARNING IN VISION TRANSFORMER
    Takeda, Mana
    Yanai, Keiji
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 616 - 620
  • [39] Continual Learning in Predictive Autoscaling
    Hao, Hongyan
    Chu, Zhixuan
    Zhu, Shiyi
    Jiang, Gangwei
    Wang, Yan
    Jiang, Caigao
    Zhang, James Y.
    Jiang, Wei
    Xue, Siqiao
    Zhou, Jun
    PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023, 2023, : 4616 - 4622
  • [40] Dynamic learning rates for continual unsupervised learning
    David Fernandez-Rodriguez, Jose
    Jose Palomo, Esteban
    Miguel Ortiz-De-Lazcano-Lobato, Juan
    Ramos-Jimenez, Gonzalo
    Lopez-Rubio, Ezequiel
    INTEGRATED COMPUTER-AIDED ENGINEERING, 2023, 30 (03) : 257 - 273