Efficient Reinforcement Learning of Task Planners for Robotic Palletization Through Iterative Action Masking Learning

被引:0
|
作者
Wu, Zheng [1 ]
Li, Yichuan [2 ]
Zhan, Wei [1 ]
Liu, Changliu [3 ]
Liu, Yun-Hui [2 ]
Tomizuka, Masayoshi [1 ]
机构
[1] Univ Calif Berkeley, Dept Mech Engn, Berkeley, CA 92093 USA
[2] Chinese Univ Hong Kong, T Stone Robot Inst, Dept Mech & Automat Engn, Hong Kong, Peoples R China
[3] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 11期
关键词
Three-dimensional displays; Robots; Task analysis; Pallets; Planning; Training; Thermal stability; Action space masking; reinforcement learning; robotic palletization; PACKING;
D O I
10.1109/LRA.2024.3440731
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The development of robotic systems for palletization in logistics scenarios is of paramount importance, addressing critical efficiency and precision demands in supply chain management. This paper investigates the application of Reinforcement Learning (RL) in enhancing task planning for such robotic systems. Confronted with the substantial challenge of a vast action space, which is a significant impediment to efficiently apply out-of-the-shelf RL methods, our study introduces a novel method of utilizing supervised learning to iteratively prune and manage the action space effectively. By reducing the complexity of the action space, our approach not only accelerates the learning phase but also ensures the effectiveness and reliability of the task planning in robotic palletization. The experiemental results underscore the efficacy of this method, highlighting its potential in improving the performance of RL applications in complex and high-dimensional environments like logistics palletization.
引用
收藏
页码:9303 / 9310
页数:8
相关论文
共 50 条
  • [1] Robotic Disassembly Task Training and Skill Transfer Using Reinforcement Learning
    Qu, Mo
    Wang, Yongjing
    Pham, Duc Truong
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (11) : 10934 - 10943
  • [2] Evaluating Task Optimization and Reinforcement Learning Models in Robotic Task Parameterization
    Delledonne, Michele
    Villagrossi, Enrico
    Beschi, Manuel
    Rastegarpanah, Alireza
    IEEE ACCESS, 2024, 12 : 173734 - 173748
  • [3] Hierarchical Reinforcement Learning With Universal Policies for Multistep Robotic Manipulation
    Yang, Xintong
    Ji, Ze
    Wu, Jing
    Lai, Yu-Kun
    Wei, Changyun
    Liu, Guoliang
    Setchi, Rossitza
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (09) : 4727 - 4741
  • [4] A Hybrid Reinforcement Learning Approach With a Spiking Actor Network for Efficient Robotic Arm Target Reaching
    Oikonomou, Katerina Maria
    Kansizoglou, Ioannis
    Gasteratos, Antonios
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (05) : 3007 - 3014
  • [5] Efficient Spatiotemporal Transformer for Robotic Reinforcement Learning
    Yang, Yiming
    Xing, Dengpeng
    Xu, Bo
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) : 7982 - 7989
  • [6] Graph and dynamics interpretation in robotic reinforcement learning task
    Yao, Zonggui
    Yu, Jun
    Zhang, Jian
    He, Wei
    INFORMATION SCIENCES, 2022, 611 : 317 - 334
  • [7] Spatial Iterative Learning Control for Robotic Path Learning
    Yang, Lin
    Li, Yanan
    Huang, Deqing
    Xia, Jingkang
    Zhou, Xiaodong
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (07) : 5789 - 5798
  • [8] The Use of Reinforcement Learning in the Task of Moving Objects with the Robotic Arm
    Aitygulov, Ermek E.
    ARTIFICIAL INTELLIGENCE, 2019, 11866 : 119 - 126
  • [9] Lifelong Federated Reinforcement Learning: A Learning Architecture for Navigation in Cloud Robotic Systems
    Liu, Boyi
    Wang, Lujia
    Liu, Ming
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2019, 4 (04) : 4555 - 4562
  • [10] Synergistic Task and Motion Planning With Reinforcement Learning-Based Non-Prehensile Actions
    Liu, Gaoyuan
    de Winter, Joris
    Steckelmacher, Denis
    Hota, Roshan Kumar
    Nowe, Ann
    Vanderborght, Bram
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (05) : 2764 - 2771