Efficient Reinforcement Learning of Task Planners for Robotic Palletization Through Iterative Action Masking Learning

被引:0
|
作者
Wu, Zheng [1 ]
Li, Yichuan [2 ]
Zhan, Wei [1 ]
Liu, Changliu [3 ]
Liu, Yun-Hui [2 ]
Tomizuka, Masayoshi [1 ]
机构
[1] Univ Calif Berkeley, Dept Mech Engn, Berkeley, CA 92093 USA
[2] Chinese Univ Hong Kong, T Stone Robot Inst, Dept Mech & Automat Engn, Hong Kong, Peoples R China
[3] Carnegie Mellon Univ, Inst Robot, Pittsburgh, PA 15213 USA
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 11期
关键词
Three-dimensional displays; Robots; Task analysis; Pallets; Planning; Training; Thermal stability; Action space masking; reinforcement learning; robotic palletization; PACKING;
D O I
10.1109/LRA.2024.3440731
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The development of robotic systems for palletization in logistics scenarios is of paramount importance, addressing critical efficiency and precision demands in supply chain management. This paper investigates the application of Reinforcement Learning (RL) in enhancing task planning for such robotic systems. Confronted with the substantial challenge of a vast action space, which is a significant impediment to efficiently apply out-of-the-shelf RL methods, our study introduces a novel method of utilizing supervised learning to iteratively prune and manage the action space effectively. By reducing the complexity of the action space, our approach not only accelerates the learning phase but also ensures the effectiveness and reliability of the task planning in robotic palletization. The experiemental results underscore the efficacy of this method, highlighting its potential in improving the performance of RL applications in complex and high-dimensional environments like logistics palletization.
引用
收藏
页码:9303 / 9310
页数:8
相关论文
共 50 条
  • [41] Learning Variable Impedance Control for Robotic Massage With Deep Reinforcement Learning: A Novel Learning Framework
    Li, Zhuoran
    Zeng, Chao
    Deng, Zhen
    Xu, Qinling
    He, Bingwei
    Zhang, Jianwei
    IEEE SYSTEMS MAN AND CYBERNETICS MAGAZINE, 2024, 10 (01): : 17 - 27
  • [42] Robotic Assembly of Deformable Linear Objects via Curriculum Reinforcement Learning
    Wu, Kai
    Chen, Rongkang
    Chen, Qi
    Li, Weihua
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2025, 10 (05): : 4770 - 4777
  • [43] Learning high-level robotic soccer strategies from scratch through reinforcement learning
    Abreu, Miguel
    Reis, Luis Paulo
    Cardoso, Henrique Lopes
    2019 19TH IEEE INTERNATIONAL CONFERENCE ON AUTONOMOUS ROBOT SYSTEMS AND COMPETITIONS (ICARSC 2019), 2019, : 128 - 134
  • [44] A Resource-efficient Task Scheduling System using Reinforcement Learning
    Morchdi, Chedi
    Chiu, Cheng-Hsiang
    Zhou, Yi
    Huang, Tsung-Wei
    29TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2024, 2024, : 89 - 95
  • [45] Efficient Design Space Exploration with Multi-Task Reinforcement Learning
    Hoffmann, Patrick
    Gorelik, Kirill
    Ivanov, Valentin
    2024 IEEE INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS, AIM 2024, 2024, : 1378 - 1385
  • [46] Robust Contact-Rich Task Learning With Reinforcement Learning and Curriculum-Based Domain Randomization
    Aflakian, Ali
    Hathaway, Jamie
    Stolkin, Rustam
    Rastegarpanah, Alireza
    IEEE ACCESS, 2024, 12 : 103461 - 103472
  • [47] Multi-Task Reinforcement Learning in Reproducing Kernel Hilbert Spaces via Cross-Learning
    Cervino, Juan
    Bazerque, Juan Andres
    Calvo-Fullana, Miguel
    Ribeiro, Alejandro
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2021, 69 : 5947 - 5962
  • [48] Annotating Motion Primitives for Simplifying Action Search in Reinforcement Learning
    Sledge, Isaac J.
    Bryner, Darshan W.
    Principe, Jose C.
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2022, 6 (05): : 1137 - 1156
  • [49] A Task-Adaptive Deep Reinforcement Learning Framework for Dual-Arm Robot Manipulation
    Cui, Yuanzhe
    Xu, Zhipeng
    Zhong, Lou
    Xu, Pengjie
    Shen, Yichao
    Tang, Qirong
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 466 - 479
  • [50] Geometric Task Networks: Learning Efficient and Explainable Skill Coordination for Object Manipulation
    Guo, Meng
    Burger, Mathias
    IEEE TRANSACTIONS ON ROBOTICS, 2022, 38 (03) : 1723 - 1734