Robust and efficient task scheduling for robotics applications with reinforcement learning

被引:4
|
作者
Tejer, Mateusz [1 ]
Szczepanski, Rafal [1 ]
Tarczewski, Tomasz [1 ]
机构
[1] Nicolaus Copernicus Univ, Inst Engn & Technol, Grudziadzka 5, PL-87100 Torun, Poland
关键词
Task scheduling; Robotic arm; Sorting problem; Reinforcement learning algorithm; Performance analysis; Predictive strategies; ALGORITHM;
D O I
10.1016/j.engappai.2023.107300
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effective task scheduling can significantly impact on performance, productivity, and profitability in many real-world settings, such as production lines, logistics, and transportation systems. Traditional approaches to task scheduling rely on heuristics or simple rule-based methods. However, with the emergence of machine learning and artificial intelligence, there is growing interest in using these methods to optimize task scheduling. In particular, reinforcement learning is a promising task scheduling approach, because it can learn from experience and adapt to changing conditions. One step often missed or neglected is choosing optimal algorithm parameters and different ways the environment could be implemented. The study analyzes the performance possibilities of task scheduling using reinforcement learning. The deep analysis allows to select highly efficient environment models and Q-learning parameters. Moreover, automatic selection based on optimization algorithms has been proposed. Regardless of the selected optimal parameters, the resilience to environmental changes seems poor. The deducted analysis motivated the Authors to develop a novel Hybrid Q-learning approach. It allows to provide superior efficiency regardless of the environmental parameters.
引用
收藏
页数:16
相关论文
共 50 条
  • [41] Robust Deep Reinforcement Learning Scheduling via Weight Anchoring
    Gracla, Steffen
    Beck, Edgar
    Bockelmann, Carsten
    Dekorsy, Armin
    IEEE COMMUNICATIONS LETTERS, 2023, 27 (01) : 210 - 213
  • [42] A Reinforcement Learning Approach to Robust Scheduling of Permutation Flow Shop
    Zhou, Tao
    Luo, Liang
    Ji, Shengchen
    He, Yuanxin
    BIOMIMETICS, 2023, 8 (06)
  • [43] A Reinforcement Learning Approach to Robust Scheduling of Semiconductor Manufacturing Facilities
    Park, In-Beom
    Huh, Jaeseok
    Kim, Joongkyun
    Park, Jonghun
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (03) : 1420 - 1431
  • [44] Modelling Framework for Reinforcement Learning based Scheduling Applications
    Steinbacher, Lennart M.
    Ait-Alla, Abderahim
    Rippel, Daniel
    Duee, Tim
    Freitag, Michael
    IFAC PAPERSONLINE, 2022, 55 (10): : 67 - 72
  • [45] Robust scheduling in team-robotics
    Becker, LB
    Nett, E
    Schemmer, S
    Gergeleit, M
    JOURNAL OF SYSTEMS AND SOFTWARE, 2005, 77 (01) : 3 - 16
  • [46] Robust facial expression recognition via lightweight reinforcement learning for rehabilitation robotics
    Chen, Yifan
    Fan, Weiming
    Gao, Hongwei
    Yu, Jiahui
    Ju, Zhaojie
    OPTOELECTRONICS LETTERS, 2025, 21 (02) : 97 - 104
  • [47] Robust facial expression recognition via lightweight reinforcement learning for rehabilitation robotics
    CHEN Yifan
    FAN Weiming
    GAO Hongwei
    YU Jiahui
    JU Zhaojie
    Optoelectronics Letters, 2025, 21 (02) : 97 - 104
  • [48] REINFORCEMENT LEARNING ALGORITHMS IN ROBOTICS
    Bocsi, Botond
    Csato, Lehel
    KEPT 2011: KNOWLEDGE ENGINEERING PRINCIPLES AND TECHNIQUES, 2011, : 131 - 142
  • [49] Reinforcement learning in robotics: A survey
    Kober, Jens
    Bagnell, J. Andrew
    Peters, Jan
    INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2013, 32 (11): : 1238 - 1274
  • [50] Lyapunov Design for Robust and Efficient Robotic Reinforcement Learning
    Westenbroek, Tyler
    Castaneda, Fernando
    Agrawal, Ayush
    Sastry, Shankar
    Sreenath, Koushil
    CONFERENCE ON ROBOT LEARNING, VOL 205, 2022, 205 : 2125 - 2135