Robust and efficient task scheduling for robotics applications with reinforcement learning

被引:4
|
作者
Tejer, Mateusz [1 ]
Szczepanski, Rafal [1 ]
Tarczewski, Tomasz [1 ]
机构
[1] Nicolaus Copernicus Univ, Inst Engn & Technol, Grudziadzka 5, PL-87100 Torun, Poland
关键词
Task scheduling; Robotic arm; Sorting problem; Reinforcement learning algorithm; Performance analysis; Predictive strategies; ALGORITHM;
D O I
10.1016/j.engappai.2023.107300
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effective task scheduling can significantly impact on performance, productivity, and profitability in many real-world settings, such as production lines, logistics, and transportation systems. Traditional approaches to task scheduling rely on heuristics or simple rule-based methods. However, with the emergence of machine learning and artificial intelligence, there is growing interest in using these methods to optimize task scheduling. In particular, reinforcement learning is a promising task scheduling approach, because it can learn from experience and adapt to changing conditions. One step often missed or neglected is choosing optimal algorithm parameters and different ways the environment could be implemented. The study analyzes the performance possibilities of task scheduling using reinforcement learning. The deep analysis allows to select highly efficient environment models and Q-learning parameters. Moreover, automatic selection based on optimization algorithms has been proposed. Regardless of the selected optimal parameters, the resilience to environmental changes seems poor. The deducted analysis motivated the Authors to develop a novel Hybrid Q-learning approach. It allows to provide superior efficiency regardless of the environmental parameters.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] Energy efficient task scheduling based on deep reinforcement learning in cloud environment: A specialized review
    Hou, Huanhuan
    Agos Jawaddi, Siti Nuraishah
    Ismail, Azlan
    Future Generation Computer Systems, 2024, 151 : 214 - 231
  • [22] Robust Reinforcement Learning via Progressive Task Sequence
    Li, Yike
    Tian, Yunzhe
    Tong, Endong
    Niu, Wenjia
    Liu, Jiqiang
    PROCEEDINGS OF THE THIRTY-SECOND INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2023, 2023, : 455 - 463
  • [23] Reinforcement Learning in Robotics: Applications and Real-World Challenges
    Kormushev, Petar
    Calinon, Sylvain
    Caldwell, Darwin G.
    ROBOTICS, 2013, 2 (03): : 122 - 148
  • [24] Survey of Model-Based Reinforcement Learning: Applications on Robotics
    Athanasios S. Polydoros
    Lazaros Nalpantidis
    Journal of Intelligent & Robotic Systems, 2017, 86 : 153 - 173
  • [25] Survey of Model-Based Reinforcement Learning: Applications on Robotics
    Polydoros, Athanasios S.
    Nalpantidis, Lazaros
    JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2017, 86 (02) : 153 - 173
  • [26] Reinforcement learning for swarm robotics: An overview of applications, algorithms and simulators
    Blais M.-A.
    Akhloufi M.A.
    Cognitive Robotics, 2023, 3 : 226 - 256
  • [27] Multi-task Deep Reinforcement Learning for Scalable Parallel Task Scheduling
    Zhang, Lingxin
    Qi, Qi
    Wang, Jingyu
    Sun, Haifeng
    Liao, Jianxin
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 2992 - 3001
  • [28] A hierarchical adaptive federated reinforcement learning for efficient resource allocation and task scheduling in hierarchical IoT network
    Sagar, A. S. M. Sharifuzzaman
    Haider, Amir
    Kim, Hyung Seok
    COMPUTER COMMUNICATIONS, 2025, 229
  • [29] A Reinforcement Learning Strategy for Task Scheduling of WSNs with Mobile Nodes
    Cirstea, Cosmin
    Davidescu, Roxana
    Gontean, Aurel
    2013 36TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING (TSP), 2013, : 348 - 353
  • [30] Efficient Task Scheduling and Load Balancing in Fog Computing for Crucial Healthcare Through Deep Reinforcement Learning
    Choppara, Prashanth
    Lokesh, Bommareddy
    IEEE ACCESS, 2025, 13 : 26542 - 26563