Robust and efficient task scheduling for robotics applications with reinforcement learning

被引:4
|
作者
Tejer, Mateusz [1 ]
Szczepanski, Rafal [1 ]
Tarczewski, Tomasz [1 ]
机构
[1] Nicolaus Copernicus Univ, Inst Engn & Technol, Grudziadzka 5, PL-87100 Torun, Poland
关键词
Task scheduling; Robotic arm; Sorting problem; Reinforcement learning algorithm; Performance analysis; Predictive strategies; ALGORITHM;
D O I
10.1016/j.engappai.2023.107300
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effective task scheduling can significantly impact on performance, productivity, and profitability in many real-world settings, such as production lines, logistics, and transportation systems. Traditional approaches to task scheduling rely on heuristics or simple rule-based methods. However, with the emergence of machine learning and artificial intelligence, there is growing interest in using these methods to optimize task scheduling. In particular, reinforcement learning is a promising task scheduling approach, because it can learn from experience and adapt to changing conditions. One step often missed or neglected is choosing optimal algorithm parameters and different ways the environment could be implemented. The study analyzes the performance possibilities of task scheduling using reinforcement learning. The deep analysis allows to select highly efficient environment models and Q-learning parameters. Moreover, automatic selection based on optimization algorithms has been proposed. Regardless of the selected optimal parameters, the resilience to environmental changes seems poor. The deducted analysis motivated the Authors to develop a novel Hybrid Q-learning approach. It allows to provide superior efficiency regardless of the environmental parameters.
引用
收藏
页数:16
相关论文
共 50 条
  • [1] A Resource-efficient Task Scheduling System using Reinforcement Learning
    Morchdi, Chedi
    Chiu, Cheng-Hsiang
    Zhou, Yi
    Huang, Tsung-Wei
    29TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2024, 2024, : 89 - 95
  • [2] Digital Twin-Assisted Efficient Reinforcement Learning for Edge Task Scheduling
    Wang, Xiucheng
    Ma, Longfei
    Li, Haocheng
    Yin, Zhisheng
    Luan, Tom
    Cheng, Nan
    2022 IEEE 95TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-SPRING), 2022,
  • [3] Deep Reinforcement Learning in robotics logistic task coordination
    Chenatti, Samuel
    Previato, Gabriel
    Cano, Guilherme
    Prudencio, Rafael
    Leite, Guilherme
    Pereira, Wallace da Cruz
    Abreu, Guilherme
    Oliveira, Thales
    Braga, Victor Sorensen
    Correa, Guilherme
    Colombini, Esther
    15TH LATIN AMERICAN ROBOTICS SYMPOSIUM 6TH BRAZILIAN ROBOTICS SYMPOSIUM 9TH WORKSHOP ON ROBOTICS IN EDUCATION (LARS/SBR/WRE 2018), 2018, : 326 - 332
  • [4] Deep Reinforcement Learning based Task Scheduling in Mobile Blockchain for IoT Applications
    Gao, Yang
    Wu, Wenjun
    Nan, Haixiang
    Sun, Yang
    Si, Pengbo
    ICC 2020 - 2020 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2020,
  • [5] Reinforcement Learning for Cognitive Radar Task Scheduling
    Gaafar, Mohamed
    Shaghaghi, Mandi
    Adve, Raviraj S.
    Ding, Zhen
    CONFERENCE RECORD OF THE 2019 FIFTY-THIRD ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, 2019, : 1653 - 1657
  • [6] Reinforcement Learning in Dynamic Task Scheduling: A Review
    Shyalika C.
    Silva T.
    Karunananda A.
    SN Computer Science, 2020, 1 (6)
  • [7] Efficient Task Scheduling for Applications on Clouds
    Al-Zoubi, Hussein
    2019 6TH IEEE INTERNATIONAL CONFERENCE ON CYBER SECURITY AND CLOUD COMPUTING (IEEE CSCLOUD 2019) / 2019 5TH IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND SCALABLE CLOUD (IEEE EDGECOM 2019), 2019, : 10 - 13
  • [8] FODAS: A Novel Reinforcement Learning Approach for Efficient Task Scheduling in Fog Computing Network
    Nagabushnam, Ganesan
    Choi, Yundo
    Kim, Kyong Hoon
    2024 9TH INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING, FMEC 2024, 2024, : 46 - 53
  • [9] Efficient reinforcement learning: computational theories, neuroscience and robotics
    Kawato, Mitsuo
    Samejima, Kazuyuki
    CURRENT OPINION IN NEUROBIOLOGY, 2007, 17 (02) : 205 - 212
  • [10] Safe reinforcement learning and its applications in robotics: A survey
    Zhang C.-X.
    Zhang X.-L.
    Xu X.
    Lu Y.
    Kongzhi Lilun Yu Yingyong/Control Theory and Applications, 2023, 40 (12): : 2090 - 2103