Deep reinforcement learning for scheduling in large-scale networked control systems

被引:9
作者
Redder, Adrian [1 ]
Ramaswamy, Arunselvan [1 ]
Quevedo, Daniel E. [1 ]
机构
[1] Paderborn Univ, Fac Comp Sci Elect Engn & Math, Paderborn, Germany
来源
IFAC PAPERSONLINE | 2019年 / 52卷 / 20期
关键词
Networked control systems; deep reinforcement learning; large-scale systems; resource scheduling; stochastic control;
D O I
10.1016/j.ifacol.2019.12.177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work considers the problem of control and resource allocation in networked systems. To this end, we present DIRA a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is tailored towards large-scale problems where control and scheduling need to act jointly to optimize performance. DIRA can be used to schedule general time-domain optimization based controllers. In the present work, we focus on control designs based on suitably adapted linear quadratic regulators. We apply our algorithm to networked systems with correlated fading communication channels. Our simulations show that DIRA scales well to large scheduling problems. Copyright (C) 2019. The Authors. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:333 / 338
页数:6
相关论文
共 50 条
  • [31] Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach
    Wang, Chao
    Wang, Jian
    Shen, Yuan
    Zhang, Xudong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (03) : 2124 - 2136
  • [32] Robust decentralised state feedback control design for large-scale networked control system
    Azimi, Mohammad Mahdi
    Afzalian, Ali A.
    Ghaderi, Reza
    INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 2018, 49 (08) : 1809 - 1820
  • [33] Robust Guaranteed Cost Control for a Class of Large Scale Networked Control Systems
    Azimi, Mohammad Mahdi
    Afzalian, Ali A.
    Ghaderi, Reza
    2017 5TH INTERNATIONAL CONFERENCE ON CONTROL, INSTRUMENTATION, AND AUTOMATION (ICCIA), 2017, : 343 - 348
  • [34] Traffic Signal Control for Large-Scale Road Networks Based on Deep Reinforcement with PSR
    Zhou, Zhicheng
    Zhang, Hui
    Zhang, Ya
    2024 3RD CONFERENCE ON FULLY ACTUATED SYSTEM THEORY AND APPLICATIONS, FASTA 2024, 2024, : 848 - 853
  • [35] An inertial control method for large-scale wind farm based on hierarchical distributed hybrid deep-reinforcement learning
    Han, Ji
    Chen, Zhe
    JOURNAL OF CLEANER PRODUCTION, 2024, 450
  • [36] GlobalLight: Exploring global influence in multi-agent deep reinforcement learning for large-scale traffic signal control
    Liu, Yilin
    Liang, Jintao
    Zhang, Yifeng
    Gong, Ping
    Luo, Guiyang
    Yuan, Quan
    Li, Jinglin
    NEUROCOMPUTING, 2025, 637
  • [37] DL-DRL: A Double-Level Deep Reinforcement Learning Approach for Large-Scale Task Scheduling of Multi-UAV
    Mao, Xiao
    Wu, Guohua
    Fan, Mingfeng
    Cao, Zhiguang
    Pedrycz, Witold
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2025, 22 : 1028 - 1044
  • [38] A deep reinforcement learning model for large-scale traffic signal control based on graph meta-learning using local subgraphs
    Zhou, Zhicheng
    Zhang, Ya
    Li, Xinde
    SCIENCE CHINA-INFORMATION SCIENCES, 2025, 68 (07)
  • [39] Localization Phenomena in Large-Scale Networked Systems: Implications for Fragility
    Shukla, Poorva
    Bamieh, Bassam
    IEEE CONTROL SYSTEMS LETTERS, 2024, 8 : 3087 - 3092
  • [40] Real-time optimization of large-scale hydrogen production systems using off-grid renewable energy: Scheduling strategy based on deep reinforcement learning
    Liang, Tao
    Chai, Lulu
    Cao, Xin
    Tan, Jianxin
    Jing, Yanwei
    Lv, Liangnian
    RENEWABLE ENERGY, 2024, 224