Deep reinforcement learning for scheduling in large-scale networked control systems

被引:10
|
作者
Redder, Adrian [1 ]
Ramaswamy, Arunselvan [1 ]
Quevedo, Daniel E. [1 ]
机构
[1] Paderborn Univ, Fac Comp Sci Elect Engn & Math, Paderborn, Germany
来源
IFAC PAPERSONLINE | 2019年 / 52卷 / 20期
关键词
Networked control systems; deep reinforcement learning; large-scale systems; resource scheduling; stochastic control;
D O I
10.1016/j.ifacol.2019.12.177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work considers the problem of control and resource allocation in networked systems. To this end, we present DIRA a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is tailored towards large-scale problems where control and scheduling need to act jointly to optimize performance. DIRA can be used to schedule general time-domain optimization based controllers. In the present work, we focus on control designs based on suitably adapted linear quadratic regulators. We apply our algorithm to networked systems with correlated fading communication channels. Our simulations show that DIRA scales well to large scheduling problems. Copyright (C) 2019. The Authors. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:333 / 338
页数:6
相关论文
共 50 条
  • [21] An Adaptive Metadata Management Scheme Based on Deep Reinforcement Learning for Large-Scale Distributed File Systems
    Huang, Xiuqi
    Gao, Yuanning
    Zhou, Xinyi
    Gao, Xiaofeng
    Chen, Guihai
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2023, 31 (06) : 2840 - 2853
  • [22] A Spatial-Temporal Deep Reinforcement Learning Model for Large-Scale Centralized Traffic Signal Control
    Yi, Chenglin
    Wu, Jia
    Ren, Yanyu
    Ran, Yunchuan
    Lou, Yican
    2022 IEEE 25TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2022, : 275 - 280
  • [23] Accelerated Derivative-Free Deep Reinforcement Learning for Large-Scale Grid Emergency Voltage Control
    Huang, Renke
    Chen, Yujiao
    Yin, Tianzhixi
    Li, Xinya
    Li, Ang
    Tan, Jie
    Yu, Wenhao
    Liu, Yuan
    Huang, Qiuhua
    IEEE TRANSACTIONS ON POWER SYSTEMS, 2022, 37 (01) : 14 - 25
  • [24] H∞ Performance Analysis of Large-Scale Networked Systems
    Guan, Rongxing
    Liu, Huabo
    Huang, Keke
    Yu, Haisheng
    IEEE SYSTEMS JOURNAL, 2024, 18 (03): : 1528 - 1537
  • [25] Scheduling and Power Control for Wireless Multicast Systems via Deep Reinforcement Learning
    Raghu, Ramkumar
    Panju, Mahadesh
    Aggarwal, Vaneet
    Sharma, Vinod
    ENTROPY, 2021, 23 (12)
  • [26] A large-scale traffic signal control algorithm based on multi-layer graph deep reinforcement learning
    Wang, Tao
    Zhu, Zhipeng
    Zhang, Jing
    Tian, Junfang
    Zhang, Wenyi
    TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2024, 162
  • [27] AUTONOMOUS NAVIGATION OF UAV IN LARGE-SCALE UNKNOWN COMPLEX ENVIRONMENT WITH DEEP REINFORCEMENT LEARNING
    Wang, Chao
    Wang, Jian
    Zhang, Xudong
    Zhang, Xiao
    2017 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2017), 2017, : 858 - 862
  • [28] A DEEP REINFORCEMENT LEARNING APPROACH TO FLOCKING AND NAVIGATION OF UAVS IN LARGE-SCALE COMPLEX ENVIRONMENTS
    Wang, Chao
    Wang, Jian
    Zhang, Xudong
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 1228 - 1232
  • [29] Autonomous Navigation of UAVs in Large-Scale Complex Environments: A Deep Reinforcement Learning Approach
    Wang, Chao
    Wang, Jian
    Shen, Yuan
    Zhang, Xudong
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (03) : 2124 - 2136
  • [30] Deep learning control for complex and large scale cloud systems
    Roopaei, Mehdi
    Rad, Paul
    Jamshidi, Mo
    INTELLIGENT AUTOMATION AND SOFT COMPUTING, 2017, 23 (03) : 389 - 391