Deep reinforcement learning for scheduling in large-scale networked control systems

被引:9
作者
Redder, Adrian [1 ]
Ramaswamy, Arunselvan [1 ]
Quevedo, Daniel E. [1 ]
机构
[1] Paderborn Univ, Fac Comp Sci Elect Engn & Math, Paderborn, Germany
来源
IFAC PAPERSONLINE | 2019年 / 52卷 / 20期
关键词
Networked control systems; deep reinforcement learning; large-scale systems; resource scheduling; stochastic control;
D O I
10.1016/j.ifacol.2019.12.177
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This work considers the problem of control and resource allocation in networked systems. To this end, we present DIRA a Deep reinforcement learning based Iterative Resource Allocation algorithm, which is scalable and control-aware. Our algorithm is tailored towards large-scale problems where control and scheduling need to act jointly to optimize performance. DIRA can be used to schedule general time-domain optimization based controllers. In the present work, we focus on control designs based on suitably adapted linear quadratic regulators. We apply our algorithm to networked systems with correlated fading communication channels. Our simulations show that DIRA scales well to large scheduling problems. Copyright (C) 2019. The Authors. Published by Elsevier Ltd. All rights reserved.
引用
收藏
页码:333 / 338
页数:6
相关论文
共 50 条
  • [41] Asynchronously Intermittent Decentralized Control of Large-Scale Systems
    Wang, Pengfei
    Su, Huan
    Wang, Ruihe
    [J]. IEEE CONTROL SYSTEMS LETTERS, 2022, 6 : 2737 - 2742
  • [42] An efficient evolutionary algorithm based on deep reinforcement learning for large-scale sparse multiobjective optimization
    Gao, Mengqi
    Feng, Xiang
    Yu, Huiqun
    Li, Xiuquan
    [J]. APPLIED INTELLIGENCE, 2023, 53 (18) : 21116 - 21139
  • [43] Coordinated Charging Strategy Applicable to Large-scale Charging Stations Based on Deep Reinforcement Learning
    Chen G.
    Wang X.
    Yuan S.
    Shuai X.
    Zhou Q.
    [J]. Dianli Xitong Zidonghua/Automation of Electric Power Systems, 2023, 47 (02): : 88 - 95
  • [44] An efficient evolutionary algorithm based on deep reinforcement learning for large-scale sparse multiobjective optimization
    Mengqi Gao
    Xiang Feng
    Huiqun Yu
    Xiuquan Li
    [J]. Applied Intelligence, 2023, 53 : 21116 - 21139
  • [45] Efficient Large-Scale Fleet Management via Multi-Agent Deep Reinforcement Learning
    Lin, Kaixiang
    Zhao, Renyu
    Xu, Zhe
    Zhou, Jiayu
    [J]. KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, : 1774 - 1783
  • [46] Robust Adaptive Decentralized Control for a Class of Networked Large-scale Systems with Sensor Network Failures
    Zhang, Kun
    Li, Lina
    [J]. 2011 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-6, 2011, : 2366 - +
  • [47] Control of chaotic systems by deep reinforcement learning
    Bucci, M. A.
    Semeraro, O.
    Allauzen, A.
    Wisniewski, G.
    Cordier, L.
    Mathelin, L.
    [J]. PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2019, 475 (2231):
  • [48] Local Control is All You Need: Decentralizing and Coordinating Reinforcement Learning for Large-Scale Process Control
    Bougie, Nicolas
    Onishi, Takashi
    Tsuruoka, Yoshimasa
    [J]. 2022 61ST ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS (SICE), 2022, : 468 - 474
  • [49] Tradeoffs between quality-of-control and quality-of-service in large-scale nonlinear networked control systems
    Borgers, D. P.
    Geiselhart, R.
    Heemels, W. P. M. H.
    [J]. NONLINEAR ANALYSIS-HYBRID SYSTEMS, 2017, 23 : 142 - 165
  • [50] Partial State Consensus Integral Reinforcement Learning for Large-scale Systems within Process Networks
    Liu, Zidong
    Zhang, Shiqiang
    Zhao, Dongya
    [J]. 2022 41ST CHINESE CONTROL CONFERENCE (CCC), 2022, : 2297 - 2302