Deep Learning for Control: a non-Reinforcement Learning View

被引:0
|
作者
Matei, Ion [1 ]
Minhas, Raj [1 ]
Zhenirovskyy, Maksym [1 ]
de Kleer, Johan [1 ]
Rai, Rahul [2 ]
机构
[1] Palo Alto Res Ctr Inc PARC, Palo Alto, CA 94304 USA
[2] Univ Buffalo SUNY, Buffalo, NY USA
来源
2020 AMERICAN CONTROL CONFERENCE (ACC) | 2020年
关键词
D O I
10.23919/acc45564.2020.9147287
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning platforms have become hugely popular due to their successes in natural language processing and image processing. Our objective is to show how deep learning platforms can be used for control problems. We do not make judgments about their performance as compared to traditional control approaches. We show that the main challenge when using deep learning platforms for learning control policies for nonlinear systems is ensuring the stability of the learning algorithm that depends on the stability of the closed loop system during the learning process. We discuss two approaches for overcoming the potential instability of the optimization algorithm, and showcase them in the context of learning a stabilizing controller for an inverted pendulum.
引用
收藏
页码:2942 / 2948
页数:7
相关论文
共 50 条
  • [21] Neural Malware Control with Deep Reinforcement Learning
    Wang, Yu
    Stokes, Jack W.
    Marinescu, Mady
    MILCOM 2019 - 2019 IEEE MILITARY COMMUNICATIONS CONFERENCE (MILCOM), 2019,
  • [22] Robust Deep Reinforcement Learning for Quadcopter Control
    Deshpande, Aditya M.
    Minai, Ali A.
    Kumar, Manish
    IFAC PAPERSONLINE, 2021, 54 (20): : 90 - 95
  • [23] Deep reinforcement learning for inventory control: A roadmap
    Boute, Robert N.
    Gijsbrechts, Joren
    van Jaarsveld, Willem
    Vanvuchelen, Nathalie
    EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2022, 298 (02) : 401 - 412
  • [24] Structured Control Nets for Deep Reinforcement Learning
    Srouji, Mario
    Zhang, Jian
    Salakhutdinov, Ruslan
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 80, 2018, 80
  • [25] Deep Reinforcement Learning Control of Quantum Cartpoles
    Wang, Zhikang T.
    Ashida, Yuto
    Ueda, Masahito
    PHYSICAL REVIEW LETTERS, 2020, 125 (10)
  • [26] DRLIC: Deep Reinforcement Learning for Irrigation Control
    Ding, Xianzhong
    Du, Wan
    2022 21ST ACM/IEEE INTERNATIONAL CONFERENCE ON INFORMATION PROCESSING IN SENSOR NETWORKS (IPSN 2022), 2022, : 41 - 53
  • [27] Deep Reinforcement Learning for Greenhouse Climate Control
    Wang, Lu
    He, Xiaofeng
    Luo, Dijun
    11TH IEEE INTERNATIONAL CONFERENCE ON KNOWLEDGE GRAPH (ICKG 2020), 2020, : 474 - 480
  • [28] Deep Reinforcement Learning for RAN Optimization and Control
    Chen, Yu
    Chen, Jie
    Krishnamurthi, Ganesh
    Yang, Huijing
    Wang, Huahui
    Zhao, Wenjie
    2021 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE (WCNC), 2021,
  • [29] Experience selection in deep reinforcement learning for control
    De Bruin, Tim
    Kober, Jens
    Tuyls, Karl
    Babuška, Robert
    Journal of Machine Learning Research, 2018, 19 : 1 - 56
  • [30] Experience Selection in Deep Reinforcement Learning for Control
    de Bruin, Tim
    Kober, Jens
    Tuyls, Karl
    Babuska, Robert
    JOURNAL OF MACHINE LEARNING RESEARCH, 2018, 19