Deep Learning for Control: a non-Reinforcement Learning View

被引:0
作者
Matei, Ion [1 ]
Minhas, Raj [1 ]
Zhenirovskyy, Maksym [1 ]
de Kleer, Johan [1 ]
Rai, Rahul [2 ]
机构
[1] Palo Alto Res Ctr Inc PARC, Palo Alto, CA 94304 USA
[2] Univ Buffalo SUNY, Buffalo, NY USA
来源
2020 AMERICAN CONTROL CONFERENCE (ACC) | 2020年
关键词
D O I
10.23919/acc45564.2020.9147287
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning platforms have become hugely popular due to their successes in natural language processing and image processing. Our objective is to show how deep learning platforms can be used for control problems. We do not make judgments about their performance as compared to traditional control approaches. We show that the main challenge when using deep learning platforms for learning control policies for nonlinear systems is ensuring the stability of the learning algorithm that depends on the stability of the closed loop system during the learning process. We discuss two approaches for overcoming the potential instability of the optimization algorithm, and showcase them in the context of learning a stabilizing controller for an inverted pendulum.
引用
收藏
页码:2942 / 2948
页数:7
相关论文
共 50 条
  • [41] Learning to Control Random Boolean Networks: A Deep Reinforcement Learning Approach
    Papagiannis, Georgios
    Moschoyiannis, Sotiris
    COMPLEX NETWORKS AND THEIR APPLICATIONS VIII, VOL 1, 2020, 881 : 721 - 734
  • [42] Jointly Learning to Construct and Control Agents using Deep Reinforcement Learning
    Schaff, Charles
    Yunis, David
    Chakrabarti, Ayan
    Walter, Matthew R.
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 9798 - 9805
  • [43] Learning Control for Air Hockey Striking using Deep Reinforcement Learning
    Taitler, Ayal
    Shimkin, Nahum
    2017 INTERNATIONAL CONFERENCE ON CONTROL, ARTIFICIAL INTELLIGENCE, ROBOTICS & OPTIMIZATION (ICCAIRO), 2017, : 22 - 27
  • [44] An Autonomous Materialized View Management System with Deep Reinforcement Learning
    Han, Yue
    Li, Guoliang
    Yuan, Haitao
    Sun, Ji
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2159 - 2164
  • [45] A Deep Reinforcement Learning Approach to Improve the Learning Performance in Process Control
    Bao, Yaoyao
    Zhu, Yuanming
    Qian, Feng
    INDUSTRIAL & ENGINEERING CHEMISTRY RESEARCH, 2021, 60 (15) : 5504 - 5515
  • [46] From Reinforcement Learning to Deep Reinforcement Learning: An Overview
    Agostinelli, Forest
    Hocquet, Guillaume
    Singh, Sameer
    Baldi, Pierre
    BRAVERMAN READINGS IN MACHINE LEARNING: KEY IDEAS FROM INCEPTION TO CURRENT STATE, 2018, 11100 : 298 - 328
  • [47] Control on the Manifolds of Mappings with a View to the Deep Learning
    Andrei Agrachev
    Andrey Sarychev
    Journal of Dynamical and Control Systems, 2022, 28 : 989 - 1008
  • [48] Control on the Manifolds of Mappings with a View to the Deep Learning
    Agrachev, Andrei
    Sarychev, Andrey
    JOURNAL OF DYNAMICAL AND CONTROL SYSTEMS, 2022, 28 (04) : 989 - 1008
  • [49] Transfer Learning in Deep Reinforcement Learning
    Islam, Tariqul
    Abid, Dm. Mehedi Hasan
    Rahman, Tanvir
    Zaman, Zahura
    Mia, Kausar
    Hossain, Ramim
    PROCEEDINGS OF SEVENTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2022, VOL 1, 2023, 447 : 145 - 153
  • [50] Learning to Drive with Deep Reinforcement Learning
    Chukamphaeng, Nut
    Pasupa, Kitsuchart
    Antenreiter, Martin
    Auer, Peter
    2021 13TH INTERNATIONAL CONFERENCE ON KNOWLEDGE AND SMART TECHNOLOGY (KST-2021), 2021, : 147 - 152