Overview of Deep Reinforcement Learning Improvements and Applications

被引:9
作者
Zhang, Junjie [1 ]
Zhang, Cong [1 ]
Chien, Wei-Che [2 ]
机构
[1] Wuhan Polytech Univ, Sch Math & Comp Sci, Wuhan, Peoples R China
[2] Natl Dong Hwa Univ, Dept Comp Sci & Informat Engn, Shoufeng Township, Hualien County, Taiwan
来源
JOURNAL OF INTERNET TECHNOLOGY | 2021年 / 22卷 / 02期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; Value function; Policy gradient; Sparse reward; NETWORK;
D O I
10.3966/160792642021032202002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The deep reinforcement learning value has received a lot of attention from researchers since it was proposed. It combines the data representation capability of deep learning and the self-learning capability of reinforcement learning to give agents the ability to make direct action decisions on raw data. Deep reinforcement learning continuously optimizes the control strategy by using value function approximation and strategy search methods, ultimately resulting in an agent with a higher level of understanding of the target task. This paper provides a systematic description and summary of the corresponding improvements of these two types of classical method machines. First, this paper briefly describes the basic algorithms of classical deep reinforcement learning, including the Monte Carlo algorithm, the Q-Learning algorithm, and the most primitive deep Q network. Then the machine improvement method of deep reinforcement learning method based on value function and strategy gradient is introduced. And then the applications of deep reinforcement learning in robot control, algorithm parameter optimization and other fields are outlined. Finally, the future of deep reinforcement learning is envisioned based on the current limitations of deep reinforcement learning.
引用
收藏
页码:239 / 255
页数:17
相关论文
共 50 条
  • [1] Deep Reinforcement Learning for Power System Applications: An Overview
    Zhang, Zidong
    Zhang, Dongxia
    Qiu, Robert C.
    CSEE JOURNAL OF POWER AND ENERGY SYSTEMS, 2020, 6 (01): : 213 - 225
  • [2] From Reinforcement Learning to Deep Reinforcement Learning: An Overview
    Agostinelli, Forest
    Hocquet, Guillaume
    Singh, Sameer
    Baldi, Pierre
    BRAVERMAN READINGS IN MACHINE LEARNING: KEY IDEAS FROM INCEPTION TO CURRENT STATE, 2018, 11100 : 298 - 328
  • [3] Deep Reinforcement Learning: An Overview
    Mousavi, Seyed Sajad
    Schukat, Michael
    Howley, Enda
    PROCEEDINGS OF SAI INTELLIGENT SYSTEMS CONFERENCE (INTELLISYS) 2016, VOL 2, 2018, 16 : 426 - 440
  • [4] Deep Reinforcement Learning: A Chronological Overview and Methods
    Terven, Juan
    AI, 2025, 6 (03)
  • [5] Deep Reinforcement Learning with Applications in Transportation
    Qin, Zhiwei
    Tang, Jian
    Ye, Jieping
    KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 3201 - 3202
  • [6] Deep Reinforcement Learning for Mobile Robots: Overview and Issues
    Haja, Zakaria
    Aissi, Mohammed
    El Habchi, Ali
    Kelmoua, Leila
    Berrich, Jamal
    Bouchentouf, Toumi
    Rahmoune, Mohammed
    DIGITAL TECHNOLOGIES AND APPLICATIONS, ICDTA 2024, VOL 3, 2024, 1100 : 523 - 532
  • [7] Behavior fusion for deep reinforcement learning
    Shi, Haobin
    Xu, Meng
    Hwang, Kao-Shing
    Cai, Bo-Yin
    ISA TRANSACTIONS, 2020, 98 : 434 - 444
  • [8] Applications of Deep Reinforcement Learning in Communications and Networking: A Survey
    Luong, Nguyen Cong
    Hoang, Dinh Thai
    Gong, Shimin
    Niyato, Dusit
    Wang, Ping
    Liang, Ying-Chang
    Kim, Dong In
    IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2019, 21 (04): : 3133 - 3174
  • [9] Deep Reinforcement Learning: Framework, Applications, and Embedded Implementations
    Li, Hongjia
    Wei, Tianshu
    Ren, Ao
    Zhu, Qi
    Wang, Yanzhi
    2017 IEEE/ACM INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN (ICCAD), 2017, : 847 - 854
  • [10] Applications of deep reinforcement learning in nuclear energy: A review
    Liu, Yongchao
    Wang, Bo
    Tan, Sichao
    Li, Tong
    Lv, Wei
    Niu, Zhenfeng
    Li, Jiangkuan
    Gao, Puzhen
    Tian, Ruifeng
    NUCLEAR ENGINEERING AND DESIGN, 2024, 429