Stock trading rule discovery with double deep Q-network

被引:28
|
作者
Shi, Yong [1 ]
Li, Wei [2 ]
Zhu, Luyao [2 ]
Guo, Kun [1 ]
Cambria, Erik [2 ]
机构
[1] Univ Chinese Acad Sci, Sch Econ & Management, Beijing 100190, Peoples R China
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; Double DQN; Stock price trend forecasting; Stock trading; NEURAL-NETWORK; PREDICTION; MODEL; DIRECTION;
D O I
10.1016/j.asoc.2021.107320
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stock market serves as an important indicator of today's economy. Predicting the price fluctuation of stocks and acquiring the maximum gains has been the main concern of investors. In recent years, deep learning models are widely applied to stock market prediction and have achieved good performances. However, the majority of these deep learning based models belong to supervised learning methods and are not capable of dealing with long-term targets. Therefore, in this paper we proposed a deep reinforcement learning based stock market trading model, which is suitable for predicting stock price fluctuation and stock transactions. We carefully devise the reward function and deep learning based policy network, which enables the model to capture the hidden dependencies and latent dynamics in the stock data. In order to evaluate the superiority of the proposed model, stock price trend forecasting and transaction is conducted on randomly selected stocks and stock market indices. Experiment results demonstrate that our model outperforms baseline methods on several indicators. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] Deep Recurrent Q-Network with Truncated History
    Oh, Hyunwoo
    Kaneko, Tomoyuki
    2018 CONFERENCE ON TECHNOLOGIES AND APPLICATIONS OF ARTIFICIAL INTELLIGENCE (TAAI), 2018, : 34 - 39
  • [22] Effective defense strategies in network security using improved double dueling deep Q-network
    Zhu, Zhengwei
    Chen, Miaojie
    Zhu, Chenyang
    Zhu, Yanping
    COMPUTERS & SECURITY, 2024, 136
  • [23] Dynamic fusion for ensemble of deep Q-network
    Patrick P. K. Chan
    Meng Xiao
    Xinran Qin
    Natasha Kees
    International Journal of Machine Learning and Cybernetics, 2021, 12 : 1031 - 1040
  • [24] Twice Sampling Method in Deep Q-network
    Zhao Y.-N.
    Liu P.
    Zhao W.
    Tang X.-L.
    Zidonghua Xuebao/Acta Automatica Sinica, 2019, 45 (10): : 1870 - 1882
  • [25] Trax Solver on Zynq with Deep Q-Network
    Sugimoto, Naru
    Mitsuishi, Takuji
    Kaneda, Takahiro
    Tsuruta, Chiharu
    Sakai, Ryotaro
    Shimura, Hideki
    Amano, Hideharu
    2015 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE TECHNOLOGY (FPT), 2015, : 272 - 275
  • [26] Dynamic fusion for ensemble of deep Q-network
    Chan, Patrick P. K.
    Xiao, Meng
    Qin, Xinran
    Kees, Natasha
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2021, 12 (04) : 1031 - 1040
  • [27] Deep Q-Network Using Reward Distribution
    Nakaya, Yuta
    Osana, Yuko
    ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2018, PT I, 2018, 10841 : 160 - 169
  • [28] Application of Deep Q-Network in Portfolio Management
    Gao, Ziming
    Gao, Yuan
    Hu, Yi
    Jiang, Zhengyong
    Su, Jionglong
    2020 5TH IEEE INTERNATIONAL CONFERENCE ON BIG DATA ANALYTICS (IEEE ICBDA 2020), 2020, : 268 - 275
  • [29] Proposal of a Deep Q-network with Profit Sharing
    Miyazaki, Kazuteru
    8TH ANNUAL INTERNATIONAL CONFERENCE ON BIOLOGICALLY INSPIRED COGNITIVE ARCHITECTURES, BICA 2017 (EIGHTH ANNUAL MEETING OF THE BICA SOCIETY), 2018, 123 : 302 - 307
  • [30] Social Attentive Deep Q-network for Recommendation
    Lei, Yu
    Wang, Zhitao
    Li, Wenjie
    Pei, Hongbin
    PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, : 1189 - 1192