A deep Q-learning portfolio management framework for the cryptocurrency market

被引:38
作者
Lucarelli, Giorgio [1 ]
Borrotti, Matteo [1 ,2 ]
机构
[1] Univ Milano Bicocca, Dept Econ Management & Stat, Piazza Ateneo Nuovo 1, I-20126 Milan, Italy
[2] CNR, Inst Appl Math & Informat Technol, Via Alfonso Corti 12, I-20133 Milan, Italy
关键词
Deep reinforcement learning; Q-learning; Portfolio management; Dueling double deep Q-networks;
D O I
10.1007/s00521-020-05359-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep reinforcement learning is gaining popularity in many different fields. An interesting sector is related to the definition of dynamic decision-making systems. A possible example is dynamic portfolio optimization, where an agent has to continuously reallocate an amount of fund into a number of different financial assets with the final goal of maximizing return and minimizing risk. In this work, a novel deep Q-learning portfolio management framework is proposed. The framework is composed by two elements: a set of local agents that learn assets behaviours and a global agent that describes the global reward function. The framework is tested on a crypto portfolio composed by four cryptocurrencies. Based on our results, the deep reinforcement portfolio management framework has proven to be a promising approach for dynamic portfolio optimization.
引用
收藏
页码:17229 / 17244
页数:16
相关论文
共 33 条
[1]   Anticipating Cryptocurrency Prices Using Machine Learning [J].
Alessandretti, Laura ;
ElBahrawy, Abeer ;
Aiello, Luca Maria ;
Baronchelli, Andrea .
COMPLEXITY, 2018,
[2]  
[Anonymous], INT C MACH LEARN ATL
[3]  
[Anonymous], INT C LEARNING REPRE
[4]  
[Anonymous], 1962, Applied dynamic programming
[5]   NEURONLIKE ADAPTIVE ELEMENTS THAT CAN SOLVE DIFFICULT LEARNING CONTROL-PROBLEMS [J].
BARTO, AG ;
SUTTON, RS ;
ANDERSON, CW .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1983, 13 (05) :834-846
[6]   Reinforcement Learning, Fast and Slow [J].
Botvinick, Matthew ;
Ritter, Sam ;
Wang, Jane X. ;
Kurth-Nelson, Zeb ;
Blundell, Charles ;
Hassabis, Demis .
TRENDS IN COGNITIVE SCIENCES, 2019, 23 (05) :408-422
[7]  
Buduma N., 2017, FUNDAMENTALS DEEP LE
[8]   Active Object Localization with Deep Reinforcement Learning [J].
Caicedo, Juan C. ;
Lazebnik, Svetlana .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2488-2496
[9]   Deep Direct Reinforcement Learning for Financial Signal Representation and Trading [J].
Deng, Yue ;
Bao, Feng ;
Kong, Youyong ;
Ren, Zhiquan ;
Dai, Qionghai .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (03) :653-664
[10]  
Di Tollo G., 2008, International Journal of Operations Research, V5, P13