A Survey on recent advances in reinforcement learning for intelligent investment decision-making optimization

被引:0
作者
Wang, Feng [1 ]
Li, Shicheng [1 ]
Niu, Shanshui [2 ]
Yang, Haoran [3 ]
Li, Xiaodong [4 ]
Deng, Xiaotie [5 ]
机构
[1] Wuhan Univ, Sch Comp Sci, Wuhan 430072, Peoples R China
[2] Carnegie Mellon Univ, Dept Stat & Data Sci, Pittsburgh, PA 15213 USA
[3] New York Univ, Dept Finance & Risk Engn, New York, NY 11201 USA
[4] Hohai Univ, Coll Comp & Informat, Nanjing 211100, Peoples R China
[5] Peking Univ, Ctr Frontiers Comp Studies, Beijing 100871, Peoples R China
基金
中国国家自然科学基金;
关键词
Reinforcement learning; Deep learning; Trading strategy; Strategy optimization; Intelligent decision-making; PORTFOLIO MANAGEMENT; MARKET; LEVEL;
D O I
10.1016/j.eswa.2025.127540
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reinforcement learning (RL) has emerged as a powerful tool for optimizing intelligent investment decision-making. With the rapid evolution of financial markets, traditional approaches often struggle to effectively analyze the vast and complex datasets involved. RL-based methods address these challenges by leveraging neural networks to process large-scale financial data, dynamically interacting with market environments to refine strategies, and designing tailored reward functions to achieve diverse investment objectives. This paper provides a comprehensive review of recent advancements in RL for investment decision-making, with a focus on four key areas, i.e., portfolio selection, trade execution, options hedging, and market making. These four problems represent highly challenging instances of multi-stage , multi-objective decision optimization in investment, highlighting the strengths of RL-based methods in effectively balancing trade-offs among different objectives over time. Detailed comparison work of state-of-the-art RL-based methods is presented, analyzing the action spaces, state representations, reward structures, and neural network architectures. Finally, the paper discusses some new challenges and point out some directions for future research in the field.
引用
收藏
页数:18
相关论文
共 111 条
[1]   Fundamental analysis, future earnings, and stock prices [J].
Abarbanell, JS ;
Bushee, BJ .
JOURNAL OF ACCOUNTING RESEARCH, 1997, 35 (01) :1-24
[2]  
Almgren R., 2007, Algorithmic Trading III, P59
[3]  
Almgren R., 2000, J RISK, V3, P5, DOI DOI 10.21314/JOR.2001.041
[4]   High-frequency trading in a limit order book [J].
Avellaneda, Marco ;
Stoikov, Sasha .
QUANTITATIVE FINANCE, 2008, 8 (03) :217-224
[5]  
Bao WH, 2019, Arxiv, DOI arXiv:1906.11046
[6]  
Beysolow II T., 2019, Applied Reinforcement Learning with Python: With OpenAI Gym, Tensorflow, and Keras, P77, DOI [10.1007/978-1-4842-5127-04, DOI 10.1007/978-1-4842-5127-04]
[7]   Natural actor-critic algorithms [J].
Bhatnagar, Shalabh ;
Sutton, Richard S. ;
Ghavamzadeh, Mohammad ;
Lee, Mark .
AUTOMATICA, 2009, 45 (11) :2471-2482
[8]   PRICING OF OPTIONS AND CORPORATE LIABILITIES [J].
BLACK, F ;
SCHOLES, M .
JOURNAL OF POLITICAL ECONOMY, 1973, 81 (03) :637-654
[9]  
Black F., 1992, FINANC ANAL J, V48, P28, DOI [DOI 10.2469/FAJ.V48.N5.28, 10.2469/faj.v48.n5.28]
[10]  
Buehler H, 2019, Swiss finance institute research paper, P19