Generating Synthetic Bitcoin Transactions and Predicting Market Price Movement via Inverse Reinforcement Learning and Agent-Based Modeling

被引:15
|
作者
Lee, Kamwoo [1 ]
Ulkuatam, Sinan [1 ]
Beling, Peter [1 ]
Scherer, William [1 ]
机构
[1] Univ Virginia, Dept Syst & Informat Engn, 151 Engineers Way, Charlottesville, VA 22904 USA
来源
JASSS-THE JOURNAL OF ARTIFICIAL SOCIETIES AND SOCIAL SIMULATION | 2018年 / 21卷 / 03期
关键词
Cryptocurrency; Bitcoin; Inverse Reinforcement Lerning; Agent-Based Modeling;
D O I
10.18564/jasss.3733
中图分类号
C [社会科学总论];
学科分类号
03 ; 0303 ;
摘要
In this paper, we present a novel method to predict Bitcoin price movement utilizing inverse reinforcement learning (IRL) and agent-based modeling (ABM). Our approach consists of predicting the price through reproducing synthetic yet realistic behaviors of rational agents in a simulated market, instead of estimating relationships between the price and price-related factors. IRL provides a systematic way to find the behavioral rules of each agent from Blockchain data by framing the trading behavior estimation as a problem of recovering motivations from observed behavior and generating rules consistent with these motivations. Once the rules are recovered, an agent-based model creates hypothetical interactions between the recovered behavioral rules, discovering equilibrium prices as emergent features through matching the supply and demand of Bitcoin. One distinct aspect of our approach with ABM is that while conventional approaches manually design individual rules, our agents' rules are channeled from IRL. Our experimental results show that the proposed method can predict short-term market price while outlining overall market trend.
引用
收藏
页数:11
相关论文
共 33 条
  • [1] AGENT-BASED MODEL CONSTRUCTION USING INVERSE REINFORCEMENT LEARNING
    Lee, Kamwoo
    Rucker, Mark
    Scherer, William T.
    Beling, Peter A.
    Gerber, Matthew S.
    Kang, Hyojung
    2017 WINTER SIMULATION CONFERENCE (WSC), 2017, : 1264 - 1275
  • [2] Generating a Synthetic Population in Support of Agent-Based Modeling of Transportation in Sydney
    Huynh, N.
    Namazi-Rad, M.
    Perez, P.
    Berryman, M. J.
    Chen, Q.
    Barthelemy, J.
    20TH INTERNATIONAL CONGRESS ON MODELLING AND SIMULATION (MODSIM2013), 2013, : 1357 - 1363
  • [3] Simulation-based optimization of radiotherapy: Agent-based modeling and reinforcement learning
    Jalalimanesh, Ammar
    Haghighi, Hamidreza Shahabi
    Ahmadi, Abbas
    Soltani, Madjid
    MATHEMATICS AND COMPUTERS IN SIMULATION, 2017, 133 : 235 - 248
  • [4] Embracing Complexity: Agent-Based Modeling for HetNets Design and Optimization via Concurrent Reinforcement Learning Algorithms
    Ibrahim, Mostafa
    Hashmi, Umair Sajid
    Nabeel, Muhammad
    Imran, Ali
    Ekin, Sabit
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2021, 18 (04): : 4042 - 4062
  • [5] Hybridization of reinforcement learning and agent-based modeling to optimize construction planning and scheduling
    Kedir, Nebiyu Siraj
    Somi, Sahand
    Fayek, Aminah Robinson
    Nguyen, Phuong H. D.
    AUTOMATION IN CONSTRUCTION, 2022, 142
  • [6] IDENTIFYING CORRELATES OF EMERGENT BEHAVIORS IN AGENT-BASED SIMULATION MODELS USING INVERSE REINFORCEMENT LEARNING
    Dadgostari, Faraz
    Swarup, Samarth
    Adams, Stephen
    Beling, Peter
    Mortveit, Henning S.
    2022 WINTER SIMULATION CONFERENCE (WSC), 2022, : 322 - 333
  • [7] Study on Market Stability and Price Limit of Chinese Stock Index Futures Market: An Agent-Based Modeling Perspective
    Xiong Xiong
    Ding Nan
    Yang Yang
    Zhang Yongjie
    PLOS ONE, 2015, 10 (11):
  • [8] An Agent-Based Simulation Modeling with Deep Reinforcement Learning for Smart Traffic Signal Control
    Jang, Ingook
    Kim, Donghun
    Lee, Donghun
    Son, Youngsung
    2018 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY CONVERGENCE (ICTC), 2018, : 1028 - 1030
  • [9] Pilot Performance Modeling via Observer-Based Inverse Reinforcement Learning
    Town, Jared
    Morrison, Zachary
    Kamalapurkar, Rushikesh
    IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2024, 32 (06) : 2444 - 2451
  • [10] A Novel Learning and Response Generating Agent-based Model for Symbolic - Numeric Knowledge Modeling and Combination
    Doboli, Alex
    Doboli, Simona
    2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), 2021,