Driver Modeling Through Deep Reinforcement Learning and Behavioral Game Theory

被引:40
作者
Albaba, Berat Mert [1 ]
Yildiz, Yildiray [1 ]
机构
[1] Bilkent Univ, Dept Mech Engn, TR-06800 Ankara, Turkey
关键词
Vehicles; Cognition; Acceleration; Data models; Training; Game theory; Reinforcement learning; Autonomous vehicles (AVs); deep learning; driver modeling; game theory (GT); reinforcement learning (RL); SYSTEMS;
D O I
10.1109/TCST.2021.3075557
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this work, a synergistic combination of deep reinforcement learning and hierarchical game theory is proposed as a modeling framework for behavioral predictions of drivers in highway driving scenarios. The modeling framework presented in this work can be used in a high-fidelity traffic simulator consisting of multiple human decision-makers. This simulator can reduce the time and effort spent for testing autonomous vehicles by allowing safe and quick assessment of self-driving control algorithms. To demonstrate the fidelity of the proposed modeling framework, game-theoretical driver models are compared with real human driver behavior patterns extracted from two different sets of traffic data.
引用
收藏
页码:885 / 892
页数:8
相关论文
共 56 条
[1]  
Agarap A. F., 2018, Deep learning using rectified linear units (ReLU)
[2]   Modeling cyber-physical human systems via an interplay between reinforcement learning and game theory [J].
Albaba, Berat Mert ;
Yildiz, Yildiray .
ANNUAL REVIEWS IN CONTROL, 2019, 48 :1-21
[3]   Stochastic Driver Modeling and Validation with Traffic Data [J].
Albaba, Mert ;
Yildiz, Yildiray ;
Li, Nan ;
Kolmanovsky, Ilya ;
Girard, Anouck .
2019 AMERICAN CONTROL CONFERENCE (ACC), 2019, :4198-4203
[4]  
Anderson J., 2016, Autonomous Vehicle Technology: A Guide for Policymakers, DOI DOI 10.7249/RR443-2
[5]  
[Anonymous], 2018, ARXIV180200332
[6]  
[Anonymous], 2019, TRAFF SAF FACTS
[7]   Probabilistically safe motion planning to avoid dynamic obstacles with uncertain motion patterns [J].
Aoude, Georges S. ;
Luders, Brandon D. ;
Joseph, Joshua M. ;
Roy, Nicholas ;
How, Jonathan P. .
AUTONOMOUS ROBOTS, 2013, 35 (01) :51-76
[8]   Cyber-Physical Security: A Game Theory Model of Humans Interacting Over Control Systems [J].
Backhaus, Scott ;
Bent, Russell ;
Bono, James ;
Lee, Ritchie ;
Tracey, Brendan ;
Wolpert, David ;
Xie, Dongping ;
Yildiz, Yildiray .
IEEE TRANSACTIONS ON SMART GRID, 2013, 4 (04) :2320-2327
[9]  
Bhattacharyya RP, 2019, IEEE INT CONF ROBOT, P789, DOI [10.1109/icra.2019.8793750, 10.1109/ICRA.2019.8793750]
[10]  
Bouton M, 2019, IEEE INT VEH SYM, P1469, DOI [10.1109/IVS.2019.8813803, 10.1109/ivs.2019.8813803]