Simulation of human-vehicle interaction at right-turn unsignalized intersections: A game-theoretic deep maximum entropy inverse reinforcement learning method

被引:0
作者
Li, Wenli [1 ]
Li, Xianglong [1 ]
Li, Lingxi [2 ]
Tang, Yuanhang [1 ]
Hu, Yuanzhi [1 ]
机构
[1] Chongqing Univ Technol, Key Lab Adv Mfg Technol Automobile Parts, Minist Educ, 69 Hongguang Ave, Chongqing 400054, Peoples R China
[2] Purdue Univ, Elmore Family Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
基金
中国国家自然科学基金;
关键词
Human-vehicle interaction; Game theory; Inverse reinforcement learning; Pedestrian simulation; Reward function; SOCIAL FORCE MODEL; PEDESTRIAN BEHAVIOR;
D O I
10.1016/j.aap.2025.107960
中图分类号
TB18 [人体工程学];
学科分类号
1201 ;
摘要
The safety of pedestrians in urban transportation systems has emerged as a significant research topic. As a vulnerable group within this transportation framework, pedestrians encounter heightened safety risks in complex urban road environments. Protecting this group and safeguarding their rights and interests in urban transportation has garnered attention from academia and industry. The objective of this study is to develop a reliable simulation model that represents pedestrian crossing behavior at unsignalized crosswalks. A data- driven human-vehicle interaction behavior modeling framework is proposed, describing the human-vehicle interaction process at right-turning unsignalized intersections as a standard Markov decision-making process. In this framework, pedestrians are treated as the primary agents, and human-vehicle interactions are described using game theory. The Deep Maximum Entropy Inverse Reinforcement Learning (DMIRL) approach, combined with game theory, is employed to identify a reward function that encapsulates these interactions. The Deep Q-network (DQN) algorithm is then designed to simulate pedestrian crossing behavior based on the derived reward function. Finally, a comparison with a baseline algorithm that does not account for the game dynamics validates the proposed framework's effectiveness and feasibility.
引用
收藏
页数:13
相关论文
共 49 条
[41]   A Game Theoretic Model Predictive Controller With Aggressiveness Estimation for Mandatory Lane Change [J].
Zhang, Qingyu ;
Langari, Reza ;
Tseng, H. Eric ;
Filev, Dimitar ;
Szwabowski, Steven ;
Coskun, Serdar .
IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2020, 5 (01) :75-89
[42]   Behavior Evolution of Multi-Group in the Process of Pedestrian Crossing Based on Evolutionary Game Theory [J].
Zhang, Ran ;
Wei, Zhonghua ;
Gu, Heng ;
Qiu, Shi .
SUSTAINABILITY, 2021, 13 (04) :1-17
[43]   Deep reinforcement learning with a particle dynamics environment applied to emergency evacuation of a room with obstacles [J].
Zhang, Yihao ;
Chai, Zhaojie ;
Lykotrafitis, George .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2021, 571
[44]   Investigating consecutive conflicts of pedestrian crossing at unsignalized crosswalks using the bivariate logistic approach [J].
Zheng, Lai ;
Wen, Cheng ;
Guo, Yanyong ;
Laureshyn, Aliaksei .
ACCIDENT ANALYSIS AND PREVENTION, 2021, 162
[45]   Modeling and Simulation of Crowd Evacuation With Signs at Subway Platform: A Case Study of Beijing Subway Stations [J].
Zhou, Min ;
Dong, Hairong ;
Wang, Xiao ;
Hu, Xiaoming ;
Ge, Shichao .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (02) :1492-1504
[46]   Optimization of Crowd Evacuation With Leaders in Urban Rail Transit Stations [J].
Zhou, Min ;
Dong, Hairong ;
Zhao, Yanbo ;
Ioannou, Petros A. ;
Wang, Fei-Yue .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (12) :4476-4487
[47]   Simulation of pedestrian behavior during the flashing green signal using a modified social force model [J].
Zhou, Zhuping ;
Zhou, Yang ;
Pu, Ziyuan ;
Xu, Yongneng .
TRANSPORTMETRICA A-TRANSPORT SCIENCE, 2019, 15 (02) :1019-1040
[48]   Propensities of red light running of pedestrians at the two-stage crossings with split pedestrian signal phases [J].
Zhu, Dianchen ;
Sze, N. N. .
ACCIDENT ANALYSIS AND PREVENTION, 2021, 151
[49]   Interactions between autonomous vehicles and pedestrians at unsignalized mid-block crosswalks considering occlusions by opposing vehicles [J].
Zhu, Hong ;
Iryo-Asano, Miho ;
Alhajyaseen, Wael K. M. ;
Nakamura, Hideki ;
Dias, Charitha .
ACCIDENT ANALYSIS AND PREVENTION, 2021, 163