Simulation of human-vehicle interaction at right-turn unsignalized intersections: A game-theoretic deep maximum entropy inverse reinforcement learning method

被引:0
作者
Li, Wenli [1 ]
Li, Xianglong [1 ]
Li, Lingxi [2 ]
Tang, Yuanhang [1 ]
Hu, Yuanzhi [1 ]
机构
[1] Chongqing Univ Technol, Key Lab Adv Mfg Technol Automobile Parts, Minist Educ, 69 Hongguang Ave, Chongqing 400054, Peoples R China
[2] Purdue Univ, Elmore Family Sch Elect & Comp Engn, W Lafayette, IN 47907 USA
基金
中国国家自然科学基金;
关键词
Human-vehicle interaction; Game theory; Inverse reinforcement learning; Pedestrian simulation; Reward function; SOCIAL FORCE MODEL; PEDESTRIAN BEHAVIOR;
D O I
10.1016/j.aap.2025.107960
中图分类号
TB18 [人体工程学];
学科分类号
1201 ;
摘要
The safety of pedestrians in urban transportation systems has emerged as a significant research topic. As a vulnerable group within this transportation framework, pedestrians encounter heightened safety risks in complex urban road environments. Protecting this group and safeguarding their rights and interests in urban transportation has garnered attention from academia and industry. The objective of this study is to develop a reliable simulation model that represents pedestrian crossing behavior at unsignalized crosswalks. A data- driven human-vehicle interaction behavior modeling framework is proposed, describing the human-vehicle interaction process at right-turning unsignalized intersections as a standard Markov decision-making process. In this framework, pedestrians are treated as the primary agents, and human-vehicle interactions are described using game theory. The Deep Maximum Entropy Inverse Reinforcement Learning (DMIRL) approach, combined with game theory, is employed to identify a reward function that encapsulates these interactions. The Deep Q-network (DQN) algorithm is then designed to simulate pedestrian crossing behavior based on the derived reward function. Finally, a comparison with a baseline algorithm that does not account for the game dynamics validates the proposed framework's effectiveness and feasibility.
引用
收藏
页数:13
相关论文
共 49 条
[31]  
Tianwen Dong, 2018, 2018 IEEE 3rd International Conference on Cloud Computing and Internet of Things (CCIOT), P560, DOI 10.1109/CCIOT45285.2018.9032504
[32]   Normal-Knowledge-Based Pavement Defect Segmentation Using Relevance-Aware and Cross-Reasoning Mechanisms [J].
Wang, Yanyan ;
Niu, Menghui ;
Song, Kechen ;
Jiang, Peng ;
Yan, Yunhui .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (04) :4413-4427
[33]   Investigating yielding behavior of heterogeneous vehicles at a semi-controlled crosswalk [J].
Wang, Yongjie ;
Su, Qian ;
Wang, Chao ;
Prato, Carlo G. .
ACCIDENT ANALYSIS AND PREVENTION, 2021, 161
[34]   Modeling illegal pedestrian crossing behaviors at unmarked mid-block roadway based on extended decision field theory [J].
Wang, Yongjie ;
Shen, Binchang ;
Wu, Hao ;
Wang, Chao ;
Su, Qian ;
Chen, Wenqiang .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2021, 562
[35]   Game theory modeling for vehicle-pedestrian interactions and simulation based on cellular automata [J].
Wu, WenJing ;
Chen, RunChao ;
Jia, Hongfei ;
Li, Yongxing ;
Liang, ZhiKang .
INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2019, 30 (04)
[36]  
Xu HX, 2016, Adv Inform Managemen, P1253, DOI 10.1109/IMCEC.2016.7867412
[37]   Capacity Model of Exclusive Right-Turn Lane at Signalized Intersection considering Pedestrian-Vehicle Interaction [J].
Yang, Chengcheng ;
Wang, Jiawen ;
Dong, Jieshuang .
JOURNAL OF ADVANCED TRANSPORTATION, 2020, 2020
[38]   A Modified Social Force Model for Pedestrian Behavior Simulation at Signalized Crosswalks [J].
Zeng, Weiliang ;
Nakamura, Hideki ;
Chen, Peng .
9TH INTERNATIONAL CONFERENCE ON TRAFFIC AND TRANSPORTATION STUDIES (ICTTS 2014), 2014, 138 :521-530
[39]   Pedestrian crossing behaviors at uncontrolled multi -lane mid-block crosswalks in developing world [J].
Zhang, Cunbao ;
Zhou, Bin ;
Qiu, Tony Z. ;
Liu, Shaobo .
JOURNAL OF SAFETY RESEARCH, 2018, 64 :145-154
[40]   Detection of driving actions on steering wheel using triboelectric nanogenerator via machine learning [J].
Zhang, Haodong ;
Cheng, Qian ;
Lu, Xiao ;
Wang, Wuhong ;
Wang, Zhong Lin ;
Sun, Chunwen .
NANO ENERGY, 2021, 79