Simulation of human-vehicle interaction at right-turn unsignalized intersections: A game-theoretic deep maximum entropy inverse reinforcement learning method
Human-vehicle interaction;
Game theory;
Inverse reinforcement learning;
Pedestrian simulation;
Reward function;
SOCIAL FORCE MODEL;
PEDESTRIAN BEHAVIOR;
D O I:
10.1016/j.aap.2025.107960
中图分类号:
TB18 [人体工程学];
学科分类号:
1201 ;
摘要:
The safety of pedestrians in urban transportation systems has emerged as a significant research topic. As a vulnerable group within this transportation framework, pedestrians encounter heightened safety risks in complex urban road environments. Protecting this group and safeguarding their rights and interests in urban transportation has garnered attention from academia and industry. The objective of this study is to develop a reliable simulation model that represents pedestrian crossing behavior at unsignalized crosswalks. A data- driven human-vehicle interaction behavior modeling framework is proposed, describing the human-vehicle interaction process at right-turning unsignalized intersections as a standard Markov decision-making process. In this framework, pedestrians are treated as the primary agents, and human-vehicle interactions are described using game theory. The Deep Maximum Entropy Inverse Reinforcement Learning (DMIRL) approach, combined with game theory, is employed to identify a reward function that encapsulates these interactions. The Deep Q-network (DQN) algorithm is then designed to simulate pedestrian crossing behavior based on the derived reward function. Finally, a comparison with a baseline algorithm that does not account for the game dynamics validates the proposed framework's effectiveness and feasibility.
机构:
Beijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
Zhang, Ran
Wei, Zhonghua
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
Wei, Zhonghua
Gu, Heng
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
Gu, Heng
Qiu, Shi
论文数: 0引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Civil Engn, Changsha 410083, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
机构:
Univ Connecticut, Mech Engn, Storrs, CT 06269 USA
Suzhou Zhito Technol Co LTD, AI Res & Dev Ctr, Shanghai, Peoples R ChinaUniv Connecticut, Mech Engn, Storrs, CT 06269 USA
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Zhou, Min
Dong, Hairong
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Dong, Hairong
Wang, Xiao
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
V1Pioneers Inc, Qingdao 266109, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Wang, Xiao
Hu, Xiaoming
论文数: 0引用数: 0
h-index: 0
机构:
KTH Royal Inst Technol, Dept Math, SE-10044 Stockholm, SwedenBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Hu, Xiaoming
Ge, Shichao
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Zhou, Min
Dong, Hairong
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Dong, Hairong
Zhao, Yanbo
论文数: 0引用数: 0
h-index: 0
机构:
Univ Southern Calif, METRANS Transportat Ctr, Dept Elect Engn, Los Angeles, CA 90089 USABeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Zhao, Yanbo
Ioannou, Petros A.
论文数: 0引用数: 0
h-index: 0
机构:
Univ Southern Calif, Ctr Adv Transportat Technol, Dept Elect Engn, Los Angeles, CA 90089 USABeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Ioannou, Petros A.
Wang, Fei-Yue
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
Natl Univ Def Technol, Res Ctr Computat Expt & Parallel Syst, Changsha 410073, Hunan, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
机构:
Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R ChinaHong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R China
Zhu, Dianchen
Sze, N. N.
论文数: 0引用数: 0
h-index: 0
机构:
Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R ChinaHong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R China
机构:
Beijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
Zhang, Ran
Wei, Zhonghua
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
Wei, Zhonghua
Gu, Heng
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
Gu, Heng
Qiu, Shi
论文数: 0引用数: 0
h-index: 0
机构:
Cent South Univ, Sch Civil Engn, Changsha 410083, Peoples R ChinaBeijing Univ Technol, Fac Architecture Civil & Transportat Engn, Beijing 100124, Peoples R China
机构:
Univ Connecticut, Mech Engn, Storrs, CT 06269 USA
Suzhou Zhito Technol Co LTD, AI Res & Dev Ctr, Shanghai, Peoples R ChinaUniv Connecticut, Mech Engn, Storrs, CT 06269 USA
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Zhou, Min
Dong, Hairong
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Dong, Hairong
Wang, Xiao
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
V1Pioneers Inc, Qingdao 266109, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Wang, Xiao
Hu, Xiaoming
论文数: 0引用数: 0
h-index: 0
机构:
KTH Royal Inst Technol, Dept Math, SE-10044 Stockholm, SwedenBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Hu, Xiaoming
Ge, Shichao
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Zhou, Min
Dong, Hairong
论文数: 0引用数: 0
h-index: 0
机构:
Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Dong, Hairong
Zhao, Yanbo
论文数: 0引用数: 0
h-index: 0
机构:
Univ Southern Calif, METRANS Transportat Ctr, Dept Elect Engn, Los Angeles, CA 90089 USABeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Zhao, Yanbo
Ioannou, Petros A.
论文数: 0引用数: 0
h-index: 0
机构:
Univ Southern Calif, Ctr Adv Transportat Technol, Dept Elect Engn, Los Angeles, CA 90089 USABeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
Ioannou, Petros A.
Wang, Fei-Yue
论文数: 0引用数: 0
h-index: 0
机构:
Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
Natl Univ Def Technol, Res Ctr Computat Expt & Parallel Syst, Changsha 410073, Hunan, Peoples R ChinaBeijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
机构:
Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R ChinaHong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R China
Zhu, Dianchen
Sze, N. N.
论文数: 0引用数: 0
h-index: 0
机构:
Hong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R ChinaHong Kong Polytech Univ, Dept Civil & Environm Engn, Hung Hom, Kowloon, Hong Kong, Peoples R China