A Three-Level Game-Theoretic Decision-Making Framework for Autonomous Vehicles

被引:16
作者
Liu, Mushuang [1 ]
Wan, Yan [1 ]
Lewis, Frank L. [2 ]
Nageshrao, Subramanya [3 ]
Filev, Dimitar [4 ]
机构
[1] Univ Texas Arlington, Dept Elect Engn, Arlington, TX 76019 USA
[2] Univ Texas Arlington, UTA Res Inst, Ft Worth, TX 76118 USA
[3] Ford Greenfield Labs, Palo Alto, CA 94304 USA
[4] Ford Res & Innovat Ctr, Dearborn, MI 48124 USA
关键词
Games; Decision making; Safety; Autonomous vehicles; Nash equilibrium; Supervised learning; Roads; Autonomous driving; decision making; game theory; DRIVING BEHAVIOR; DRIVER; MODEL;
D O I
10.1109/TITS.2022.3172926
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In this paper, a three-level decision-making framework is developed to generate safe and effective decisions for autonomous vehicles (AVs). A key component in this decision framework is a normal-form game to capture the interactions between the ego vehicle and its surrounding vehicles. The payoffs in the normal-form game are designed to capture both safety reward and the reward gained by obeying (or the price paid by violating) ``soft'' traffic rules, e.g., first-come-first-go. This game formulation enables the ego to 1) make appropriate decisions considering the payoffs and possible actions of its surrounding vehicles, and 2) take intelligent actions in emergencies that may sacrifice some soft traffic rules to ensure safety. Moreover, we introduce parameters in the payoff matrix to tune the ego vehicle's behavior, e.g., aggressiveness level. A neural network is developed to learn the tuning parameters via supervised learning. In addition, to enable the ego to respond timely to different surrounding vehicles' driving styles, driving style characterization is incorporated into the payoff design for the normal-form game. Simulation studies are conducted to demonstrate the performance of the developed algorithms in two-vehicle intersection-crossing and lane-changing scenarios.
引用
收藏
页码:20298 / 20308
页数:11
相关论文
共 50 条
[21]   Planning and Decision-Making for Autonomous Vehicles [J].
Schwarting, Wilko ;
Alonso-Mora, Javier ;
Rus, Daniela .
ANNUAL REVIEW OF CONTROL, ROBOTICS, AND AUTONOMOUS SYSTEMS, VOL 1, 2018, 1 :187-210
[22]   An Integrated Framework of Decision Making and Motion Planning for Autonomous Vehicles Considering Social Behaviors [J].
Hang, Peng ;
Lv, Chen ;
Huang, Chao ;
Cai, Jiacheng ;
Hu, Zhongxu ;
Xing, Yang .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (12) :14458-14469
[23]   Developing a game-theoretic interactive decision-making framework for urban land-use planning [J].
Abolhasani, Somaie ;
Taleai, Mohammad ;
Lakes, Tobia .
HABITAT INTERNATIONAL, 2023, 141
[24]   Game-Theoretic Frameworks for Epidemic Spreading and Human Decision-Making: A Review [J].
Huang, Yunhan ;
Zhu, Quanyan .
DYNAMIC GAMES AND APPLICATIONS, 2022, 12 (01) :7-48
[25]   Game-theoretic Cooperative Coverage using Autonomous Vehicles [J].
Song, Junnan ;
Gupta, Shalabh ;
Hare, James .
2014 OCEANS - ST. JOHN'S, 2014,
[26]   Decision-Making Method of Autonomous Vehicles in Urban Environments Considering Traffic Laws [J].
Lu, Xinghao ;
Zhao, Haiyan ;
Gao, Bingzhao ;
Chen, Weixuan ;
Chen, Hong .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :21641-21652
[27]   A Review of Decision-Making and Planning for Autonomous Vehicles in Intersection Environments [J].
Chen, Shanzhi ;
Hu, Xinghua ;
Zhao, Jiahao ;
Wang, Ran ;
Qiao, Min .
WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (03)
[28]   Game-Theoretic Modeling of Traffic in Unsignalized Intersection Network for Autonomous Vehicle Control Verification and Validation [J].
Tian, Ran ;
Li, Nan ;
Kolmanovsky, Ilya ;
Yildiz, Yildiray ;
Girard, Anouck R. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (03) :2211-2226
[29]   Safe and Energy-Saving Vehicle-Following Driving Decision-Making Framework of Autonomous Vehicles [J].
Zhang, Ying ;
You, Tao ;
Chen, Jinchao ;
Du, Chenglie ;
Ai, Zhaoyang ;
Qu, Xiaobo .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2022, 69 (12) :13859-13871
[30]   Game-Theoretic Decision-Making and Payoff Design for UAV Collision Avoidance in a Three-Dimensional Airspace [J].
Deniz, Meryem ;
Zhao, Lu ;
Wan, Yan ;
Lewis, Frank L. .
UNMANNED SYSTEMS, 2024, 12 (03) :499-509