The vehicle speed strategy with double traffic lights based on reinforcement learning

被引:0
作者
Chen, Kaixuan [1 ]
Wu, Guangqiang [1 ]
Peng, Shang [1 ]
Zeng, Xiang [1 ]
Ju, Lijuan [1 ]
机构
[1] Tongji Univ, Inst Automot Simulat Sci, Sch Automobile Studies, Shanghai 201804, Peoples R China
关键词
Q-learning; double traffic lights; vehicle speed decision; reinforcement learning; Markov model; fuel consumption model;
D O I
10.1504/IJVP.2023.131974
中图分类号
TH [机械、仪表工业];
学科分类号
0802 ;
摘要
This paper proposes a speed strategy based on reinforcement learning on the basis of double traffic lights. This strategy can ensure that vehicles can pass traffic lights without stopping or with little stopping. First of all, Prescan software is used to build traffic lights, roads, and vehicles and other scenario models. Simulink software is used for vehicles, traffic lights control, and other models. Secondly, the double traffic lights scenario has analysed in detail. And then, the improved Q-learning algorithm is used to build the vehicle speed decision model and train the Q table. Q table is used for subsequent real vehicle tests and simulation verification. Finally, the feasibility of the strategy is verified in a variety of conditions, and the results show that the strategy can guarantee fuel economy and get through the double traffic lights as smoothly as possible.
引用
收藏
页码:250 / 271
页数:23
相关论文
共 50 条
  • [1] Traffic Lights Dynamic Timing Algorithm Based on Reinforcement Learning
    Lu, Chenqing
    Wen, Feng
    Gen, Mitsuo
    PROCEEDINGS OF THE ELEVENTH INTERNATIONAL CONFERENCE ON MANAGEMENT SCIENCE AND ENGINEERING MANAGEMENT, 2018, : 1752 - 1761
  • [2] Reinforcement Learning with Average Cost for Adaptive Control of Traffic Lights at Intersections
    Prashanth, L. A.
    Bhatnagar, Shalabh
    2011 14TH INTERNATIONAL IEEE CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS (ITSC), 2011, : 1640 - 1645
  • [3] Research on Energy Management Strategy of Electric Vehicle Hybrid System Based on Reinforcement Learning
    Cheng, Yu
    Xu, Ge
    Chen, Qihong
    ELECTRONICS, 2022, 11 (13)
  • [4] Reinforcement Learning-Based Variable Speed Limit Control Strategy to Reduce Traffic Congestion at Freeway Recurrent Bottlenecks
    Li, Zhibin
    Liu, Pan
    Xu, Chengcheng
    Duan, Hui
    Wang, Wei
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (11) : 3204 - 3217
  • [5] Reinforcement learning approach to develop variable speed limit strategy using vehicle data and simulations
    Kim, Yunjong
    Kang, Kawon
    Park, Nuri
    Park, Juneyoung
    Oh, Cheol
    JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2024,
  • [6] Traffic Signal Control With Reinforcement Learning Based on Region-Aware Cooperative Strategy
    Wang, Min
    Wu, Libing
    Li, Jianxin
    He, Liu
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 6774 - 6785
  • [7] Development and Evaluation of a Smart Charging Strategy for an Electric Vehicle Fleet Based on Reinforcement Learning
    Tuchnitz, Felix
    Ebell, Niklas
    Schlund, Jonas
    Pruckner, Marco
    APPLIED ENERGY, 2021, 285
  • [8] Dynamic Pricing Strategy of Electric Vehicle Aggregators Based on DDPG Reinforcement Learning Algorithm
    Liu, Dunnan
    Wang, Weiye
    Wang, Lingxiang
    Jia, Heping
    Shi, Mengshu
    IEEE ACCESS, 2021, 9 : 21556 - 21566
  • [9] Energy Management Strategy of Fuel Cell Vehicles Based on Reinforcement Learning and Traffic Information
    Song Z.
    Min D.
    Chen H.
    Pan Y.
    Zhang T.
    Tongji Daxue Xuebao/Journal of Tongji University, 2021, 49 : 211 - 216
  • [10] Reinforcement Learning Based Obstacle Avoidance for Autonomous Underwater Vehicle
    Prashant Bhopale
    Faruk Kazi
    Navdeep Singh
    Journal of Marine Science and Application, 2019, 18 : 228 - 238