Predictive cruise control of connected and autonomous vehicles via reinforcement learning

被引:19
|
作者
Gao, Weinan [1 ]
Odekunle, Adedapo [1 ]
Chen, Yunfeng [2 ]
Jiang, Zhong-Ping [3 ]
机构
[1] Georgia Southern Univ, Allen E Paulson Coll Engn & Comp, Dept Elect & Comp Engn, Statesboro, GA 30460 USA
[2] Purdue Univ, Purdue Polytech Inst, Dept Construct Management Technol, W Lafayette, IN 47907 USA
[3] NYU, Tandon Sch Engn, Dept Elect & Comp Engn, Brooklyn, NY 11201 USA
关键词
road vehicles; optimal control; adaptive control; learning (artificial intelligence); predictive control; velocity control; distributed control; road traffic control; mobile robots; acceleration control; reinforcement learning; autonomous vehicle; data-driven adaptive optimal control algorithm; vehicle safety; passenger comfort; predictive cruise control; connected vehicles; distributed optimal controllers; suboptimal control; velocity regulation; headway regulation; acceleration regulation; TIME MULTIAGENT SYSTEMS; OUTPUT REGULATION; CONSENSUS;
D O I
10.1049/iet-cta.2018.6031
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predictive cruise control concerns designing controllers for autonomous vehicles using the broadcasted information from the traffic lights such that the idle time around the intersection can be reduced. This study proposes a novel adaptive optimal control approach based on reinforcement learning to solve the predictive cruise control problem of a platoon of connected and autonomous vehicles. First, the reference velocity is determined for each autonomous vehicle in the platoon. Second, a data-driven adaptive optimal control algorithm is developed to estimate the gains of the desired distributed optimal controllers without the exact knowledge of system dynamics. The obtained controller is able to regulate the headway, velocity, and acceleration of each vehicle in a suboptimal sense. The goal of trip time reduction is achieved without compromising vehicle safety and passenger comfort. Numerical simulations are presented to validate the efficacy of the proposed methodology.
引用
收藏
页码:2849 / 2855
页数:7
相关论文
共 50 条
  • [1] Gaussian learning-based fuzzy predictive cruise control for improving safety and economy of connected vehicles
    He, Defeng
    Peng, Binbin
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (05) : 346 - 355
  • [2] Distributed predictive cruise control based on reinforcement learning and validation on microscopic traffic simulation
    Mynuddin, Mohammed
    Gao, Weinan
    IET INTELLIGENT TRANSPORT SYSTEMS, 2020, 14 (05) : 270 - 277
  • [3] Delay-feedback predictive cruise control of autonomous and connected vehicles
    He D.-F.
    Luo J.
    Shu X.-X.
    Jilin Daxue Xuebao (Gongxueban)/Journal of Jilin University (Engineering and Technology Edition), 2021, 51 (01): : 349 - 357
  • [4] Learning Model Predictive Control for Connected Autonomous Vehicles
    Jafarzadeh, Hassan
    Fleming, Cody
    2019 IEEE 58TH CONFERENCE ON DECISION AND CONTROL (CDC), 2019, : 2336 - 2343
  • [5] Platoon control of connected autonomous vehicles: A distributed reinforcement learning method by consensus
    Liu, Bo
    Ding, Zhengtao
    Lv, Chen
    IFAC PAPERSONLINE, 2020, 53 (02): : 15241 - 15246
  • [6] Comparison of Deep Reinforcement Learning and Model Predictive Control for Adaptive Cruise Control
    Lin, Yuan
    McPhee, John
    Azad, Nasser L.
    IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2021, 6 (02): : 221 - 231
  • [7] Autonomous Predictive Modeling via Reinforcement Learning
    Khurana, Udayan
    Samulowitz, Horst
    CIKM '20: PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, 2020, : 3285 - 3288
  • [8] Cooperative Adaptive Cruise Control of Connected and Autonomous Vehicles Subject to Input Saturation
    Gao, Weinan
    Rios-Gutierrez, Fernando
    Tong, Weitian
    Chen, Lei
    2017 IEEE 8TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS AND MOBILE COMMUNICATION CONFERENCE (UEMCON), 2017,
  • [9] Multi-Performance Predictive Cruise Control of Connected Vehicles on Urban Roads
    Sun Yu
    He Defeng
    Song Xiulan
    Zhang Lukuan
    PROCEEDINGS OF THE 35TH CHINESE CONTROL CONFERENCE 2016, 2016, : 9270 - 9275
  • [10] A Combined Reinforcement Learning and Model Predictive Control for Car-Following Maneuver of Autonomous Vehicles
    Wang, Liwen
    Yang, Shuo
    Yuan, Kang
    Huang, Yanjun
    Chen, Hong
    CHINESE JOURNAL OF MECHANICAL ENGINEERING, 2023, 36 (01)