Predictive cruise control of connected and autonomous vehicles via reinforcement learning

被引:19
作者
Gao, Weinan [1 ]
Odekunle, Adedapo [1 ]
Chen, Yunfeng [2 ]
Jiang, Zhong-Ping [3 ]
机构
[1] Georgia Southern Univ, Allen E Paulson Coll Engn & Comp, Dept Elect & Comp Engn, Statesboro, GA 30460 USA
[2] Purdue Univ, Purdue Polytech Inst, Dept Construct Management Technol, W Lafayette, IN 47907 USA
[3] NYU, Tandon Sch Engn, Dept Elect & Comp Engn, Brooklyn, NY 11201 USA
关键词
road vehicles; optimal control; adaptive control; learning (artificial intelligence); predictive control; velocity control; distributed control; road traffic control; mobile robots; acceleration control; reinforcement learning; autonomous vehicle; data-driven adaptive optimal control algorithm; vehicle safety; passenger comfort; predictive cruise control; connected vehicles; distributed optimal controllers; suboptimal control; velocity regulation; headway regulation; acceleration regulation; TIME MULTIAGENT SYSTEMS; OUTPUT REGULATION; CONSENSUS;
D O I
10.1049/iet-cta.2018.6031
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predictive cruise control concerns designing controllers for autonomous vehicles using the broadcasted information from the traffic lights such that the idle time around the intersection can be reduced. This study proposes a novel adaptive optimal control approach based on reinforcement learning to solve the predictive cruise control problem of a platoon of connected and autonomous vehicles. First, the reference velocity is determined for each autonomous vehicle in the platoon. Second, a data-driven adaptive optimal control algorithm is developed to estimate the gains of the desired distributed optimal controllers without the exact knowledge of system dynamics. The obtained controller is able to regulate the headway, velocity, and acceleration of each vehicle in a suboptimal sense. The goal of trip time reduction is achieved without compromising vehicle safety and passenger comfort. Numerical simulations are presented to validate the efficacy of the proposed methodology.
引用
收藏
页码:2849 / 2855
页数:7
相关论文
共 32 条
[1]  
Alrifaee B, 2015, MED C CONTR AUTOMAT, P82, DOI 10.1109/MED.2015.7158733
[2]   Predictive Cruise Control: Utilizing Upcoming Traffic Signal Information for Improving Fuel Economy and Reducing Trip Time [J].
Asadi, Behrang ;
Vahidi, Ardalan .
IEEE TRANSACTIONS ON CONTROL SYSTEMS TECHNOLOGY, 2011, 19 (03) :707-714
[3]   Cooperative Adaptive Cruise Control: A Reinforcement Learning Approach [J].
Desjardins, Charles ;
Chaib-draa, Brahim .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2011, 12 (04) :1248-1260
[4]   Adaptive Actor-Critic Design-Based Integral Sliding-Mode Control for Partially Unknown Nonlinear Systems With Input Disturbances [J].
Fan, Quan-Yong ;
Yang, Guang-Hong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2016, 27 (01) :165-177
[5]  
Fang HZ, 2016, IEEE DECIS CONTR P, P4226, DOI 10.1109/CDC.2016.7798911
[6]  
Gao W., 2018, TRB ANN M WASH DC
[7]   Leader-to-Formation Stability of Multiagent Systems: An Adaptive Optimal Control Approach [J].
Gao, Weinan ;
Jiang, Zhong-Ping ;
Lewis, Frank L. ;
Wang, Yebin .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (10) :3581-3587
[8]   Learning-Based Adaptive Optimal Tracking Control of Strict-Feedback Nonlinear Systems [J].
Gao, Weinan ;
Jiang, Zhong-Ping .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (06) :2614-2624
[9]   Data-Driven Adaptive Optimal Control of Connected Vehicles [J].
Gao, Weinan ;
Jiang, Zhong-Ping ;
Ozbay, Kaan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (05) :1122-1133
[10]   Adaptive Dynamic Programming and Adaptive Optimal Output Regulation of Linear Systems [J].
Gao, Weinan ;
Jiang, Zhong-Ping .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2016, 61 (12) :4164-4169