Development of an Efficient Driving Strategy for Connected and Automated Vehicles at Signalized Intersections: A Reinforcement Learning Approach

被引:231
作者
Zhou, Mofan [1 ]
Yu, Yang [2 ]
Qu, Xiaobo [3 ]
机构
[1] Tencent Holdings Ltd, Shenzhen 518057, Peoples R China
[2] Univ Technol Sydney, Sch Civil & Environm Engn, Sydney, NSW 2007, Australia
[3] Chalmers Univ Technol, Dept Architecture & Civil Engn, S-41296 Gothenburg, Sweden
关键词
Oscillators; Trajectory; Reinforcement learning; Vehicles; Real-time systems; Optimization; Training; Neural network; reinforcement learning; car-following; intersection; traffic light; machine learning; deep deterministic policy gradient; traffic oscillation; ADAPTIVE CRUISE CONTROL; TRAJECTORY DESIGN; VALIDATION; MODEL; GO; PROPAGATION; ALGORITHMS; PREDICTION; FRAMEWORK; GAME;
D O I
10.1109/TITS.2019.2942014
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
The concept of Connected and Automated Vehicles (CAVs) enables instant traffic information to be shared among vehicle networks. With this newly proposed concept, a vehicle's driving behaviour will no longer be solely based on the driver's limited and incomplete observation. By taking advantages of the shared information, driving behaviours of CAVs can be improved greatly to a more responsible, accurate and efficient level. This study proposed a reinforcement-learning-based car following model for CAVs in order to obtain an appropriate driving behaviour to improve travel efficiency, fuel consumption and safety at signalized intersections in real-time. The result shows that by specifying an effective reward function, a controller can be learned and works well under different traffic demands as well as traffic light cycles with different durations. This study reveals a great potential of emerging reinforcement learning technologies in transport research and applications.
引用
收藏
页码:433 / 443
页数:11
相关论文
共 63 条
[1]   Estimating vehicle fuel consumption and emissions based on instantaneous speed and acceleration levels [J].
Ahn, K ;
Rakha, H ;
Trani, A ;
Van Aerde, M .
JOURNAL OF TRANSPORTATION ENGINEERING, 2002, 128 (02) :182-190
[2]  
[Anonymous], THEORY REINFORCEMENT
[3]  
[Anonymous], [No title captured]
[4]  
[Anonymous], 2016, 33 INT C MACH LEARN
[5]  
[Anonymous], 2017, ABS170702286 CORR
[6]  
[Anonymous], S INN TRAFF FLOW THE
[7]  
[Anonymous], [No title captured]
[8]  
[Anonymous], 2015, Reinforcement Learning: An Introduction
[9]  
[Anonymous], [No title captured]
[10]   Learning-based traffic signal control algorithms with neighborhood information sharing: An application for sustainable mobility [J].
Aziz, H. M. Abdul ;
Zhu, Feng ;
Ukkusuri, Satish V. .
JOURNAL OF INTELLIGENT TRANSPORTATION SYSTEMS, 2018, 22 (01) :40-52