DDPG-based Energy-Efficient Train Speed Trajectory Optimization under Virtual Coupling

被引:0
作者
Liu, Xuan [1 ]
Zhou, Min [1 ]
Tan, Ligang [2 ]
Dong, Hairong [1 ]
机构
[1] Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing 100044, Peoples R China
[2] China State Railway Grp Co Ltd, Beijing, Peoples R China
来源
2023 IEEE 26TH INTERNATIONAL CONFERENCE ON INTELLIGENT TRANSPORTATION SYSTEMS, ITSC | 2023年
基金
中国国家自然科学基金;
关键词
DDPG; Energy-Efficient; Virtual Coupling; Protection; Optimization;
D O I
10.1109/ITSC57777.2023.10422416
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Train operation control under virtual coupling has become an efficient method to increase the capacity of the railway, especially in the scenario of emergencies represented by the temporary speed restriction. To realize safe, efficient, and energy-saving operations for the following train under virtual coupling, this paper proposes a deep reinforcement learning method for follower speed trajectory optimization based on the given speed trajectory of the leader. The agent outputs the continuous values in [ 1] to control the follower to brake or accelerate. A collision-avoidance protection mechanism is conducted in the learning process to ensure feasible action. Numerical experiments are carried out based on real railway data. The results indicate that the proposed method can achieve a more energy-efficient process of tight and safe following between the adjacent trains in less computation time.
引用
收藏
页码:5718 / 5723
页数:6
相关论文
共 18 条
[1]  
[Anonymous], 2015, CHARACTERISTICS TRAI
[2]   Investigating Market Potentials and Operational Scenarios of Virtual Coupling Railway Signaling [J].
Aoun, Joelle ;
Quaglietta, Egidio ;
Goverde, Rob M. P. .
TRANSPORTATION RESEARCH RECORD, 2020, 2674 (08) :799-812
[3]   Trajectory Optimization for High-Speed Trains via a Mixed Integer Linear Programming Approach [J].
Cao, Yuan ;
Zhang, Zixuan ;
Cheng, Fanglin ;
Su, Shuai .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) :17666-17676
[4]  
Dong H, 2021, P 2019 INT C COMPUTA, V9, P1574
[5]   Comfortable and energy-efficient speed control of autonomous vehicles on rough pavements using deep reinforcement learning [J].
Du, Yuchuan ;
Chen, Jing ;
Zhao, Cong ;
Liu, Chenglong ;
Liao, Feixiong ;
Chan, Ching-Yao .
TRANSPORTATION RESEARCH PART C-EMERGING TECHNOLOGIES, 2022, 134
[6]  
JIANG L, 2021, 2021 7 INT C MOD TEC, DOI DOI 10.1109/GLOBECOM46510.2021.9685327
[7]  
Miao R., 2022, A Capacity-Effective Scheduling Approach for Virtual Coupling Train Operations
[8]   Deep Deterministic Policy Gradient for High-Speed Train Trajectory Optimization [J].
Ning, Lingbin ;
Zhou, Min ;
Hou, Zhuopu ;
Goverde, Rob M. P. ;
Wang, Fei-Yue ;
Dong, Hairong .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (08) :11562-11574
[9]   A multi-state train-following model for the analysis of virtual coupling railway operations [J].
Quaglietta, Egidio ;
Wang, Meng ;
Goverde, Rob M. P. .
JOURNAL OF RAIL TRANSPORT PLANNING & MANAGEMENT, 2020, 15
[10]   A cooperative collision-avoidance control methodology for virtual coupling trains [J].
Su, Shuai ;
Liu, Wentao ;
Zhu, Qingyang ;
Li, Ruoqing ;
Tang, Tao ;
Lv, Jidong .
ACCIDENT ANALYSIS AND PREVENTION, 2022, 173