Automatic train operation speed control based on ASP-SAC algorithm

被引:0
作者
Liu, Bohong [1 ]
Lu, Tian [1 ]
机构
[1] School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou
关键词
ASP-SAC algorithm; automatic train operation; multi-objective control; reinforcement learning; speed control;
D O I
10.19713/j.cnki.43-1423/u.T20231620
中图分类号
学科分类号
摘要
With the green transformation of economic development and the rapid advancement of artificial intelligence, urban rail transit has become an important mode of daily travel for residents. While ensuring safety, efficiency, and punctuality, the energy-saving and comfort demands of train operation have also attracted increasing attention. Reasonable operation strategies can effectively achieve automatic driving speed control of trains under multiple control requirements. Reinforcement learning, as an intelligent decision-making method, can effectively solve this control problem. Firstly, based on the comprehensive analysis of factors such as technology, safety, and passenger experience, the Soft Actor-Critic (SAC) algorithm was improved as the Action-State Experience Prioritized Soft Actor-Critic (ASP-SAC) method, using expert experience action segmentation and state information entropy to study the problem of automatic train operation speed control. Secondly, the problem was formalized as a Markov decision process. The train operation environment was established. The state space, action space, and reward function based on goal control were determined. Finally, using a section of data from the Beijing Subway Yizhuang Line as an example, the ASP-SAC method was validated and compared with other algorithms in the same environment. The research results show that the method is feasible for automatic train operation speed control under multiple target requirements, with an efficiency improvement of 22.73% compared to the unimproved algorithm, and a 29.17% improvement compared to the PPO algorithm. Additionally, the method outperforms SAC, DQN, PPO, and PID algorithms in timeliness, precision, and energy efficiency while ensuring safety and comfort during train operation, with energy consumption reduced by 3.64%, 5.62%, 4.38%, and 7.35% respectively, demonstrating good control effects. Furthermore, the method can possess robustness and has certain superiority and reference value in the aspect of automatic train operation speed control. © 2024, Central South University Press. All rights reserved.
引用
收藏
页码:2637 / 2648
页数:11
相关论文
共 18 条
  • [1] General situation of urban rail transit lines in China in 2022[J], China Metros, 2023, 1
  • [2] ZHANG Qiang, CHEN Dewang, YU Zhenyu, Performance evaluation of urban rail transit ATO system [J], Urban Rapid Rail Transit, 24, 4, (2011)
  • [3] RAO Xiaolu, The research and simulation of automatic train operation algorithm, (2010)
  • [4] LU Sha, Research on intelligent control algorithm for automatic train operation, (2018)
  • [5] HOU Tao, TANG Li, NIU Hongxia, Data-driven speed compound control of high-speed train[J], Journal of Transportation Systems Engineering and Information Technology, 23, 3, (2023)
  • [6] LI Bo, BAI Shuangxia, MENG Bobo, Et al., Autonomous Air Combat Decision-making Algorithm of UAVs Based on SAC algorithm[J], Command Control & Simulation, 44, 5, (2022)
  • [7] PENG Ziyu, WANG Gaocai, NONG Wang, SAC based algorithm for task offloading and resource provisioning in multiple-services mobile edge computing[J], Application Research of Computers, 40, 5, pp. 1497-1503, (2023)
  • [8] NING Qiang, LIU Yuansheng, XIE Longyang, Application of SAC-based autonomous vehicle control method[J], Computer Engineering and Applications, 59, 8, (2023)
  • [9] HUANG Ruchen, HE Hongwen, Naturalistic data-driven and emission reduction-conscious energy management for hybrid electric vehicle based on improved soft actor-critic algorithm, Journal of Power Sources, 559, (2023)
  • [10] HUNOR TOTH S, JANOS VIHAROS Z, BARDOS A., Autonomous vehicle drift with a soft actor-critic reinforcement learning agent[C], 2022 IEEE 20th Jubilee World Symposium on Applied Machine Intelligence and Informatics (SAMI), (2022)