A spatial-temporal neural network based on ResNet-Transformer for predicting railroad broken rails

被引：0

作者：

Wang, Xin ^{[1
]}

Dai, Junyan ^{[1
]}

Liu, Xiang ^{[1
]}

机构：

[1] State Univ New Jersey, Dept Civil & Environm Engn, Piscataway, NJ 08854 USA

来源：

ADVANCED ENGINEERING INFORMATICS | 2025年 / 65卷

关键词：

Broken rail; Freight railroad; Spatial-temporal modeling; ResNet-Transformer; Time-independent data; Time-dependent data; MODEL;

D O I：

10.1016/j.aei.2025.103126

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Broken rails are a primary factor considered in railroad capital planning investments. This paper develops a spatial-temporal neural network model based on ResNet-Transformer architecture to predict the occurrence of broken rails one year in advance. The railroad data for this research includes infrastructure data, operational data, condition-related data, and maintenance activities. First, this research captures detailed spatial correlations and temporal dependencies, ensuring that each aspect is considered for its specific impact on rail integrity. Then, utilizing the ResNet architecture, the proposed model captures spatial correlations among static rail characteristics. Subsequently, the Transformer architecture is utilized for effectively handling long-term temporal data patterns and dependencies that reflect dynamic changes over time. An experiment was conducted based on railroad data collected from one major freight railroad covering about 20,000 miles of track spanning seven years, from 2013 to 2021. AUC values of the proposed model for the training, validation, and test set are 0.84, 0.81, and 0.81, respectively, demonstrating that the model has a relatively good performance and generalizes reasonably well to the validation and test set. The results indicate that the proposed model outperforms traditional machine learning approaches such as XGBoost, especially in identifying high-risk segments. When screening 10% of the highest-risk rail segments, the model can capture 41.6% of broken rails, compared to only 33.1% detected by XGBoost and 38.0% detected by ResNet-only model. This enhanced detection capability highlights the model's effectiveness in utilizing complex pattern recognition across both spatial and temporal data. The proposed spatial-temporal model not only aids in proactive maintenance to improve the safety and reliability of rail transportation but also contributes to more strategic capital planning in the railroad industry.

引用

页数：12

共 45 条

[1]

Ahmad M.W., Akram M.U., Mohsan M.M., Saghar K., Ahmad R., Butt W.H., Transformer-based sensor failure prediction and classification framework for UAVs, Expert Syst. Appl., 248, (2024)

[2]

Bai L., Liu R., Wang F., Sun Q., Wang F., Estimating railway rail service life: A rail-grid-based approach, Transp. Res. A Policy Pract., 105, pp. 54-65, (2017)

[3]

Bogaerts T., Masegosa A.D., Angarita-Zapata J.S., Onieva E., Hellinckx P., A graph CNN-LSTM neural network for short and long-term traffic forecasting based on trajectory data, Transp. Res. Part C Emerging Technol., 112, pp. 62-77, (2020)

[4]

Bridgelall R., Tolliver D.D., Railroad accident analysis using extreme gradient boosting, Accid. Anal. Prev., 156, (2021)

[5]

Chang S., Wang L., Shi M., Zhang J., Yang L., Cui L., Extended attention signal transformer with adaptive class imbalance loss for Long-tailed intelligent fault diagnosis of rotating machinery, Adv. Eng. Inf., 60, (2024)

[6]

Chattopadhyay G., Kumar S., Parameter estimation for rail degradation model, International Journal of Performability Engineering, 5, (2009)

[7]

Chen J., Wang P., Xu J., Chen R., Simulation of vehicle-turnout coupled dynamics considering the flexibility of wheelsets and turnouts, Veh. Syst. Dyn., 61, pp. 739-764, (2023)

[8]

Chen M., Sun Y., Zhai W., High efficient dynamic analysis of vehicle–track–subgrade vertical interaction based on Green function method, Veh. Syst. Dyn., 58, pp. 1076-1100, (2020)

[9]

Chen R., Chen J., Wang P., Fang J., Xu J., Impact of wheel profile evolution on wheel-rail dynamic interaction and surface initiated rolling contact fatigue in turnouts, Wear, 438-439, (2019)

[10]

Chen T., Guestrin C., Xgboost: A scalable tree boosting system, in, Proceedings of the 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, pp. 785-794, (2016)

← 1 2 3 4 5 →