Defect Detection in Freight Trains Using a Lightweight and Effective Multi-Scale Fusion Framework with Knowledge Distillation

被引:0
作者
Ma, Ziqin [1 ]
Zhou, Shijie [2 ]
Lin, Chunyu [2 ]
机构
[1] China Energy Railway Equipment Co Ltd, Beijing 100011, Peoples R China
[2] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
来源
ELECTRONICS | 2025年 / 14卷 / 05期
关键词
train defect detection; knowledge distillation; feature fusion;
D O I
10.3390/electronics14050925
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The safe operation of freight train equipment is crucial to the stability of the transportation system. With the advancement of intelligent monitoring technology, vision-based anomaly detection methods have gradually become an essential approach to train equipment condition monitoring. However, due to the complexity of train equipment inspection scenarios, existing methods still face significant challenges in terms of accuracy and generalization capability. Freight trains defect detection models are deployed on edge computing devices, onboard terminals, and fixed monitoring stations. Therefore, to ensure the efficiency and lightweight nature of detection models in industrial applications, we have improved the YOLOv8 model structure and proposed a network architecture better suited for train equipment anomaly detection. We adopted the lightweight MobileNetV4 as the backbone to enhance computational efficiency and adaptability. By comparing it with other state-of-the-art lightweight networks, we verified the superiority of our approach in train equipment defect detection tasks. To enhance the model's ability to detect objects of different sizes, we introduced the Content-Guided Attention Fusion (CGAFusion) module, which effectively strengthens the perception of both global context and local details by integrating multi-scale features. Furthermore, to improve model performance while meeting the lightweight requirements of industrial applications, we incorporated a staged knowledge distillation strategy on large-scale datasets. This approach significantly reduces model parameters and computational costs while maintaining high detection accuracy. Extensive experiments demonstrate the effectiveness and efficiency of our method, proving its competitiveness compared with other state-of-the-art approaches.
引用
收藏
页数:14
相关论文
共 45 条
[1]  
Aung K.H.H., Kok C.L., Koh Y.Y., Teo T.H., An Embedded Machine Learning Fault Detection System for Electric Fan Drive, Electronics, 13, (2024)
[2]  
Gan J., Li Q., Wang J., Yu H., A hierarchical extractor-based visual rail surface inspection system, IEEE Sens. J, 17, pp. 7935-7944, (2017)
[3]  
Hoshi T., Baba Y., Gavai G., Railway Anomaly detection model using synthetic defect images generated by CycleGAN, arXiv, (2021)
[4]  
Han Y., Liu Z., Lyu Y., Liu K., Li C., Zhang W., Deep learning-based visual ensemble method for high-speed railway catenary clevis fracture detection, Neurocomputing, 396, pp. 556-568, (2020)
[5]  
Das S., Kong X., Lavrenz S.M., Wu L., Jalayer M., Fatal crashes at highway rail grade crossings: A US based study, Int. J. Transp. Sci. Technol, 11, pp. 107-117, (2022)
[6]  
Pahwa R.S., Chao J., Paul J., Li Y., Nwe M.T.L., Xie S., James A., Ambikapathi A., Zeng Z., Chandrasekhar V.R., Faultnet: Faulty rail-valves detection using deep learning and computer vision, Proceedings of the 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pp. 559-566
[7]  
Qin D., Leichner C., Delakis M., Fornoni M., Luo S., Yang F., Wang W., Banbury C., Ye C., Akin B., Et al., MobileNetV4: Universal Models for the Mobile Ecosystem, Computer Vision—ECCV 2024, Proceedings of the European Conference on Computer Vision, Milan, Italy, 29 September–4 October 2024, pp. 78-96, (2025)
[8]  
Chen Z., He Z., Lu Z.M., DEA-Net: Single image dehazing based on detail-enhanced convolution and content-guided attention, IEEE Trans. Image Process, 33, pp. 1002-1015, (2024)
[9]  
Lin T.Y., Maire M., Belongie S., Hays J., Perona P., Ramanan D., Dollar P., Zitnick C.L., Microsoft coco: Common objects in context, Proceedings of the Computer Vision—ECCV 2014: 13th European Conference, pp. 740-755, (2014)
[10]  
Mital A., Govindaraju M., Subramani B., A comparison between manual and hybrid methods in parts inspection, Integr. Manuf. Syst, 9, pp. 344-349, (1998)