Deep Learning and Machine Vision-Based Inspection of Rail Surface Defects

被引:83
作者
Yang, Hongfei [1 ]
Wang, Yanzhang [1 ]
Hu, Jiyong [2 ]
He, Jiatang [2 ]
Yao, Zongwei [3 ]
Bi, Qiushi [3 ]
机构
[1] Jilin Univ, Coll Instrumentat & Elect Engn, Changchun 130061, Jilin, Peoples R China
[2] FAW Volkswagen Automobile Co Ltd, Changchun 130011, Jilin, Peoples R China
[3] Jilin Univ, Sch Mech & Aerosp Engn, Changchun 130022, Jilin, Peoples R China
基金
中国国家自然科学基金;
关键词
Rails; Image segmentation; Surface morphology; Surface contamination; Image edge detection; Surface cleaning; Feature extraction; CNN; defect detection; entropy penalty factor; GrabCut; railroad surface;
D O I
10.1109/TIM.2021.3138498
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface defects are usually the early phenomenon of rail failure, which threatens the safety of railroad transportation critically, and the timely detection of surface defects helps to eliminate the potential risk of rail and reduce the chance of railroad safety accidents. The existing methods of detecting surface defects on rails suffer from a large performance degradation in the application of rails containing pollutions such as rust and oil. Therefore, this article proposes a multilevel, end-to-end fast rail surface defect detection method. First, rail extraction was performed based on the stability of the standard deviation of the edge pixels. Then, differential box-counting (DBC) and GrabCut algorithm are then combined for defect segmentation to boost the speed and accuracy of extracting complex defects. Finally, YOLO v2 is used to precisely locate and detect defects. The experimental results show that the proposed method performs well, with an average accuracy of 97.11 & x0025;, an average recall of 96.10 & x0025;, and an average frame rate of 0.0064 s. In addition, the proposed method offers a high robustness in the tests of different use cases.
引用
收藏
页数:14
相关论文
共 35 条
[31]  
Wei KP, 2007, ICNC 2007: THIRD INTERNATIONAL CONFERENCE ON NATURAL COMPUTATION, VOL 5, PROCEEDINGS, P591
[32]   Automatic Visual Detection System of Railway Surface Defects With Curvature Filter and Improved Gaussian Mixture Model [J].
Zhang, Hui ;
Jin, Xiating ;
Wu, Q. M. Jonathan ;
Wang, Yaonan ;
He, Zhendong ;
Yang, Yimin .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (07) :1593-1608
[33]   Pyramid Scene Parsing Network [J].
Zhao, Hengshuang ;
Shi, Jianping ;
Qi, Xiaojuan ;
Wang, Xiaogang ;
Jia, Jiaya .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6230-6239
[34]   A CNN-Based Defect Inspection Method for Catenary Split Pins in High-Speed Railway [J].
Zhong, Junping ;
Liu, Zhigang ;
Han, Zhiwei ;
Han, Ye ;
Zhang, Wenxuan .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2019, 68 (08) :2849-2860
[35]  
Zhou Liangfen, 2013, Journal of Computer Applications, V33, P49, DOI 10.3724/SP.J.1087.2013.00049