Deep Learning and Machine Vision-Based Inspection of Rail Surface Defects

被引:83
作者
Yang, Hongfei [1 ]
Wang, Yanzhang [1 ]
Hu, Jiyong [2 ]
He, Jiatang [2 ]
Yao, Zongwei [3 ]
Bi, Qiushi [3 ]
机构
[1] Jilin Univ, Coll Instrumentat & Elect Engn, Changchun 130061, Jilin, Peoples R China
[2] FAW Volkswagen Automobile Co Ltd, Changchun 130011, Jilin, Peoples R China
[3] Jilin Univ, Sch Mech & Aerosp Engn, Changchun 130022, Jilin, Peoples R China
基金
中国国家自然科学基金;
关键词
Rails; Image segmentation; Surface morphology; Surface contamination; Image edge detection; Surface cleaning; Feature extraction; CNN; defect detection; entropy penalty factor; GrabCut; railroad surface;
D O I
10.1109/TIM.2021.3138498
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface defects are usually the early phenomenon of rail failure, which threatens the safety of railroad transportation critically, and the timely detection of surface defects helps to eliminate the potential risk of rail and reduce the chance of railroad safety accidents. The existing methods of detecting surface defects on rails suffer from a large performance degradation in the application of rails containing pollutions such as rust and oil. Therefore, this article proposes a multilevel, end-to-end fast rail surface defect detection method. First, rail extraction was performed based on the stability of the standard deviation of the edge pixels. Then, differential box-counting (DBC) and GrabCut algorithm are then combined for defect segmentation to boost the speed and accuracy of extracting complex defects. Finally, YOLO v2 is used to precisely locate and detect defects. The experimental results show that the proposed method performs well, with an average accuracy of 97.11 & x0025;, an average recall of 96.10 & x0025;, and an average frame rate of 0.0064 s. In addition, the proposed method offers a high robustness in the tests of different use cases.
引用
收藏
页数:14
相关论文
共 35 条
[1]  
Anping Xu, 2010, Proceedings 2010 3rd International Conference on Intelligent Networks and Intelligent Systems (ICINIS 2010), P703, DOI 10.1109/ICINIS.2010.181
[2]   Railway Fastener Inspection by Real-Time Machine Vision [J].
Aytekin, Caglar ;
Rezaeitabar, Yousef ;
Dogru, Sedat ;
Ulusoy, Ilkay .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2015, 45 (07) :1101-1107
[3]   ADAPTIVE IMAGE SEGMENTATION USING A GENETIC ALGORITHM [J].
BHANU, B ;
LEE, S ;
MING, J .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1995, 25 (12) :1543-1567
[4]   Graph cuts and efficient N-D image segmentation [J].
Boykov, Yuri ;
Funka-Lea, Gareth .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2006, 70 (02) :109-131
[5]   Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network [J].
Chen, Junwen ;
Liu, Zhigang ;
Wang, Hongrui ;
Nunez, Alfredo ;
Han, Zhiwei .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (02) :257-269
[6]  
Ding Zhen, 1997, Acta Electronica Sinica, V25, P39
[7]  
Faghih-Roohi S, 2016, IEEE IJCNN, P2584, DOI 10.1109/IJCNN.2016.7727522
[8]   Deep Multitask Learning for Railway Track Inspection [J].
Gibert, Xavier ;
Patel, VishalM. ;
Chellappa, Rama .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2017, 18 (01) :153-164
[9]  
Gibert X, 2015, IEEE IMAGE PROC, P621, DOI 10.1109/ICIP.2015.7350873
[10]  
Hackel T, 2015, IEEE IMTC P, P693, DOI 10.1109/I2MTC.2015.7151352