DM-RIS: Deep Multimodel Rail Inspection System With Improved MRF-GMM and CNN

被引:69
作者
Jin, Xiating [1 ]
Wang, Yaonan [1 ]
Zhang, Hui [2 ,3 ]
Zhong, Hang [1 ]
Liu, Li [1 ]
Wu, Q. M. Jonathan [4 ]
Yang, Yimin [5 ]
机构
[1] Hunan Univ, Coll Elect & Informat Engn, Changsha 410082, Hunan, Peoples R China
[2] Changsha Univ Sci & Technol, Coll Elect & Informat Engn, Changsha 410012, Peoples R China
[3] Univ Windsor, Dept Elect & Comp Engn, CVSS Lab, Windsor, ON N9B 3P4, Canada
[4] Univ Windsor, Dept Elect & Comp Engn, Windsor, ON N9B 3P4, Canada
[5] Lakehead Univ, Dept Comp Sci, Thunder Bay, ON P7B 5E1, Canada
基金
中国国家自然科学基金;
关键词
Faster RCNN; improved Gaussian mixture model (GMM); Markov random field (MRF); rail inspection; surface defect; visual detection; DEFECT DETECTION; MIXTURE MODEL; CLASSIFICATION; SQUATS;
D O I
10.1109/TIM.2019.2909940
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Rail inspection system (RIS) remains an emergent instrumentation for railway transportation, with its capacity of measuring surface defect on steel rail. However, detecting technique and interpretation of RIS constitute a challenging problem since traditional technologies are expensive and prone to errors. In this paper, a deep multimodel RIS (DM-RIS) is established for surface defect where fast and robust spatially constrained Gaussian mixture model is presented for segmentation proposal and Faster RCNN is utilized for objective location in a parallel structure. First, we incorporate spatial information between pixels into an improved Gaussian mixture model based on Markov random field (MRF) for accurate and rapid defect edge segmentation. Specifically, a direct parameter-learning in expectation & x2013;maximization (EM) algorithm is proposed. Meanwhile, to remove nondefect, numerous labeled samples with weak illumination, inequality reflection, external noise, rust, and greasy dirt are fed into Faster RCNN so that DM-RIS is robust environmentally to various light, angle, background, and acquisition equipment. Finally, the joint hit area refers to a real defect. The experimental results demonstrate that the proposed method performs well with 96.74 & x0025; precision, 94.13 & x0025; recall, 95.18 & x0025; overlap, and 0.485 s/frame speed on average, and is robust compared with the related well-established approaches.
引用
收藏
页码:1051 / 1065
页数:15
相关论文
共 55 条
  • [1] [Anonymous], IEEE T INSTRUM MEAS
  • [2] [Anonymous], SEGNET DEEP CONVOLUT
  • [3] [Anonymous], PERMANENT WAY I J RE
  • [4] Attoh-Okine N.O., 2017, Big Data and Differential Privacy: Analysis Strategies for Railway Track Engineering
  • [5] Railway Fastener Inspection by Real-Time Machine Vision
    Aytekin, Caglar
    Rezaeitabar, Yousef
    Dogru, Sedat
    Ulusoy, Ilkay
    [J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2015, 45 (07): : 1101 - 1107
  • [6] BESAG J, 1974, J ROY STAT SOC B MET, V36, P192
  • [7] A spatially constrained mixture model for image segmentation
    Blekas, K
    Likas, A
    Galatsanos, NP
    Lagaris, IE
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2005, 16 (02): : 494 - 498
  • [8] Rail defects: an overview
    Cannon, DF
    Edel, KO
    Grassie, SL
    Sawley, K
    [J]. FATIGUE & FRACTURE OF ENGINEERING MATERIALS & STRUCTURES, 2003, 26 (10) : 865 - 886
  • [9] EM procedures using mean field-like approximations for Markov model-based image segmentation
    Celeux, G
    Forbes, F
    Peyrard, N
    [J]. PATTERN RECOGNITION, 2003, 36 (01) : 131 - 144
  • [10] Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks
    Cha, Young-Jin
    Choi, Wooram
    Buyukozturk, Oral
    [J]. COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) : 361 - 378