Real-time detection of track fasteners based on object detection and FPGA

被引:3
作者
Xiao, Tian [1 ]
Xu, Tianhua [1 ]
Wang, Guang [2 ]
机构
[1] Beijing Jiaotong Univ, State Key Lab Rail Traff Control & Safety, Beijing, Peoples R China
[2] Florida State Univ, Dept Comp Sci, Tallahassee, FL USA
关键词
Fastener detection; Real-time; Convolutional neural network; YOLOv2 detection network; FPGA; DEFECT DETECTION; ALGORITHM; SYSTEM;
D O I
10.1016/j.micpro.2023.104863
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
An accurate and fast fasteners detection is of great significance for improving the inspection efficiency of railway tracks. However, the task is also challenging due to the limited memory and processing capacity of the embedded maintenance systems. To address these challenges, in this paper, we presents a solution that can be deployed on the high-speed operation vehicles, including You Only Look Once version 2 (YOLOv2) network and Field Programmable Gate Array (FPGA) HW-based acceleration strategy. The algorithm proposed in this paper is implemented completely on FPGA, and the hardware acceleration strategy such as loop pipelining, array partition and ping-pong buffer optimization is applied to get the highest performance. The hardware implementation results show that the improved YOLOv2 detection network and fastener detection system are superior to the existing embedded maintenance system in processing time and hardware resources. The proposed systems can detect a track image in 41 ms, which is much faster than the existing embedded maintenance system.
引用
收藏
页数:10
相关论文
共 37 条
  • [1] Face description with local binary patterns:: Application to face recognition
    Ahonen, Timo
    Hadid, Abdenour
    Pietikainen, Matti
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) : 2037 - 2041
  • [2] Electronic nose system on the Zynq SoC platform
    Ali, Amine Ait Si
    Djelouat, Hamza
    Amira, Abbes
    Bensaali, Faycal
    Benammar, Mohieddine
    Bermak, Amine
    [J]. MICROPROCESSORS AND MICROSYSTEMS, 2017, 53 : 145 - 156
  • [3] [Anonymous], 2005, P IEEE C COMP VIS PA
  • [4] Automatic Defect Detection of Fasteners on the Catenary Support Device Using Deep Convolutional Neural Network
    Chen, Junwen
    Liu, Zhigang
    Wang, Hongrui
    Nunez, Alfredo
    Han, Zhiwei
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2018, 67 (02) : 257 - 269
  • [5] Dong QC, 2018, 2018 13TH WORLD CONGRESS ON INTELLIGENT CONTROL AND AUTOMATION (WCICA), P773, DOI 10.1109/WCICA.2018.8630451
  • [6] The Pascal Visual Object Classes (VOC) Challenge
    Everingham, Mark
    Van Gool, Luc
    Williams, Christopher K. I.
    Winn, John
    Zisserman, Andrew
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2010, 88 (02) : 303 - 338
  • [7] Automatic Fastener Classification and Defect Detection in Vision-Based Railway Inspection Systems
    Feng, Hao
    Jiang, Zhiguo
    Xie, Fengying
    Yang, Ping
    Shi, Jun
    Chen, Long
    [J]. IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2014, 63 (04) : 877 - 888
  • [8] Feng Q., 2007, URBAN MASS TRANSIT, V10, DOI [10.3969/j.issn.1007-869X.2007.03.007, DOI 10.3969/J.ISSN.1007-869X.2007.03.007]
  • [9] Fast R-CNN
    Girshick, Ross
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1440 - 1448
  • [10] He KM, 2020, IEEE T PATTERN ANAL, V42, P386, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]