Selective Feature Fusion and Irregular-Aware Network for Pavement Crack Detection

被引:12
作者
Cheng, Xu [1 ]
He, Tian [1 ]
Shi, Fan [1 ]
Zhao, Meng [1 ]
Liu, Xiufeng [2 ]
Chen, Shengyong [1 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
[2] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Kongens Lyngby, Denmark
基金
中国国家自然科学基金;
关键词
Deep learning; irregular-aware; pavement crack detection; selective feature fusion; ARCHITECTURE; SYSTEM;
D O I
10.1109/TITS.2023.3325989
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Road cracks on highways and main roads are among the most prominent defects. Given the inherent inaccuracy, time-consuming nature, and labor intensiveness of manual road crack detection, there's a compelling need for automated solutions. The irregular shape of cracks, along with complex background conditions encompassing varying lighting, tree shadows, and dark stains, poses a significant challenge for computer vision-based approaches. Most cracks exhibit irregular edge patterns, which are pivotal features for accurate detection. In response to recent advancements in deep learning within the realm of computer vision, this paper introduces an innovative neural network architecture termed the 'Selective Feature Fusion and Irregular-Aware Network (SFIAN)' designed specifically for crack detection on pavements. The proposed network selectively integrates features from multiple levels, enhancing and controlling the flow of valuable information at each stage while effectively modeling irregular crack objects. In an extensive evaluation, this paper conducts experiments on five distinct crack datasets and compares the results with twelve state-of-the-art crack detection methods, including the latest edge detection and semantic segmentation techniques. The experimental findings demonstrate the superior performance of the proposed method, surpassing baseline methods by a notable margin, with an increase of approximately 13.3% in the F1-score, all without introducing additional time complexity. Furthermore, the model achieves real-time processing, achieving a remarkable speed of 35 frames per second (FPS) on images at 320 x 480 pixels, facilitated by NVIDIA 3090 hardware.
引用
收藏
页码:3445 / 3456
页数:12
相关论文
共 52 条
[1]   Analysis of edge-detection techniques for crack identification in bridges [J].
Abdel-Qader, L ;
Abudayyeh, O ;
Kelly, ME .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2003, 17 (04) :255-263
[2]   Video Foreground Extraction Using Multi-View Receptive Field and EncoderDecoder DCNN for Traffic and Surveillance Applications [J].
Akilan, Thangarajah ;
Wu, Q. M. Jonathan ;
Zhang, Wandong .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (10) :9478-9493
[3]   Real-time multiple damage mapping using autonomous UAV and deep faster region-based neural networks for GPS-denied structures [J].
Ali, Rahmat ;
Kang, Dongho ;
Suh, Gahyun ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2021, 130
[4]   Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path Selection [J].
Amhaz, Rabih ;
Chambon, Sylvie ;
Idier, Jerome ;
Baltazart, Vincent .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2016, 17 (10) :2718-2729
[5]  
Amhaz R, 2014, IEEE IMAGE PROC, P788, DOI 10.1109/ICIP.2014.7025158
[6]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[7]   Deep learning-based automatic volumetric damage quantification using depth camera [J].
Beckman, Gustavo H. ;
Polyzois, Dimos ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2019, 99 :114-124
[8]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[9]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[10]  
Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709