Selective Feature Fusion and Irregular-Aware Network for Pavement Crack Detection

被引:12
作者
Cheng, Xu [1 ]
He, Tian [1 ]
Shi, Fan [1 ]
Zhao, Meng [1 ]
Liu, Xiufeng [2 ]
Chen, Shengyong [1 ]
机构
[1] Tianjin Univ Technol, Sch Comp Sci & Engn, Tianjin 300384, Peoples R China
[2] Tech Univ Denmark, Dept Technol Management & Econ, DK-2800 Kongens Lyngby, Denmark
基金
中国国家自然科学基金;
关键词
Deep learning; irregular-aware; pavement crack detection; selective feature fusion; ARCHITECTURE; SYSTEM;
D O I
10.1109/TITS.2023.3325989
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Road cracks on highways and main roads are among the most prominent defects. Given the inherent inaccuracy, time-consuming nature, and labor intensiveness of manual road crack detection, there's a compelling need for automated solutions. The irregular shape of cracks, along with complex background conditions encompassing varying lighting, tree shadows, and dark stains, poses a significant challenge for computer vision-based approaches. Most cracks exhibit irregular edge patterns, which are pivotal features for accurate detection. In response to recent advancements in deep learning within the realm of computer vision, this paper introduces an innovative neural network architecture termed the 'Selective Feature Fusion and Irregular-Aware Network (SFIAN)' designed specifically for crack detection on pavements. The proposed network selectively integrates features from multiple levels, enhancing and controlling the flow of valuable information at each stage while effectively modeling irregular crack objects. In an extensive evaluation, this paper conducts experiments on five distinct crack datasets and compares the results with twelve state-of-the-art crack detection methods, including the latest edge detection and semantic segmentation techniques. The experimental findings demonstrate the superior performance of the proposed method, surpassing baseline methods by a notable margin, with an increase of approximately 13.3% in the F1-score, all without introducing additional time complexity. Furthermore, the model achieves real-time processing, achieving a remarkable speed of 35 frames per second (FPS) on images at 320 x 480 pixels, facilitated by NVIDIA 3090 hardware.
引用
收藏
页码:3445 / 3456
页数:12
相关论文
共 52 条
[21]   FaPN: Feature-aligned Pyramid Network for Dense Image Prediction [J].
Huang, Shihua ;
Lu, Zhichao ;
Cheng, Ran ;
He, Cheng .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :844-853
[22]  
Jaderberg M, 2015, ADV NEUR IN, V28
[23]   Efficient attention-based deep encoder and decoder for automatic crack segmentation [J].
Kang, Dong H. ;
Cha, Young-Jin .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2022, 21 (05) :2190-2205
[24]   Autonomous UAVs for Structural Health Monitoring Using Deep Learning and an Ultrasonic Beacon System with Geo-Tagging [J].
Kang, Dongho ;
Cha, Young-Jin .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (10) :885-902
[25]   SNAKES - ACTIVE CONTOUR MODELS [J].
KASS, M ;
WITKIN, A ;
TERZOPOULOS, D .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (04) :321-331
[26]   Detecting Curves with Unknown Endpoints and Arbitrary Topology Using Minimal Paths [J].
Kaul, Vivek ;
Yezzi, Anthony ;
Tsai, Yichang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (10) :1952-1965
[27]  
Lee CY, 2015, JMLR WORKSH CONF PRO, V38, P562
[28]  
Li XT, 2020, AAAI CONF ARTIF INTE, V34, P11418
[29]   Feature Pyramid Networks for Object Detection [J].
Lin, Tsung-Yi ;
Dollar, Piotr ;
Girshick, Ross ;
He, Kaiming ;
Hariharan, Bharath ;
Belongie, Serge .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :936-944
[30]   DeepCrack: A deep hierarchical feature learning architecture for crack segmentation [J].
Liu, Yahui ;
Yao, Jian ;
Lu, Xiaohu ;
Xie, Renping ;
Li, Li .
NEUROCOMPUTING, 2019, 338 :139-153