PAF-Net: A Progressive and Adaptive Fusion Network for Pavement Crack Segmentation

被引:27
作者
Yang, Lei [1 ]
Huang, Hanyun [1 ]
Kong, Shuyi [1 ]
Liu, Yanhong [1 ]
Yu, Hongnian [1 ,2 ]
机构
[1] Zhengzhou Univ, Sch Elect & Informat Engn, Zhengzhou 450001, Henan, Peoples R China
[2] Edinburgh Napier Univ, Sch Comp Engn & Built Environm, Edinburgh EH10 5DT, Scotland
基金
中国国家自然科学基金;
关键词
Pavement crack segmentation; progressive fusion; adaptive feature fusion multi-scale input strategy; deep supervision;
D O I
10.1109/TITS.2023.3287533
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Automatic crack detection remains challenging due to factors such as irregular crack shapes and sizes, uneven illumination, complex backgrounds, and image noise. Deep learning has shown promise in computer vision for pixel-wise crack detection, but existing methods still suffer from limitations such as information loss, insufficient feature fusion, and semantic gap issues. To address these challenges, a novel pavement crack segmentation network, called PAF-Net, is proposed, which incorporates progressive and adaptive feature fusion. To mitigate information loss caused by feature downsampling, a progressive context fusion (PCF) block is introduced to capture context information from adjacent scales. To better capture strong features from local regions, a dual attention (DA) block is proposed that leverages both global and local context information, reducing the semantic gap issue. Furthermore, to achieve effective multi-scale feature fusion, a dynamic weight learning (DWL) block is proposed that enables efficient fusion of feature maps from different network layers. Additionally, a multi-scale input unit is incorporated to provide the proposed segmentation network with more contextual information. To evaluate the performance of PAF-Net, we conduct experiments using four common evaluation metrics and compare it with multiple mainstream segmentation models on three public datasets. The proposed PAF-Net demonstrates superior segmentation accuracy for pixel-level crack detection compared to other segmentation models, as evident from qualitative and quantitative experimental results.
引用
收藏
页码:12686 / 12700
页数:15
相关论文
共 63 条
[1]   Attention-based generative adversarial network with internal damage segmentation using thermography [J].
Ali, Rahmat ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2022, 141
[2]   Structural crack detection using deep convolutional neural networks [J].
Ali, Raza ;
Chuah, Joon Huang ;
Abu Talip, Mohamad Sofian ;
Mokhtar, Norrima ;
Shoaib, Muhammad Ali .
AUTOMATION IN CONSTRUCTION, 2022, 133
[3]   Automatic Crack Detection on Two-Dimensional Pavement Images: An Algorithm Based on Minimal Path Selection [J].
Amhaz, Rabih ;
Chambon, Sylvie ;
Idier, Jerome ;
Baltazart, Vincent .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2016, 17 (10) :2718-2729
[4]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[5]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[6]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[7]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[8]   Air Writing via Receiver Array-Based Ultrasonic Source Localization [J].
Chen, Hui ;
Ballal, Tarig ;
Muqaibel, Ali Hussein ;
Zhang, Xiangliang ;
Al-Naffouri, Tareq Y. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2020, 69 (10) :8088-8101
[9]  
Chen Jieneng, 2021, arXiv
[10]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848