DMA-Net: DeepLab With Multi-Scale Attention for Pavement Crack Segmentation

被引:151
作者
Sun, Xinzi [1 ]
Xie, Yuanchang [2 ]
Jiang, Liming [2 ]
Cao, Yu [1 ]
Liu, Benyuan [1 ]
机构
[1] Univ Massachusetts Lowell, Dept Comp Sci, Lowell, MA 01854 USA
[2] Univ Massachusetts Lowell, Dept Civil & Environm Engn, Lowell, MA 01854 USA
关键词
Image segmentation; Convolution; Semantics; Roads; Decoding; Feature extraction; Computer vision; Pavement crack segmentation; Convolutional Neural Network (CNN); multi-scale attention; CONVOLUTIONAL NETWORKS; DAMAGE;
D O I
10.1109/TITS.2022.3158670
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Cracks are important indicators of pavement structural and operational conditions. Early pavement crack detection and treatments can help extend pavement service life, reduce fuel consumption, and improve safety and ride quality. Pavement distress surveys have traditionally been performed manually by visually inspecting the roads, which is labor-intensive and time-consuming. Therefore, computer-vision-based automated crack detection has great practical significance in pavement maintenance and traffic safety. Traditional image processing techniques are sensitive to noise in images and are thus likely to miss detecting some cracks due to the crack texture variety, complex lighting conditions, and various similar but irrelevant objects on the road. This paper adopts and enhances DeepLabv3+, a popular deep learning framework for semantic image segmentation, for road pavement crack detection. We propose a multi-scale attention module in the decoder of DeepLabv3+ to generate an attention mask and dynamically assign weights between high-level and low-level feature maps. Compared with fixed weights across different features, the dynamic weights strategy can assign more reasonable weights to different feature maps. Ablation experiments show that the attention mask can effectively help the model better combine multi-scale features and generate more accurate pavement crack segmentation results. The proposed method achieves state-of-the-art results on three benchmarks, including Crack500, DeepCrack, and FMA (Fitchburg Municipal Airport) datasets. We further test it on pavement crack images captured by smartphones, and the results show that it provides a viable approach to road pavement crack segmentation in practice with excellent performance.
引用
收藏
页码:18392 / 18403
页数:12
相关论文
共 47 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[3]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[4]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[5]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[6]  
Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709
[7]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[8]  
Escalona U, 2019, COMPUT SIST, V23, P451, DOI [10.13053/CyS-23-2-3047, 10.13053/cys-23-2-3047]
[9]  
Fan Z., 2018, Automatic pavement crack detection based on structured prediction with the convolutional neural network'
[10]   Automatic Crack Detection on Road Pavements Using Encoder-Decoder Architecture [J].
Fan, Zhun ;
Li, Chong ;
Chen, Ying ;
Wei, Jiahong ;
Loprencipe, Giuseppe ;
Chen, Xiaopeng ;
Di Mascio, Paola .
MATERIALS, 2020, 13 (13) :1-18