MFAFNet: An innovative crack intelligent segmentation method based on multi-layer feature association fusion network

被引:17
作者
Dong, Jiaxiu [1 ,2 ,3 ,4 ]
Wang, Niannian [1 ,2 ,3 ,4 ]
Fang, Hongyuan [1 ,2 ,3 ,4 ]
Guo, Wentong [5 ,6 ]
Li, Bin [1 ,2 ,3 ,4 ]
Zhai, Kejie [1 ,2 ,3 ,4 ]
机构
[1] Zhengzhou Univ, Sch Water Conservancy & Transportat, Zhengzhou 450001, Peoples R China
[2] Zhengzhou Univ, Yellow River Lab, Zhengzhou 450001, Henan, Peoples R China
[3] Natl Local Joint Engn Lab Major Infrastruct Testin, Zhengzhou 450001, Peoples R China
[4] Collaborat Innovat Ctr Water Conservancy & Transpo, Zhengzhou 450001, Henan, Peoples R China
[5] Zhejiang Univ, Polytech Inst, Hangzhou 310058, Henan, Peoples R China
[6] Zhejiang Univ, Inst Intelligent Transportat Syst, Hangzhou 310058, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
Asphalt pavement; Crack segmentation; MFAFNet; Segmentation performance;
D O I
10.1016/j.aei.2024.102584
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The regular and timely detection and segmentation of cracks in asphalt pavements is very important for road evaluation. However, certain problems remain to be solved, such as the difficulty of crack detection under interference from zebra stripes and dark light. A novel intelligent crack segmentation method based on a multilayer feature association fusion network (MFAFNet) is therefore proposed in this study. Firstly, a fusion convolution with a Transformer called a feature coupling encoder (FC-Encoder) is developed in MFAFNet to enhance the model ' s global feature awareness and ability to capture local details. Secondly, a two-branch feature association module (TFBA-module) is proposed to obtain strong correlation information for global and local features. Next, a hybrid MLP architecture for lightweight feature decoder (H-MLP Decoder) is constructed to achieve feature recombination of the multi-level fusion information. The accuracy of crack segmentation under interference from zebra stripes and dark light is improved through the use of these three modules. Our model is compared with some well-known existing segmentation networks such as U-Net, DeepLabv3 +, PSPNet, HRNet and SegFormer, and the segmentation accuracy, F1-score and IoU of the proposed MFAFNet are found to be 94.39 %, 93.26 % and 89.46 %, respectively. In addition, the segmentation efficiency reaches 21.87FPS. Our experimental results show that the proposed MFAFNet yields more effective performance in the field of asphalt pavement crack segmentation than the alternatives.
引用
收藏
页数:17
相关论文
共 55 条
[1]   Machine learning model for predicting the crack detection and pattern recognition of geopolymer concrete beams [J].
Aravind, N. ;
Nagajothi, S. ;
Elavenil, S. .
CONSTRUCTION AND BUILDING MATERIALS, 2021, 297
[2]  
Ba J.L., 2016, arXiv preprint arXiv:1607.06450, DOI DOI 10.48550/ARXIV.1607.06450
[3]   Estimation of the degree of hydration of concrete through automated machine learning based microstructure analysis - A study on effect of image magnification [J].
Bangaru, Srikanth Sagar ;
Wang, Chao ;
Hassan, Marwa ;
Jeon, Hyun Woo ;
Ayiluri, Tarun .
ADVANCED ENGINEERING INFORMATICS, 2019, 42
[4]  
Budak M., 2016, INT ART INT DAT PROC
[5]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[6]   Multi-modal fusion of satellite and street-view images for urban village classification based on a dual-branch deep neural network [J].
Chen, Boan ;
Feng, Quanlong ;
Niu, Bowen ;
Yan, Fengqin ;
Gao, Bingbo ;
Yang, Jianyu ;
Gong, Jianhua ;
Liu, Jiantao .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 109
[7]   CrackEmbed: Point feature embedding for crack segmentation from disaster site point clouds with anomaly detection [J].
Chen, Jingdao ;
Cho, Yong Kwon .
ADVANCED ENGINEERING INFORMATICS, 2022, 52
[8]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[9]   Pavement crack detection using hessian structure propagation [J].
Chen, Qi ;
Huang, Yuchun ;
Sun, Hui ;
Huang, Weihong .
ADVANCED ENGINEERING INFORMATICS, 2021, 49
[10]   SDDNet: Real-Time Crack Segmentation [J].
Choi, Wooram ;
Cha, Young-Jin .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (09) :8016-8025