Crack segmentation through deep convolutional neural networks and heterogeneous image fusion

被引:37
作者
Zhou, Shanglian [1 ]
Song, Wei [1 ]
机构
[1] Univ Alabama, Dept Civil Construct & Environm Engn, Tuscaloosa, AL 35487 USA
关键词
Concrete roadway; Encoder-decoder network; Heterogeneous image fusion; Intensity data; Range data; Crack segmentation; LEVEL;
D O I
10.1016/j.autcon.2021.103605
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
A DCNN-based crack segmentation methodology is proposed by leveraging heterogeneous image fusion to alleviate image-related disturbances in intensity or range image data and mitigate uncertainties through crossdomain (i.e., intensity and range data domains) feature correlation. Intensity and range images are captured from concrete roadways and integrated through data fusion. Three encoder-decoder networks representing different patterns on exploiting the image data (i.e., fused raw image, raw range image, filtered range image, and raw intensity image) are proposed and compared to benchmarks. Experimental results demonstrate the proposed DCNN exploiting the fused raw image through an ?extract-fuse? pattern achieves the most robust and accurate performance on crack segmentation among the implemented DCNNs.
引用
收藏
页数:16
相关论文
共 68 条
[1]   Analysis of edge-detection techniques for crack identification in bridges [J].
Abdel-Qader, L ;
Abudayyeh, O ;
Kelly, ME .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2003, 17 (04) :255-263
[2]   Robust Pixel-Level Crack Detection Using Deep Fully Convolutional Neural Networks [J].
Alipour, Mohamad ;
Harris, Devin K. ;
Miller, Gregory R. .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2019, 33 (06)
[3]  
[Anonymous], 2017, arXiv 2017 1704.06857
[4]  
[Anonymous], 2019, The AASHTO Manual for Bridge Element Inspection, V2nd
[5]   Encoder-decoder network for pixel-level road crack detection in black-box images [J].
Bang, Seongdeok ;
Park, Somin ;
Kim, Hongjo ;
Kim, Hyoungkwan .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2019, 34 (08) :713-727
[6]   Deep learning-based automatic volumetric damage quantification using depth camera [J].
Beckman, Gustavo H. ;
Polyzois, Dimos ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2019, 99 :114-124
[7]  
Bengio Yoshua, 2012, Neural Networks: Tricks of the Trade. Second Edition: LNCS 7700, P437, DOI 10.1007/978-3-642-35289-8_26
[8]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[9]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[10]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378