DeepCrack: A deep hierarchical feature learning architecture for crack segmentation

被引:660
作者
Liu, Yahui [1 ]
Yao, Jian [1 ]
Lu, Xiaohu [1 ]
Xie, Renping [1 ]
Li, Li [1 ]
机构
[1] Wuhan Univ, Comp Vis & Remote Sensing CVRS Lab, Sch Remote Sensing & Informat Engn, Wuhan, Hubei, Peoples R China
基金
中国国家自然科学基金;
关键词
Convolutional neural network; Crack detection; Semantic segmentation; Hierarchical convolutional features; Guided filtering; Crack detection dataset;
D O I
10.1016/j.neucom.2019.01.036
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatic crack detection from images of various scenes is a useful and challenging task in practice. In this paper, we propose a deep hierarchical convolutional neural network (CNN), called as DeepCrack, to predict pixel-wise crack segmentation in an end-to-end method. DeepCrack consists of the extended Fully Convolutional Networks (FCN) and the Deeply-Supervised Nets (DSN). During the training, the elaborately designed model learns and aggregates multi-scale and multi-level features from the low convolutional layers to the high-level convolutional layers, which is different from the standard approaches of only using the last convolutional layer. DSN provides integrated direct supervision for features of each convolutional stage. We apply both guided filtering and Conditional Random Fields (CRFs) methods to refine the final prediction results. A benchmark dataset consisting of 537 images with manual annotation maps are built to verify the effectiveness of our proposed method. Our method achieved state-of-the-art performances on the proposed dataset (mean I/U of 85.9, best F-score of 86.5, and 0.1 s per image). (c) 2019 Elsevier B.V. All rights reserved.
引用
收藏
页码:139 / 153
页数:15
相关论文
共 48 条
[21]   Caffe: Convolutional Architecture for Fast Feature Embedding [J].
Jia, Yangqing ;
Shelhamer, Evan ;
Donahue, Jeff ;
Karayev, Sergey ;
Long, Jonathan ;
Girshick, Ross ;
Guadarrama, Sergio ;
Darrell, Trevor .
PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, :675-678
[22]   HyperNet: Towards Accurate Region Proposal Generation and Joint Object Detection [J].
Kong, Tao ;
Yao, Anbang ;
Chen, Yurong ;
Sun, Fuchun .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :845-853
[23]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[24]  
Lee CY, 2015, JMLR WORKSH CONF PRO, V38, P562
[25]   Novel approach to pavement image segmentation based on neighboring difference histogram method [J].
Li Qingquan ;
Liu Xianglong .
CISP 2008: FIRST INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING, VOL 2, PROCEEDINGS, 2008, :792-796
[26]   FoSA: F* Seed-growing Approach for crack-line detection from pavement images [J].
Li, Qingquan ;
Zou, Qin ;
Zhang, Daqiang ;
Mao, Qingzhou .
IMAGE AND VISION COMPUTING, 2011, 29 (12) :861-872
[27]   Efficient Piecewise Training of Deep Structured Models for Semantic Segmentation [J].
Lin, Guosheng ;
Shen, Chunhua ;
van den Hengel, Anton ;
Reid, Ian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3194-3203
[28]  
Liu W., 2016, INT C LEARN REPR ICL
[29]  
Long J, 2015, PROC CVPR IEEE, P3431, DOI 10.1109/CVPR.2015.7298965
[30]  
Nair V., 2010, P 27 INT C MACH LEAR, P807