An Efficient Explainable Convolutional Network with Visualization of Feature Maps for Enhanced Understanding of Building Facade Defects

被引:2
作者
Shin, Hyunkyu [1 ]
Lee, Sanghyo [2 ]
机构
[1] Mokwon Univ, Div Architecture, Daejeon 35349, South Korea
[2] Hanyang Univ, Div Smart Convergence Engn, Educ Res Ind Cluster Ansan, Ansan 426791, South Korea
基金
新加坡国家研究基金会;
关键词
Defect recognition; Visualization; Attention network; Selective layers; Deep learning; CONCRETE CRACK DETECTION; DAMAGE DETECTION; NEURAL-NETWORKS; INSPECTION; CLASSIFICATION;
D O I
10.1061/JCCEE5.CPENG-5857
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Over the past decade, extensive research has been conducted on employing deep learning techniques to detect visual defects in structural facades during inspection. Although these models have shown accuracy in identifying defects from visual data, they encounter limitations in practical applications. This includes uncertainty with data that fall outside the trained distribution and their lack of explanation of detection results. In addition, owing to their extensive parameters, these models require substantial computational resources, which is impractical for visual inspection. These limitations impede immediate defect checking and misjudgment of the deep learning model. The study aims to address these challenges by optimizing a deep-learning-based defect recognition model using a selective layer attention network (SAN). This utilizes a selective feature extraction method to provide essential visual defect information through feature maps within a deep learning model. SAN can effectively represent defect information from building surface images across each layer using the gradient-weighted class activation-mapping visualization technique. These findings demonstrate that the SAN-based model offers clear visual information while significantly reducing the usage of computational resources by 90% compared with the original network, maintaining an equivalent performance level.
引用
收藏
页数:12
相关论文
共 53 条
[1]   Robust Pixel-Level Crack Detection Using Deep Fully Convolutional Neural Networks [J].
Alipour, Mohamad ;
Harris, Devin K. ;
Miller, Gregory R. .
JOURNAL OF COMPUTING IN CIVIL ENGINEERING, 2019, 33 (06)
[2]   A deep-learning-based computer vision solution for construction vehicle detection [J].
Arabi, Saeed ;
Haghighat, Arya ;
Sharma, Anuj .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (07) :753-767
[3]   Evaluation of deep learning approaches based on convolutional neural networks for corrosion detection [J].
Atha, Deegan J. ;
Jahanshahi, Mohammad R. .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2018, 17 (05) :1110-1128
[4]   Encoder-decoder network for pixel-level road crack detection in black-box images [J].
Bang, Seongdeok ;
Park, Somin ;
Kim, Hongjo ;
Kim, Hyoungkwan .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2019, 34 (08) :713-727
[5]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[6]   Autonomous Structural Visual Inspection Using Region-Based Deep Learning for Detecting Multiple Damage Types [J].
Cha, Young-Jin ;
Choi, Wooram ;
Suh, Gahyun ;
Mahmoudkhani, Sadegh ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2018, 33 (09) :731-747
[7]   Attention to Scale: Scale-aware Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Yang, Yi ;
Wang, Jiang ;
Xu, Wei ;
Yuille, Alan L. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3640-3649
[8]  
Chen TY, 2022, Arxiv, DOI arXiv:2201.10523
[9]   Automatic delamination segmentation for bridge deck based on encoder-decoder deep learning through UAV-based thermography [J].
Cheng, Chongsheng ;
Shang, Zhexiong ;
Shen, Zhigang .
NDT & E INTERNATIONAL, 2020, 116
[10]   Automated defect inspection of concrete structures [J].
Chow, Jun Kang ;
Liu, Kuan-fu ;
Tan, Pin Siang ;
Su, Zhaoyu ;
Wu, Jimmy ;
Li, Zhaofeng ;
Wang, Yu-Hsing .
AUTOMATION IN CONSTRUCTION, 2021, 132