Real-Time Ground-Level Building Damage Detection Based on Lightweight and Accurate YOLOv5 Using Terrestrial Images

被引:30
作者
Liu, Chaoxian [1 ]
Sui, Haigang [1 ]
Wang, Jianxun [1 ]
Ni, Zixuan [1 ]
Ge, Liang [2 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Tianjin Inst Surveying & Mapping Co Ltd, 9 Changling Rd, Tianjin 300381, Peoples R China
基金
中国国家自然科学基金;
关键词
building damage; terrestrial image; ghost bottleneck; CBAM; Bi-FPN; YOLOv5; EARTHQUAKE; CHANNEL; CNN;
D O I
10.3390/rs14122763
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Real-time building damage detection effectively improves the timeliness of post-earthquake assessments. In recent years, terrestrial images from smartphones or cameras have become a rich source of disaster information that may be useful in assessing building damage at a lower cost. In this study, we present an efficient method of building damage detection based on terrestrial images in combination with an improved YOLOv5. We compiled a Ground-level Detection in Building Damage Assessment (GDBDA) dataset consisting of terrestrial images with annotations of damage types, including debris, collapse, spalling, and cracks. A lightweight and accurate YOLOv5 (LA-YOLOv5) model was used to optimize the detection efficiency and accuracy. In particular, a lightweight Ghost bottleneck was added to the backbone and neck modules of the YOLOv5 model, with the aim to reduce the model size. A Convolutional Block Attention Module (CBAM) was added to the backbone module to enhance the damage recognition effect. In addition, regarding the scale difference of building damage, the Bi-Directional Feature Pyramid Network (Bi-FPN) for multi-scale feature fusion was used in the neck module to aggregate features with different damage types. Moreover, depthwise separable convolution (DSCONV) was used in the neck module to further compress the parameters. Based on our GDBDA dataset, the proposed method not only achieved detection accuracy above 90% for different damage targets, but also had the smallest weight size and fastest detection speed, which improved by about 64% and 24%, respectively. The model performed well on datasets from different regions. The overall results indicate that the proposed model realizes rapid and accurate damage detection, and meets the requirement of lightweight embedding in the future.
引用
收藏
页数:21
相关论文
共 48 条
[1]   High Resolution Imagery Collection for Post-Disaster Studies Utilizing Unmanned Aircraft Systems (UAS) [J].
Adams, Stuart M. ;
Levitan, Marc L. ;
Friedland, Carol J. .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2014, 80 (12) :1161-1168
[2]   Multi-Source Data Fusion Based on Ensemble Learning for Rapid Building Damage Mapping during the 2018 Sulawesi Earthquake and Tsunami in Palu, Indonesia [J].
Adriano, Bruno ;
Xia, Junshi ;
Baier, Gerald ;
Yokoya, Naoto ;
Koshimura, Shunichi .
REMOTE SENSING, 2019, 11 (07)
[3]  
Bochkovskiy A., 2020, PREPRINT
[4]   Earthquake-Induced Building Damage Mapping Based on Multi-Task Deep Learning Framework [J].
Chen, Fang ;
Yu, Bo .
IEEE ACCESS, 2019, 7 :181396-181404
[5]   Deep learning for post-hurricane aerial damage assessment of buildings [J].
Cheng, Chih-Shen ;
Behzadan, Amir H. ;
Noshadravan, Arash .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2021, 36 (06) :695-710
[6]   A comprehensive review of earthquake-induced building damage detection with remote sensing techniques [J].
Dong, Laigen ;
Shan, Jie .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2013, 84 :85-99
[7]   Using Remote Sensing for Building Damage Assessment: GEOCAN Study and Validation for 2011 Christchurch Earthquake [J].
Foulser-Piggott, Roxane ;
Spence, Robin ;
Eguchi, Ron ;
King, Andrew .
EARTHQUAKE SPECTRA, 2016, 32 (01) :611-631
[8]   Efficient lightweight video person re-identification with online difference discrimination module [J].
Gao, Cunyuan ;
Yao, Rui ;
Zhou, Yong ;
Zhao, Jiaqi ;
Fang, Liang ;
Hu, Fuyuan .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (14) :19169-19181
[9]   A review on synthetic aperture radar-based building damage assessment in disasters [J].
Ge, Pinglan ;
Gokon, Hideomi ;
Meguro, Kimiro .
REMOTE SENSING OF ENVIRONMENT, 2020, 240
[10]   A Light-Weight CNN for Object Detection with Sparse Model and Knowledge Distillation [J].
Guo, Jing-Ming ;
Yang, Jr-Sheng ;
Seshathiri, Sankarasrinivasan ;
Wu, Hung-Wei .
ELECTRONICS, 2022, 11 (04)