Earthquake Crack Detection From Aerial Images Using a Deformable Convolutional Neural Network

被引:26
作者
Yu, Dawen [1 ]
Ji, Shunping [1 ]
Li, Xue [2 ]
Yuan, Zhaode [3 ]
Shen, Chaoyong [4 ]
机构
[1] Wuhan Univ, Sch Remote Sensing & Informat Engn, Wuhan 430079, Peoples R China
[2] China Earthquake Adm, Inst Seismol, Wuhan 430072, Peoples R China
[3] China Earthquake Adm, State Key Lab Earthquake Dynam, Inst Geol, Beijing 100029, Peoples R China
[4] Third Surveying & Mapping Inst Guizhou Prov, Guiyang 550004, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Earthquakes; Surface cracks; Feature extraction; Remote sensing; Pipelines; Image segmentation; Deep learning; Deformable convolutional neural network (CNN); earthquake crack detection; remote sensing images; semantic segmentation; spatial attention;
D O I
10.1109/TGRS.2022.3183157
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Detecting the terrain surface cracks caused by earthquakes, which are termed coseismic ruptures, has important significance for discovering concealed faults, monitoring their movements, and forecasting possible follow-on earthquakes. On May 22, 2021, Maduo County in Qinghai province, China, suffered an earthquake with a magnitude of 7.4, which created densely distributed cracks. In this study, we designed an automatic crack detection framework based on remote sensing technology. With the use of low-altitude unmanned aerial vehicles (UAVs), we obtained very high-resolution aerial images of the area affected by the earthquake, which were further processed by photogrammetric software to produce digital orthophoto maps (DOMs). We then designed a novel terrain surface crack detection neural network, which differs from the previous methods that focus on detecting cracks in man-made object surfaces such as flat roads. We investigated the spatial property of the sinuous linear cracks and handled this by introducing adaptive deformable convolutions with a context-channel-space boosted mechanism. The feature extraction stage, feature optimization stage, and upsampling stage were embedded with the deformable convolutions to form a compact and powerful crack detector, named Crack-CADNet [the Context-chAnnel-space boosted Deformable convolutional neural network (CNN) for crack detection]. The postprocessing included filtering out the nontectonic cracks, aided by annotations from experts, and grouping and vectorizing the generated binary segmentation map as crack polygons, which were evaluated at the instance level. In addition to the first in-depth investigation of detecting earthquake cracks with aerial remote sensing and a deep learning-based process, the crack detection network we propose outperformed the recent CNN-based methods designed for general semantic segmentation and crack detection. Source code and the Maduo earthquake crack dataset will be available at http://gpcv.whu.edu.cn/data/.
引用
收藏
页数:12
相关论文
共 42 条
[1]  
[Anonymous], 2015, Microsoft COCO captions: Data collection and evaluation server
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   Engineering deep learning methods on automatic detection of damage in infrastructure due to extreme events [J].
Bai, Yongsheng ;
Zha, Bing ;
Sezen, Halil ;
Yilmaz, Alper .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2023, 22 (01) :338-352
[4]   Autonomous concrete crack detection using deep fully convolutional neural network [J].
Cao Vu Dung ;
Le Duc Anh .
AUTOMATION IN CONSTRUCTION, 2019, 99 :52-58
[5]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[6]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[7]   Fatigue Crack Detection Using Unmanned Aerial Systems in Fracture Critical Inspection of Steel Bridges [J].
Dorafshan, Sattar ;
Thomas, Robert J. ;
Maguire, Marc .
JOURNAL OF BRIDGE ENGINEERING, 2018, 23 (10)
[8]  
Feng C, 2017, COMPUTING IN CIVIL ENGINEERING 2017: INFORMATION MODELLING AND DATA ANALYTICS, P298
[9]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[10]   CrackW-Net: A Novel Pavement Crack Image Segmentation Convolutional Neural Network [J].
Han, Chengjia ;
Ma, Tao ;
Huyan, Ju ;
Huang, Xiaoming ;
Zhang, Yanning .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :22135-22144