Autonomous health assessment of civil infrastructure using deep learning and smart devices

被引:29
作者
Agyemang, Isaac Osei [1 ]
Zhang, Xiaoling [1 ]
Acheampong, Daniel [2 ]
Adjei-Mensah, Isaac [1 ]
Kusi, Goodlet Akwasi [3 ]
Mawuli, Bernard Cobbinah [3 ]
Agbley, Bless Lord Y. [3 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu 610054, Peoples R China
[2] Florida Gulf Coast Univ, Lutgert Coll, Ft Myers, FL USA
[3] Univ Elect Sci & Technol China, Sch Comp Sci, Chengdu 610054, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Structural health monitoring; Detection; Autonomous; Ensemble learning; Unmanned aerial vehicles; Drones; DAMAGE DETECTION; SYSTEM;
D O I
10.1016/j.autcon.2022.104396
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Damage detection via drones is fundamental in infrastructure health assessment. However, object scale variation due to drones' swift movement and sparse scenes make damage detection challenging. This paper describes a multi-task framework, EnsembleDetNet, for damage detection and multi-label scene classification by leveraging object detectors and classifiers based on ensemble learning which induces diversity and strength-correlation. Further, a novel attention module that significantly improves EnsembleDetNet by about 5% is proposed via explicit ensembling of parallel and sequential channel and spatial attention maps. Extensive experiments with a public dataset and an onsite verification utilizing a micro drone indicate that EsembleDetNet outperforms stateof-the-art detectors and classifiers under variant evaluation metrics. EnsembleDetNet has the potential to become a new paradigm in infrastructure health assessment.
引用
收藏
页数:15
相关论文
共 52 条
[1]  
Agyemang Isaac Osei, 2021, 2021 4th International Conference on Pattern Recognition and Artificial Intelligence (PRAI), P202, DOI 10.1109/PRAI53619.2021.9551102
[2]  
Agyemang I.O., 2022, PERIOD POLYTECH-CIV, P1, DOI [10.3311/PPci.18689, DOI 10.3311/PPCI.18689]
[3]  
Agyemang I.O., 2022, PEER HUB IMAGENET NE
[4]   Real-time multiple damage mapping using autonomous UAV and deep faster region-based neural networks for GPS-denied structures [J].
Ali, Rahmat ;
Kang, Dongho ;
Suh, Gahyun ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2021, 130
[5]   Deep learning-based road damage detection and classification for multiple countries [J].
Arya, Deeksha ;
Maeda, Hiroya ;
Ghosh, Sanjay Kumar ;
Toshniwal, Durga ;
Mraz, Alexander ;
Kashiyama, Takehiro ;
Sekimoto, Yoshihide .
AUTOMATION IN CONSTRUCTION, 2021, 132
[6]   Deep learning-based automatic volumetric damage quantification using depth camera [J].
Beckman, Gustavo H. ;
Polyzois, Dimos ;
Cha, Young-Jin .
AUTOMATION IN CONSTRUCTION, 2019, 99 :114-124
[7]   Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks [J].
Cha, Young-Jin ;
Choi, Wooram ;
Buyukozturk, Oral .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2017, 32 (05) :361-378
[8]   Automatic delamination segmentation for bridge deck based on encoder-decoder deep learning through UAV-based thermography [J].
Cheng, Chongsheng ;
Shang, Zhexiong ;
Shen, Zhigang .
NDT & E INTERNATIONAL, 2020, 116
[9]  
DAdemo N, 2013, QT OPENCV MULTITHREA
[10]   Imaging-based crack detection on concrete surfaces using You Only Look Once network [J].
Deng, Jianghua ;
Lu, Ye ;
Lee, Vincent Cheng-Siong .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2021, 20 (02) :484-499