Three-dimensional reconstruction and damage localization of bridge undersides based on close-range photography using UAV

被引:4
作者
Jiang, Shang [1 ,2 ]
Zhang, Yufeng [3 ,4 ]
Wang, Feiyu [2 ]
Xu, Yichao [3 ,4 ]
机构
[1] Nantong Univ, Sch Transportat & Civil Engn, Nantong, Peoples R China
[2] Southeast Univ, Sch Civil Engn, Nanjing, Peoples R China
[3] Jiangsu Transportat Inst Grp, Nanjing, Peoples R China
[4] Natl Key Lab Safety Durabil & Hlth Operat Long Spa, Nanjing, Peoples R China
关键词
bridge inspection; damage detection; aerial photography; 3D reconstruction; deep learning;
D O I
10.1088/1361-6501/ad90fb
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Damage inspection on the undersides of bridges is an important and challenging part of routine bridge inspections. A method for 3D reconstruction and damage localization of bridge undersides based on close-range photography by unmanned aerial vehicle (UAV) and stereo vision combined with deep learning algorithms is proposed, the specific contributions include: (1) proposing a close-range photography method for acquiring high-resolution images from multiple perspectives of the bridge underside by UAVs, serving as the data source for damage analysis; (2) applying a deep learning-assisted segmentation method to optimize the multi-view geometry-based 3D reconstruction method, improving the efficiency of three-dimensional reconstruction, and defining the projection direction from the 3D reconstruction results to obtain ultra-high-resolution panoramic images of the bridge underside; (3) addressing the issue of detecting minor damages in large panoramic images by using a slice-assisted reasoning module and a lightweight convolutional YOLO v8 network to identify exposed steel bars corroded due to concrete damage in the panoramic images, and defining a coordinate system to localize the damages on the bridge underside. The proposed method was applied to damage detection and localization on the underside of a 160 m span main span of an in-service concrete bridge. The results demonstrate that the proposed method can quickly and accurately identify exposed steel bar corrosion on the bridge underside and output reports, proving the practicality of the proposed method.
引用
收藏
页数:18
相关论文
共 37 条
[1]   A State-of-the-Art Review of Bridge Inspection Planning: Current Situation and Future Needs [J].
Abdallah, Abdelrahman M. ;
Atadero, Rebecca A. ;
Ozbek, Mehmet E. .
JOURNAL OF BRIDGE ENGINEERING, 2022, 27 (02)
[2]   SLICING AIDED HYPER INFERENCE AND FINE-TUNING FOR SMALL OBJECT DETECTION [J].
Akyon, Fatih Cagatay ;
Altinuc, Sinan Onur ;
Temizel, Alptekin .
2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, :966-970
[3]   Tunnel inspection using photogrammetric techniques and image processing: A review [J].
Attard, Leanne ;
Debono, Carl James ;
Valentino, Gianluca ;
Di Castro, Mario .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 144 :180-188
[4]  
Deng-Ping Fan, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12266), P263, DOI 10.1007/978-3-030-59725-2_26
[5]  
He KM, 2020, IEEE T PATTERN ANAL, V42, P386, DOI [10.1109/TPAMI.2018.2844175, 10.1109/ICCV.2017.322]
[6]   A Review of Yolo Algorithm Developments [J].
Jiang, Peiyuan ;
Ergu, Daji ;
Liu, Fangyao ;
Cai, Ying ;
Ma, Bo .
8TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND QUANTITATIVE MANAGEMENT (ITQM 2020 & 2021): DEVELOPING GLOBAL DIGITAL ECONOMY AFTER COVID-19, 2022, 199 :1066-1073
[7]   Bridge coating inspection based on two-stage automatic method and collision-tolerant unmanned aerial system [J].
Jiang, Shang ;
Wu, Yanqi ;
Zhang, Jian .
AUTOMATION IN CONSTRUCTION, 2022, 146
[8]   Pavement crack measurement based on aerial 3D reconstruction and learning-based segmentation method [J].
Jiang, Shang ;
Gu, Siyang ;
Yan, Zhiyu .
MEASUREMENT SCIENCE AND TECHNOLOGY, 2023, 34 (01)
[9]   Vision-guided unmanned aerial system for rapid multiple-type damage detection and localization [J].
Jiang, Shang ;
Cheng, Yuyao ;
Zhang, Jian .
STRUCTURAL HEALTH MONITORING-AN INTERNATIONAL JOURNAL, 2023, 22 (01) :319-337
[10]   Real-time crack assessment using deep neural networks with wall-climbing unmanned aerial system [J].
Jiang, Shang ;
Zhang, Jian .
COMPUTER-AIDED CIVIL AND INFRASTRUCTURE ENGINEERING, 2020, 35 (06) :549-564