Towards accurate image stitching for drone-based wind turbine blade inspection

被引:41
作者
Yang, Cong [1 ]
Liub, Xun [2 ]
Zhou, Hua [2 ]
Ke, Yan [2 ]
See, John [3 ]
机构
[1] Soochow Univ, Suzhou, Peoples R China
[2] Clobotics, Shanghai, Peoples R China
[3] Heriot Watt Univ Malaysia, Putrajaya, Malaysia
基金
中国国家自然科学基金;
关键词
Defect analysis; Image stitching; Blade inspection; Wind turbine;
D O I
10.1016/j.renene.2022.12.063
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Accurate image stitching is crucial to wind turbine blade visualization and defect analysis. It is inevitable that drone-captured images for blade inspection are high resolution and heavily overlapped. This also necessitates the stitching-based deduplication process on detected defects. However, the stitching task suffers from texture poor blade surfaces, unstable drone pose (especially off-shore), and the lack of public blade datasets that cater to real-world challenges. In this paper, we present a simple yet efficient algorithm for robust and accurate blade image stitching. To promote further research, we also introduce a new dataset, Blade30, which contains 1,302 real drone-captured images covering 30 full blades captured under various conditions (both on-and off-shore), accompanied by a rich set of annotations such as defects and contaminations, etc. The proposed stitching algorithm generates the initial blade panorama based on blade edges and drone-blade distances at the coarse grained level, followed by fine-grained adjustments optimized by regression-based texture and shape losses. Our method also fully utilizes the properties of blade images and prior information of the drone. Experiments report promising accuracy in blade stitching and defect deduplication tasks in the vision-based wind turbine blade inspection scenario, surpassing the performance of existing methods.
引用
收藏
页码:267 / 279
页数:13
相关论文
共 65 条
[1]  
Adel E., 2014, International Journal of Computer Applications, V99, P1, DOI [10.5120/17374-7818, DOI 10.5120/17374-7818]
[2]   Comparison and analysis of non-destructive testing techniques suitable for delamination inspection in wind turbine blades [J].
Amenabar, I. ;
Mendikute, A. ;
Lopez-Arraiza, A. ;
Lizaranzu, M. ;
Aurrekoetxea, J. .
COMPOSITES PART B-ENGINEERING, 2011, 42 (05) :1298-1305
[3]  
BERGEN JR, 1992, LECT NOTES COMPUT SC, V588, P237
[4]   Automatic panoramic image stitching using invariant features [J].
Brown, Matthew ;
Lowe, David G. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) :59-73
[5]   Autonomous Wind-Turbine Blade Inspection Using LiDAR-Equipped Unmanned Aerial Vehicle [J].
Car, Marko ;
Markovic, Lovro ;
Ivanovic, Antun ;
Orsag, Matko ;
Bogdan, Stjepan .
IEEE ACCESS, 2020, 8 :131380-131387
[6]  
CastroSantos L, 2016, GREEN ENERGY TECHNOL, P1, DOI 10.1007/978-3-319-27972-5
[7]  
Chady Tomasz, 2016, Przeglad Elektrotechniczny, V92, P1, DOI [10.15199/48.2016.05.01, 10.15199/48.2016.05.01]
[8]   Shape-Preserving Half-Projective Warps for Image Stitching [J].
Chang, Che-Han ;
Sato, Yoichi ;
Chuang, Yung-Yu .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3254-3261
[9]  
Chen LC, 2017, Arxiv, DOI [arXiv:1706.05587, 10.48550/arXiv.1706.05587]
[10]   Automatic Optical Surface Inspection of Wind Turbine Rotor Blades using Convolutional Neural Networks [J].
Denhof, Dimitri ;
Staar, Benjamin ;
Luetjen, Michael ;
Freitag, Michael .
52ND CIRP CONFERENCE ON MANUFACTURING SYSTEMS (CMS), 2019, 81 :1166-1170