A Crack Detection Model of Wind Turbine Blade Inner Surface Based on Image Fusion Applicable to Embedded Platforms

被引:0
作者
Guo, Jingkun [1 ]
Wang, Ruiqin [1 ]
Jin, Yutong [1 ]
Zheng, Hongwei [1 ]
Dai, Shijie [1 ]
机构
[1] Hebei Univ Technol, Sch Mech Engn, 5340 Xiping Rd, Tianjin, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, ICMA 2024 | 2024年
基金
中国国家自然科学基金;
关键词
crack detection; image fusion; rotated bounding box; low saliency; wind turbine blade; NETWORK;
D O I
10.1109/ICMA61710.2024.10633185
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Timely crack detection is crucial to maintain the health of wind turbine blades. However, the composite structure of the wind turbine blade (WTB) inner surface is intricately composed. Current object detection networks lack efficiency and accuracy in crack detection on the WTB owing to the low saliency cracks of the inner surface. Meanwhile, the impact on the accuracy of the crack detection model due to the low dynamic range of a single visible crack image on the inner surface of the WTB cannot be neglected. For the sake of solving the above problems, a new dataset is set, consisting of infrared (IR) and visible (VIS) images. The new network structure is proposed to utilize the above dataset, achieving the fusion of crack information between two modal images (IR-VIS). Moreover, to quantify cracks with width, height, and rotation angles accurately, a rotated bounding box method is introduced. Last but not least, a two-stage training method is designed to improve the training results, which can mitigate the low training speed of the model caused by the complexity of the fusion structure. The experimental study is carried out, showing the IR-VIS dataset is effective for crack detection, and the modified model improved detection performance by 31.59%. In crack detection of the inner surface on the WTB, the modified model outperforms base object detection model in the ablative experiments. Our method can improve accuracy up to 82.02% by fusing IR-VIS images. In addition, our model achieves 75.94% accuracy and runs at 38 FPS speed when paired with the Jetson Nano, a limited computational embedded device.
引用
收藏
页码:424 / 429
页数:6
相关论文
共 21 条
[1]   The effect of resin uptake on the flexural properties of compression molded sandwich composites [J].
Cao, Dongyang ;
Malakooti, Sadeq ;
Kulkarni, Vijay N. ;
Ren, Yao ;
Liu, Yingjian ;
Nie, Xu ;
Qian, Dong ;
Griffith, D. Todd ;
Lu, Hongbing .
WIND ENERGY, 2022, 25 (01) :71-93
[2]   Thermographic non-destructive inspection of wind turbine blades using unmanned aerial systems [J].
Galleguillos, C. ;
Zorrilla, A. ;
Jimenez, A. ;
Diaz, L. ;
Montiano, A. L. ;
Barroso, M. ;
Viguria, A. ;
Lasagni, F. .
PLASTICS RUBBER AND COMPOSITES, 2015, 44 (03) :98-103
[3]   Low saliency crack detection based on improved multimodal object detection network: an example of wind turbine blade inner surface [J].
Gao, Yinfeng ;
Dai, Shijie ;
Ji, Wenbin ;
Wang, Ruiqin .
JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (03)
[4]   HDCB-Net: A Neural Network With the Hybrid Dilated Convolution for Pixel-Level Crack Detection on Concrete Bridges [J].
Jiang, Wenbo ;
Liu, Min ;
Peng, Yunuo ;
Wu, Lehui ;
Wang, Yaonan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (08) :5485-5494
[5]   Arbitrary-Oriented Ship Detection Method Based on Long-Edge Decomposition Rotated Bounding Box Encoding in SAR Images [J].
Jiang, Xinqiao ;
Xie, Hongtu ;
Chen, Jiaxing ;
Zhang, Jian ;
Wang, Guoqian ;
Xie, Kai .
REMOTE SENSING, 2023, 15 (03)
[6]   Stepwise Domain Adaptation (SDA) for Object Detection in Autonomous Vehicles Using an Adaptive CenterNet [J].
Li, Guofa ;
Ji, Zefeng ;
Qu, Xingda .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) :17729-17743
[7]   RFN-Nest: An end-to-end residual fusion network for infrared and visible images [J].
Li, Hui ;
Wu, Xiao-Jun ;
Kittler, Josef .
INFORMATION FUSION, 2021, 73 :72-86
[8]   Fusion from Decomposition: A Self-Supervised Decomposition Approach for Image Fusion [J].
Liang, Pengwei ;
Jiang, Junjun ;
Liu, Xianming ;
Ma, Jiayi .
COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 :719-735
[9]   Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection [J].
Liu, Jinyuan ;
Fan, Xin ;
Huang, Zhanbo ;
Wu, Guanyao ;
Liu, Risheng ;
Zhong, Wei ;
Luo, Zhongxuan .
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, :5792-5801
[10]   SwinFusion: Cross-domain Long-range Learning for General Image Fusion via Swin Transformer [J].
Ma, Jiayi ;
Tang, Linfeng ;
Fan, Fan ;
Huang, Jun ;
Mei, Xiaoguang ;
Ma, Yong .
IEEE-CAA JOURNAL OF AUTOMATICA SINICA, 2022, 9 (07) :1200-1217