A Crack Detection Model of Wind Turbine Blade Inner Surface Based on Image Fusion Applicable to Embedded Platforms

被引:0
作者
Guo, Jingkun [1 ]
Wang, Ruiqin [1 ]
Jin, Yutong [1 ]
Zheng, Hongwei [1 ]
Dai, Shijie [1 ]
机构
[1] Hebei Univ Technol, Sch Mech Engn, 5340 Xiping Rd, Tianjin, Peoples R China
来源
2024 IEEE INTERNATIONAL CONFERENCE ON MECHATRONICS AND AUTOMATION, ICMA 2024 | 2024年
基金
中国国家自然科学基金;
关键词
crack detection; image fusion; rotated bounding box; low saliency; wind turbine blade; NETWORK;
D O I
10.1109/ICMA61710.2024.10633185
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Timely crack detection is crucial to maintain the health of wind turbine blades. However, the composite structure of the wind turbine blade (WTB) inner surface is intricately composed. Current object detection networks lack efficiency and accuracy in crack detection on the WTB owing to the low saliency cracks of the inner surface. Meanwhile, the impact on the accuracy of the crack detection model due to the low dynamic range of a single visible crack image on the inner surface of the WTB cannot be neglected. For the sake of solving the above problems, a new dataset is set, consisting of infrared (IR) and visible (VIS) images. The new network structure is proposed to utilize the above dataset, achieving the fusion of crack information between two modal images (IR-VIS). Moreover, to quantify cracks with width, height, and rotation angles accurately, a rotated bounding box method is introduced. Last but not least, a two-stage training method is designed to improve the training results, which can mitigate the low training speed of the model caused by the complexity of the fusion structure. The experimental study is carried out, showing the IR-VIS dataset is effective for crack detection, and the modified model improved detection performance by 31.59%. In crack detection of the inner surface on the WTB, the modified model outperforms base object detection model in the ablative experiments. Our method can improve accuracy up to 82.02% by fusing IR-VIS images. In addition, our model achieves 75.94% accuracy and runs at 38 FPS speed when paired with the Jetson Nano, a limited computational embedded device.
引用
收藏
页码:424 / 429
页数:6
相关论文
共 21 条
[11]   Automatic visual defects inspection of wind turbine blades via YOLO-based small object detection approach [J].
Qiu, Zifeng ;
Wang, Shuangxin ;
Zeng, Zhaoxi ;
Yu, Dingli .
JOURNAL OF ELECTRONIC IMAGING, 2019, 28 (04)
[12]   Recent technology and challenges of wind energy generation: A review [J].
Roga, Sukanta ;
Bardhan, Shawli ;
Kumar, Yogesh ;
Dubey, Sudhir K. .
SUSTAINABLE ENERGY TECHNOLOGIES AND ASSESSMENTS, 2022, 52
[13]   DMA-Net: DeepLab With Multi-Scale Attention for Pavement Crack Segmentation [J].
Sun, Xinzi ;
Xie, Yuanchang ;
Jiang, Liming ;
Cao, Yu ;
Liu, Benyuan .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (10) :18392-18403
[14]   YDTR: Infrared and Visible Image Fusion via Y-Shape Dynamic Transformer [J].
Tang, Wei ;
He, Fazhi ;
Liu, Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :5413-5428
[15]   CenterNet-Auto: A Multi-object Visual Detection Algorithm for Autonomous Driving Scenes Based on Improved CenterNet [J].
Wang, Hai ;
Xu, Yansong ;
Wang, Zining ;
Cai, Yingfeng ;
Chen, Long ;
Li, Yicheng .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2023, 7 (03) :742-752
[16]   Review of the Typical Damage and Damage-Detection Methods of Large Wind Turbine Blades [J].
Wang, Wenjie ;
Xue, Yu ;
He, Chengkuan ;
Zhao, Yongnian .
ENERGIES, 2022, 15 (15)
[17]  
Xu YC, 2021, IEEE T PATTERN ANAL, V43, P1452, DOI [10.1109/TPAMI.2020.2974745, 10.1109/TGRS.2020.3026387]
[18]   Imbalanced Classification Based on Minority Clustering Synthetic Minority Oversampling Technique With Wind Turbine Fault Detection Application [J].
Yi, Huaikuan ;
Jiang, Qingchao ;
Yan, Xuefeng ;
Wang, Bei .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (09) :5867-5875
[19]   CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusion [J].
Zhao, Zixiang ;
Bai, Haowen ;
Zhang, Jiangshe ;
Zhang, Yulun ;
Xu, Shuang ;
Lin, Zudi ;
Timofte, Radu ;
Van Gool, Luc .
2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, :5906-5916
[20]   Effective Pan-Sharpening With Transformer and Invertible Neural Network [J].
Zhou, Man ;
Fu, Xueyang ;
Huang, Jie ;
Zhao, Feng ;
Liu, Aiping ;
Wang, Rujing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60