An automatic detection method of aero-engine bolt installation defects based on key points detection

被引：0
|
作者：
Xin J. [1 ]
Wang R. [1 ]
Xie Y. [1 ]
Sun J. [1 ]
机构：
[1] Laboratory of Precision Opto-mechatronics Technology, Ministry of Education, Institute of Instrumentation Science and Opto-Electronics Engineering, Beihang University, Beijing
来源：
Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument | 2023年 / 44卷 / 03期
关键词：
binocular stereo vision; deep learning; defect detection; key points detection;
D O I：
10.19650/j.cnki.cjsi.J2210752
中图分类号：
学科分类号：
摘要：
In view of the problems of complex background, small target and inconspicuous fine features of aero-engine bolts, an automated detection algorithm of aero-engine bolt installation detection based on key points detection is proposed. First, a cascaded convolutional neural network based on the Faster RCNN and the improved CPN (AD-CPN) is proposed to achieve the detection of bolts and 2D key points which can determine whether the bolt has fallen off or missed. To further detect the 3D installation detection of the bolt, the Euclidean distance selection strategy is introduced to match and screen the key points to obtain the detected point pairs. Finally, the 3D coordinates of the key points are calculated by using binocular stereo vision technology. In this way, it can judge whether the bolt is wrongly installed. Compared with CPN, the mAP,AP50, and AP75 of AD-CPN are improved by 2. 9%, 3. 3%, and 4%, respectively. In addition, the relative average error of bolt measurement length is approximately 3. 0% . It can be seen that the algorithm could enhance the accuracy of detection, and ensure the safe operation of aero-engines, which has great practical significance. © 2023 Science Press. All rights reserved.
引用
收藏
页码：98 / 106
页数：8
相关论文
共 22 条
  • [1] LIU X J, HU T Y, REN Y., Application of RVI on maintain of aero-plane engine, Engineering & Test, 1, pp. 34-36, (2009)
  • [2] ZHAO L Y, WU Y Q., Research progress of surface defect detection methods based on machine vision, Chinese Journal of Scientific Instrument, 43, 1, pp. 198-219, (2022)
  • [3] RAMANA L, CHOI W, CHA Y J., Fully automated vision-based loosened bolt detection using the viola-jones algorithm [ J ], Structural Health Monitoring, 18, 2, pp. 422-434, (2019)
  • [4] GIBBONS T J, PIERCE G, WORDEN K, Et al., Convolutional neural networks for the detection of damaged fasteners in engineering structures [ A], 9th European Workshop on Structural Health Monitoring, pp. 18-32, (2018)
  • [5] QI Y CH, WU X L, ZHAO ZH B, Et al., Bolt defect detection for aerial transmission lines using Faster R-CNN with an embedded dual attention mechanism, Journal of Image and Graphics, 26, 11, pp. 2594-2604, (2021)
  • [6] ZHANG SH, WANG H T, DONG X CH, Et al., Study on classification and detection of bolt defects in transmission lines based on deep learning [ J], Application of IC, 45, 7, pp. 2821-2829, (2021)
  • [7] LOWE D G., Object recognition from local scale-invariant features, Proc of IEEE International Conference on Computer Vision, 2, pp. 1150-1157, (1999)
  • [8] BAY H, ESS A, TUYTELAARS T, Et al., Speeded-up robust features (SURF) [ J], Computer Vision & Image Understanding, 110, 3, pp. 346-359, (2008)
  • [9] RUBLEE E, RABAUD V, KONOLIGE K, Et al., ORB: An efficient alternative to SIFT or SURF [ C ], 2011 International Conference on Computer Vision, pp. 2564-2571, (2011)
  • [10] DETONE D, MALISIEWICZ T, RABINOVICH A., Superpoint: Self-supervised interest point detection and description, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 224-236, (2018)
123