Detection method for weld defects in time-of-flight diffraction images based on multi-image fusion and feature hybrid enhancement

被引:4
作者
Yang, Deyan [1 ]
Jiang, Hongquan [1 ]
Ai, Song [2 ]
Yang, Tianlun [2 ]
Zhi, Zelin [1 ,3 ]
Jing, Deqiang [3 ]
Gao, Jianmin [1 ]
Yue, Kun [1 ]
Cheng, Huyue [1 ]
Xu, Yongjun [3 ]
机构
[1] Xi An Jiao Tong Univ, State Key Lab Mfg Syst Engn, Xian 710049, Peoples R China
[2] Dongfang Turbine Co Ltd, State Key Lab Clean & Efficient Turbomachinery Pow, Deyang 618000, Peoples R China
[3] Shaanxi Special Equipment Inspect & Testing Inst, Xian 710048, Peoples R China
基金
中国国家自然科学基金;
关键词
Time-of-flight diffraction; Deep learning; Defect detection; Image decomposition; Feature hybrid enhancement;
D O I
10.1016/j.engappai.2024.109442
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The accurate recognition of defects in the time-of-flight diffraction (TOFD) images of welds is important to improve the capability and efficiency of defect detection. The existing deep learning-based defect detection methods take a single image as input, without considering the fact that technicians need to observe the image "dynamically" during its evaluation, resulting in low accuracy and credibility of the defect detection results. To address these issues, combining deep learning techniques with TOFD inspection domain knowledge, this article proposes a multi-image fusion and feature hybrid enhancement-based weld defect detection method for TOFD images, comprising three parts: a single-to-multiple image decomposition module based on gain preprocessing, multi-image feature extraction module, and weld defect detection module based on feature hybrid enhancement. The developed method can realize a "dynamically changing" feature extraction and target detection of weld defects in TOFD images. The proposed method was experimentally verified using TOFD images of welds in largescale spherical pressure tanks. This method greatly surpassed the current state-of-the-art approaches, including You Only Look Once (YOLO) v9, YOLOv10, and Real-Time DEtection TRansformer (RT-DETR), achieving a mean average precision of 82.0%, average precision for small-size targets of 45.2%, and average recall for small-size targets of 70.9%. The detection time for a single TOFD image with a resolution of 500 x 1350 pixels is 0.1287 s, satisfying the real-time requirements for weld TOFD inspection in practical engineering applications. The proposed method can also be extended to engineering applications such as intelligent detection of weld defects based on X-ray images.
引用
收藏
页数:15
相关论文
共 42 条
[1]   Editorial: intelligent manufacturing systems towards industry 4.0 era [J].
Barari, Ahmad ;
de Sales Guerra Tsuzuki, Marcos ;
Cohen, Yuval ;
Macchi, Marco .
JOURNAL OF INTELLIGENT MANUFACTURING, 2021, 32 (07) :1793-1796
[2]   Determining the Coordinates of Reflectors in a Plane Perpendicular to Welded Joint Using Echo Signals Measured by Transducers in the TOFD Scheme [J].
Bazulin, E. G. ;
Vopilkin, A. Kh ;
Tikhonov, D. S. .
RUSSIAN JOURNAL OF NONDESTRUCTIVE TESTING, 2021, 57 (06) :437-445
[3]  
Bleuze A., 2009, ASME PRESSURE VESSEL, P43680
[4]   Improved YOLOv8-GD deep learning model for defect detection in electroluminescence images of solar photovoltaic modules [J].
Cao, Yukang ;
Pang, Dandan ;
Zhao, Qianchuan ;
Yan, Yi ;
Jiang, Yongqing ;
Tian, Chongyi ;
Wang, Fan ;
Li, Julin .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 131
[5]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[6]  
Chen K, 2019, Arxiv, DOI arXiv:1906.07155
[7]  
Ge Z, 2021, Arxiv, DOI arXiv:2107.08430
[8]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[9]   Coordinate Attention for Efficient Mobile Network Design [J].
Hou, Qibin ;
Zhou, Daquan ;
Feng, Jiashi .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :13708-13717
[10]   In-process calibration of a non-destructive testing system used for in-process inspection of multi-pass welding [J].
Javadi, Yashar ;
Sweeney, Nina E. ;
Mohseni, Ehsan ;
MacLeod, Charles N. ;
Lines, David ;
Vasilev, Momchil ;
Qiu, Zhen ;
Vithanage, Randika K. W. ;
Mineo, Carmelo ;
Stratoudaki, Theodosia ;
Pierce, Stephen G. ;
Gachagan, Anthony .
MATERIALS & DESIGN, 2020, 195