Synthetic data generation using finite element method to pre-train an image segmentation model for defect detection using infrared thermography

被引:5
作者
Pareek, Kaushal Arun [1 ,2 ]
May, Daniel [1 ,2 ]
Meszmer, Peter [1 ]
Ras, Mohamad Abo [2 ]
Wunderle, Bernhard [1 ]
机构
[1] Tech Univ Chemnitz, Fac Elect Engn & Informat Technol, Chair Mat & Reliabil Microsyst, D-09107 Chemnitz, Germany
[2] Berliner Nanotest & Design GmbH, Volmerstr 9B, D-12489 Berlin, Germany
关键词
Flaw detection; Deep learning; Data augmentation; Pre-training; Zero defect manufacturing; Inline inspection; Synthetic data; Finite element method; Image segmentation; Infrared thermography; Non-destructive testing; NEURAL-NETWORKS; DEPTH; ENHANCEMENT; RECONSTRUCTION; CONTRAST;
D O I
10.1007/s10845-024-02326-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The vision of a deep learning-empowered non-destructive evaluation technique aligns perfectly with the goal of zero-defect manufacturing, enabling manufacturers to detect and repair defects actively. However, the dearth of data in manufacturing is one of the biggest obstacles to realizing an intelligent defect detection system. This work presents a framework for bridging the data gap in manufacturing using the potential of synthetic datasets generated using the finite element method-based digital twin. The non-destructive technique under consideration is pulse infrared thermography. A large number of synthetic thermographic measurements were generated using 2D axisymmetric transient thermal simulations. The representativeness of synthetic data was thoroughly investigated at various steps of the framework, and the image segmentation model was trained separately on experimental and synthetic datasets. The study results reveal that when carefully rendered, synthetic datasets represent the experimental data well. When evaluated on real-world experimental samples, the segmentation model pre-trained on synthetic datasets generalizes well to the experimental samples. Furthermore, another advantage of synthetic datasets is the ease of labelling a large amount of data. Finally, the robustness assessment of the model was done on two new datasets: one where the complete experimental setup was changed, and the other was an open-source infrared thermography dataset
引用
收藏
页码:1879 / 1905
页数:27
相关论文
共 49 条
  • [1] Ansys, 2022, ANSYS MECH APDL 2022
  • [2] Application of automation for in-line quality inspection, a zero-defect manufacturing approach
    Azamfirei, Victor
    Psarommatis, Foivos
    Lagrosen, Yvonne
    [J]. JOURNAL OF MANUFACTURING SYSTEMS, 2023, 67 : 1 - 22
  • [3] Benitez H., 2006, QUANT INFRARED THERM, DOI [10.21611/qirt.2006.010, DOI 10.21611/QIRT.2006.010]
  • [4] Benitez H., 2007, P SPIE INT SOC OPTIC, V10
  • [5] Definition of a new thermal contrast and pulse correction for defect quantification in pulsed thermography
    Benitez, Hernan D.
    Ibarra-Castanedo, Clemente
    Bendada, AbdelHakim
    Maldague, Xavier
    Loaiza, Humberto
    Caicedo, Eduardo
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2008, 51 (03) : 160 - 167
  • [6] Bison P., 1994, P QUANT INFR THERM S, P214
  • [7] Brunton SL, 2019, DATA-DRIVEN SCIENCE AND ENGINEERING: MACHINE LEARNING, DYNAMICAL SYSTEMS, AND CONTROL, P1, DOI 10.1017/9781108380690
  • [8] Carslaw H., 1959, CONDUCTION HEAT SOLI, P510
  • [9] Castanedo C.I., 2005, THESIS U LAVAL QUEBE
  • [10] Optimizing input data for training an artificial neural network used for evaluating defect depth in infrared thermographic nondestructive testing
    Chulkov, A. O.
    Nesteruk, D. A.
    Vavilov, V. P.
    Moskovchenko, A. I.
    Saeed, N.
    Omar, M.
    [J]. INFRARED PHYSICS & TECHNOLOGY, 2019, 102