Enhancing quality inspection in automotive manufacturing through deep learning and transfer learning

被引:0
作者
El Wahabi, Abdelhamid [1 ]
Mesquiny, Ayoub [1 ,2 ]
El Ahmadi, Oumaima [1 ,2 ]
Baraka, Ibrahim Hadj [1 ]
Hamdoune, Salaheddine [1 ]
Boudhir, Anouar Abdelhakim [2 ]
机构
[1] LIST Laboratory, ISEEC Research Team, UAE Faculty of Science and Technology, Tangier
[2] C3S Laboratory, SSET Research Team, UAE Faculty of Science and Technology, Tangier
关键词
Automated optical inspection; Convolutional neural network; Deep learning; Defect detection; Quality control; Transfer learning;
D O I
10.1007/s00521-024-10534-2
中图分类号
学科分类号
摘要
Ensuring quality control and accurate defect detection are paramount in the automotive manufacturing industry. Nevertheless, manual and automated optical inspection approaches have encountered limitations in efficiently addressing this area. To overcome these challenges, automotive companies are actively investigating the utilization of deep learning models to automate and optimize quality control processes. This paper focuses on the development of image classification models with the specific objective of accurately categorizing industrial components as acceptable or defective. The targeted manufacturing processes include terminal crimps, gluing the cap of coils, soldering pins and inductors. Our approach leverages transfer learning to mitigate the limited data, utilizing ten state-of-the-art convolutional neural network models (CNNs) previously developed for the ImageNet Large-Scale Visual Recognition Challenge (ILSVRC): DenseNet121, DenseNet201, InceptionResNetV2, InceptionV3, MobileNetV2, ResNet50V2, ResNet101V2, ResNet152V2, VGG19, and Xception. The last layer of these models replaced to align with our dataset's classes, and various strategies such as freezing layers, fine-tuning, adding other layers, and retraining are employed. Finally, we evaluated our performances models using metrics such as accuracy, precision, recall, and ROC–AUC. The results demonstrate the efficiency of transfer learning in quality inspection classification, with DenseNet121 and VGG19 achieving accuracy and precision rates exceeding 99%. © The Author(s), under exclusive licence to Springer-Verlag London Ltd., part of Springer Nature 2025.
引用
收藏
页码:11711 / 11736
页数:25
相关论文
共 36 条
[1]  
Daniel W.-R., Moshe S., Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection, CIRP Ann, 65, 1, pp. 417-420, (2016)
[2]  
Abhiroop B., Sylvain G., End-to-end deep learning framework for printed circuit board manufacturing defect classification, Sci Rep, 12, (2022)
[3]  
(2023)
[4]  
Controleng, (2019)
[5]  
Abd A., Alireza M., A review and analysis of automatic optical inspection and quality monitoring methods in electronics industry, IEEE Access, 8, pp. 183192-183271, (2020)
[6]  
Zhonghe R., Fengzhou F., Ning Y., You W., State of the art in defect detection based on machine vision, Int J Precis Eng Manuf Green Technol, 9, pp. 661-691, (2022)
[7]  
Ruifang Y., Ming C., Chia-Sheng P., Cheng A., Jacque L., High-resolution optical inspection system for fast detection and classification of surface defects, Int J Optomech, 12, 1, pp. 1-10, (2018)
[8]  
Laith A., Jinglan Z., Amjad J.H., Ayad A.-D., Ye D., Omran A.-S., Mohammed A., Muthana A.-A., Laith F., Review of deep learning: concepts, CNN architectures, challenges, applications, future directions, J Big Data, 8, (2021)
[9]  
Justus Z., Felix V., Marco F., Uwe W., Mathias K., Patrick Z., Anomaly detection for industrial quality assurance: a comparative evaluation of unsupervised deep learning models, Comput Ind Eng, 177, (2023)
[10]  
Yibin H., Congying Q., Xiaonan W., Shijun W., Kui Y., A compact convolutional neural network for surface defect inspection, Sensors, 20, 7, (2020)