Low-Cost Real-Time Automated Optical Inspection Using Deep Learning and Attention Map

被引:4
作者
Shih, Yu [1 ]
Kuo, Chien-Chih [1 ]
Lee, Ching -Hung [1 ]
机构
[1] Natl Yang Ming Chiao Tung Univ, Dept Elect & Comp Engn, Hsinchu 300, Taiwan
关键词
Automated optical inspection; deep learning; real-time inspection; attention; RESIDUAL LIFE PREDICTION; CLASSIFICATION; DESIGN; MODEL;
D O I
10.32604/iasc.2023.027659
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The recent trends in Industry 4.0 and Internet of Things have encour-aged many factory managers to improve inspection processes to achieve automa-tion and high detection rates. However, the corresponding cost results of sample tests are still used for quality control. A low-cost automated optical inspection system that can be integrated with production lines to fully inspect products with-out adjustments is introduced herein. The corresponding mechanism design enables each product to maintain a fixed position and orientation during inspec-tion to accelerate the inspection process. The proposed system combines image recognition and deep learning to measure the dimensions of the thread and iden-tify its defects within 20 s, which is lower than the production-line productivity per 30 s. In addition, the system is designed to be used for monitoring production lines and equipment status. The dimensional tolerance of the proposed system reaches 0.012 mm, and a 100% accuracy is achieved in terms of the defect reso-lution. In addition, an attention-based visualization approach is utilized to verify the rationale for the use of the convolutional neural network model and identify the location of thread defects.
引用
收藏
页码:2087 / 2099
页数:13
相关论文
共 36 条
[1]   Automated inspection system for automobile bearing seals [J].
Ashwini, K. ;
Rudraswamy, S. B. .
MATERIALS TODAY-PROCEEDINGS, 2021, 46 :4709-4715
[3]   Grad-CAM plus plus : Generalized Gradient-based Visual Explanations for Deep Convolutional Networks [J].
Chattopadhay, Aditya ;
Sarkar, Anirban ;
Howlader, Prantik ;
Balasubramanian, Vineeth N. .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :839-847
[4]   Vibration Signals Analysis by Explainable Artificial Intelligence (XAI) Approach: Application on Bearing Faults Diagnosis [J].
Chen, Han-Yun ;
Lee, Ching-Hung .
IEEE ACCESS, 2020, 8 :134246-134256
[5]   A New Ensemble Approach based on Deep Convolutional Neural Networks for Steel Surface Defect classification [J].
Chen, Wen ;
Gao, Yiping ;
Gao, Liang ;
Li, Xinyu .
51ST CIRP CONFERENCE ON MANUFACTURING SYSTEMS, 2018, 72 :1069-1072
[6]   A Symbolic Regression Based Residual Useful Life Model for Slewing Bearings [J].
Ding, Peng ;
Qian, Qinrong ;
Wang, Hua ;
Yao, Jianyong .
IEEE ACCESS, 2019, 7 :72076-72089
[7]  
Fan W. W, 2021, J SENSORS, P1
[8]   Autonomous damage recognition in visual inspection of laminated composite structures using deep learning [J].
Fotouhi, Sakineh ;
Pashmforoush, Farzad ;
Bodaghi, Mahdi ;
Fotouhi, Mohamad .
COMPOSITE STRUCTURES, 2021, 268
[9]  
Gonzalez RC., 2008, DIGITAL IMAGE PROCES
[10]   Residual Life Prediction of Multistage Manufacturing Processes With Interaction Between Tool Wear and Product Quality Degradation [J].
Hao, Li ;
Bian, Linkan ;
Gebraeel, Nagi ;
Shi, Jianjun .
IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2017, 14 (02) :1211-1224