A lightweight deep learning model for TFT-LCD circuits defect classification based on swin transformer

被引:1
作者
Xia Y. [1 ]
Luo C. [1 ]
Zhou Y. [1 ]
Jia L. [2 ]
机构
[1] School of Mechanical Engineering, Southeast University, Nanjing
[2] Wuxi Shangshi-finevision Technology Co., Ltd, Wuxi
来源
Guangxue Jingmi Gongcheng/Optics and Precision Engineering | 2023年 / 31卷 / 22期
关键词
computer vision; image classification; Thin Film Transistor Liquid Crystal Display(TFT-LCD); transformer;
D O I
10.37188/OPE.20233122.3357
中图分类号
学科分类号
摘要
Defect detection in thin film transistor-liquid crystal display (TFT-LCD) circuits is a challenging task because of the complex background setting, different types of defects involved, and real-time detection requirements from industry. Traditional methods have difficulties in satisfying the dual requirements of detection speed and accuracy. To address this challenge, in this study, a deep learning method is developed for image classification based on the Swin Transformer technique. First, token merging is used to reduce the computational complexity of each layer of the model, thus improving computation efficiency. Then, a depthwise separable convolution module is introduced to add convolutional bias to reduce the reliance on massive data. Finally, a knowledge distillation method is applied to overcome the problem of reduced detection accuracy caused by the less-intensive computation design. Experimental results on the self-made dataset demonstrate that the proposed method achieves a 2.6 G FLOPs reduction and a 17% speed improvement compared to baseline models, with only a 1.3% Top-1 accuracy precision reduction. More importantly, the proposed model achieves better balance on accuracy and detection speed on both self-made and public datasets than existing mainstream models on image classification in the TFT-LCD manufacturing industry. © 2023 Chinese Academy of Sciences. All rights reserved.
引用
收藏
页码:3357 / 3370
页数:13
相关论文
共 29 条
[1]  
HARALICK R M, SHANMUGAM K, DINSTEIN I, Textural features for image classification[J], IEEE Transactions on Systems, Man, and Cybernetics, SMC-3, 6, pp. 610-621, (1973)
[2]  
DALAL N, TRIGGS B, Histograms of oriented gradients for human detection[C], 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05), pp. 886-893, (2005)
[3]  
STOCKMAN G, SHAPIRO LG, Computer Vision[M], pp. 69-73, (2002)
[4]  
PLATT J C, Sequential minimal optimization: a fast algorithm for training support vector machines [S], Microsoft Research Technical Report, (1998)
[5]  
KANG S B, LEE J H, SONG K Y, Automatic defect classification of TFT-LCD panels using machine learning[C], 2009 IEEE International Symposium on Industrial Electronics, pp. 2175-2177, (2009)
[6]  
HUANG W, LU H T, Defect Classification of TFT-LCD with bag of visual words approach[C], 2012 IEEE 6th International Conference on Information and Automation for Sustainability, pp. 167-170, (2012)
[7]  
KONG L F, SHEN J, HU Z L, Detection of Water-Stains defects in TFT-LCD based on machine vision[C], 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp. 1-5, (2018)
[8]  
XIAO S M, WANG S J, CHANG L, Compressive sensing fast classification for handwritten digital images[J], Opt. Precision Eng, 29, 7, pp. 1709-1719, (2021)
[9]  
MIAO C K, LOU S L, LI T, Multi-label infrared image classification algorithm based on weakly supervised learning[J], Opt. Precision Eng, 30, 20, pp. 2501-2509, (2022)
[10]  
CHIKONTWE P, KIM S, PARK S H, CAD: Co-Adapting discriminative features for improved Few-Shot classification[C], 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 14534-14543, (2022)