Deep-Learning-Enabled Automatic Optical Inspection for Module-Level Defects in LCD

被引:20
作者
Zhu, Haidi [1 ]
Huang, Jingchang [1 ]
Liu, Huawei [1 ]
Zhou, Qianwei [2 ]
Zhu, Jianqing [3 ]
Li, Baoqing [1 ]
机构
[1] Chinese Acad Sci, Sci & Technol Microsyst Lab, Shanghai Inst Microsyst & Informat Technol, Shanghai 201800, Peoples R China
[2] Zhejiang Univ Technol, Coll Comp Sci, Hangzhou 310014, Peoples R China
[3] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
基金
中国国家自然科学基金;
关键词
Liquid crystal displays; Deep learning; Internet of Things; Thin film transistors; Object detection; Automatic optical inspection; Smart manufacturing; Automatic optical inspection (AOI); deep learning; liquid crystal display (LCD); smart manufacturing;
D O I
10.1109/JIOT.2021.3079440
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Liquid crystal display (LCD) defects detection on module level is increasingly important for flat-panel displays (FPD) industry to increase the production capacity via machine vision technology. However, it is an overwhelmingly challenging issue due to various difficulties. This article discloses a practical automatic optical inspection (AOI) system consisting of hardware structure and software algorithm to detect module-level defects. The AOI system is the core component to build a distributed integrated inspection system with the help of the Internet of Things (IoT). Starting from the analysis of the challenges encountered in module-level defects inspection, a delicate photograph scheme is proposed to reveal different kinds of defects. In order to robustly work on the module-level defects detection with complex situations, a novel framework based on YOLOV3 detection unit is proposed in this article, including the preprocessing module, detection module, defects definition module, and interferences elimination module. To the best of our knowledge, this is the first work that designs a practical AOI system for module-level defects detection. In order to demonstrate the effectiveness of the proposed method, extensive experiments have been conducted on the manufacturing lines. The evaluation of the detection performance of the AOI system in comparison with a manual scheme indicates that the proposed system is practical for module-level defects detection. Currently, the proposed system has been deployed in a real-world LCD manufacturing line from a major player in the world.
引用
收藏
页码:1122 / 1135
页数:14
相关论文
共 42 条
  • [11] Rich feature hierarchies for accurate object detection and semantic segmentation
    Girshick, Ross
    Donahue, Jeff
    Darrell, Trevor
    Malik, Jitendra
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 580 - 587
  • [12] Howard AG., 2017, ARXIV, DOI DOI 10.48550/ARXIV.1704.04861
  • [13] An assembly scheduler for TFT LCD manufacturing
    Jeong, B
    Kim, SW
    Lee, YJ
    [J]. COMPUTERS & INDUSTRIAL ENGINEERING, 2001, 41 (01) : 37 - 58
  • [14] A NEW FABRICATION TECHNOLOGY FOR VERY-LARGE-AREA TFT-LCDS
    KANEKO, E
    [J]. DISPLAYS, 1993, 14 (02) : 125 - 130
  • [15] Leo M., 2018, P EUR C COMP VIS WOR, P3
  • [16] Li GQ, 2018, PROCEEDINGS OF 2018 IEEE 3RD ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC 2018), P1031, DOI 10.1109/IAEAC.2018.8577214
  • [17] Defect Inspection in Low-Contrast LCD Images Using Hough Transform-Based Nonstationary Line Detection
    Li, Wei-Chen
    Tsai, Du-Ming
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2011, 7 (01) : 136 - 147
  • [18] The quality improvement of PI coating process of TFT-LCD panels with Taguchi methods
    Lin, Chern-Sheng
    Shih, Shun-Jen
    Lu, An-Tsung
    Hung, San-Shan
    Chiu, Chuang-Chien
    [J]. OPTIK, 2012, 123 (08): : 703 - 710
  • [19] A novel positioning method for optical automatic inspection of an LCD assembly process
    Lin, Chern-Sheng
    Chang, Su-Chi
    Lay, Yun-Long
    Yeh, Mau-Shiun
    Lin, Chi-Chin
    [J]. OPTIK, 2010, 121 (12): : 1089 - 1095
  • [20] Modeling and characterization of TFT-LCD display module for LED projector
    Lin, Samuel
    Lin, S. C.
    Yu, J. M.
    [J]. OPTIK, 2011, 122 (17): : 1538 - 1543