Deep-Learning-Enabled Automatic Optical Inspection for Module-Level Defects in LCD

被引:20
作者
Zhu, Haidi [1 ]
Huang, Jingchang [1 ]
Liu, Huawei [1 ]
Zhou, Qianwei [2 ]
Zhu, Jianqing [3 ]
Li, Baoqing [1 ]
机构
[1] Chinese Acad Sci, Sci & Technol Microsyst Lab, Shanghai Inst Microsyst & Informat Technol, Shanghai 201800, Peoples R China
[2] Zhejiang Univ Technol, Coll Comp Sci, Hangzhou 310014, Peoples R China
[3] Huaqiao Univ, Coll Engn, Quanzhou 362021, Peoples R China
基金
中国国家自然科学基金;
关键词
Liquid crystal displays; Deep learning; Internet of Things; Thin film transistors; Object detection; Automatic optical inspection; Smart manufacturing; Automatic optical inspection (AOI); deep learning; liquid crystal display (LCD); smart manufacturing;
D O I
10.1109/JIOT.2021.3079440
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Liquid crystal display (LCD) defects detection on module level is increasingly important for flat-panel displays (FPD) industry to increase the production capacity via machine vision technology. However, it is an overwhelmingly challenging issue due to various difficulties. This article discloses a practical automatic optical inspection (AOI) system consisting of hardware structure and software algorithm to detect module-level defects. The AOI system is the core component to build a distributed integrated inspection system with the help of the Internet of Things (IoT). Starting from the analysis of the challenges encountered in module-level defects inspection, a delicate photograph scheme is proposed to reveal different kinds of defects. In order to robustly work on the module-level defects detection with complex situations, a novel framework based on YOLOV3 detection unit is proposed in this article, including the preprocessing module, detection module, defects definition module, and interferences elimination module. To the best of our knowledge, this is the first work that designs a practical AOI system for module-level defects detection. In order to demonstrate the effectiveness of the proposed method, extensive experiments have been conducted on the manufacturing lines. The evaluation of the detection performance of the AOI system in comparison with a manual scheme indicates that the proposed system is practical for module-level defects detection. Currently, the proposed system has been deployed in a real-world LCD manufacturing line from a major player in the world.
引用
收藏
页码:1122 / 1135
页数:14
相关论文
共 42 条
  • [1] Toward effective mobile encrypted traffic classification through deep learning
    Aceto, Giuseppe
    Ciuonzo, Domenico
    Montieri, Antonio
    Pescape, Antonio
    [J]. NEUROCOMPUTING, 2020, 409 : 306 - 315
  • [2] Mobile Encrypted Traffic Classification Using Deep Learning: Experimental Evaluation, Lessons Learned, and Challenges
    Aceto, Giuseppe
    Ciuonzo, Domenico
    Montieri, Antonio
    Pescape, Antonio
    [J]. IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2019, 16 (02): : 445 - 458
  • [3] [Anonymous], 2016, ARXIV
  • [4] Mask R-CNN
    He, Kaiming
    Gkioxari, Georgia
    Dollar, Piotr
    Girshick, Ross
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2980 - 2988
  • [5] Industry 4.0: How it is defined from a sociotechnical perspective and how much sustainability it includes - A literature review
    Beier, Grischa
    Ullrich, Andre
    Niehoff, Silke
    Reissig, Malte
    Habich, Matthias
    [J]. JOURNAL OF CLEANER PRODUCTION, 2020, 259
  • [6] Defect Detection in Porcelain Industry based on Deep Learning Techniques
    Birlutiu, Adriana
    Burlacu, Adrian
    Kadar, Manuella
    Onita, Daniela
    [J]. 2017 19TH INTERNATIONAL SYMPOSIUM ON SYMBOLIC AND NUMERIC ALGORITHMS FOR SCIENTIFIC COMPUTING (SYNASC 2017), 2017, : 263 - 270
  • [7] Ship Detection Based on YOLOv2 for SAR Imagery
    Chang, Yang-Lang
    Anagaw, Amare
    Chang, Lena
    Wang, Yi Chun
    Hsiao, Chih-Yu
    Lee, Wei-Hong
    [J]. REMOTE SENSING, 2019, 11 (07)
  • [8] An overview on the evolution and adoption of deep learning applications used in the industry
    Dutta, Sourav
    [J]. WILEY INTERDISCIPLINARY REVIEWS-DATA MINING AND KNOWLEDGE DISCOVERY, 2018, 8 (04)
  • [9] Fu C.-Y., 2017, ARXIV170106659
  • [10] Fast R-CNN
    Girshick, Ross
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1440 - 1448