Toward generalizable robot vision guidance in real-world operational manufacturing factories: A Semi-Supervised Knowledge Distillation approach

被引:6
作者
Zhao, Zizhou [1 ]
Lyu, Junyu [2 ]
Chu, Yinghao [3 ]
Liu, Ke [1 ,2 ]
Cao, Daofan [1 ]
Wu, Changning [2 ]
Qin, Longjun [4 ]
Qin, Shiwei [5 ]
机构
[1] Southern Univ Sci & Technol, Dept Chem, Shenzhen, Peoples R China
[2] Southern Univ Sci & Technol, Sch Innovat & Entrepreneurship, Shenzhen, Peoples R China
[3] City Univ Hong Kong, Dept Syst Engn, Hong Kong, Peoples R China
[4] Peking Univ, Shenzhen Grad Sch, Sch Environm & Energy, Shenzhen 518055, Peoples R China
[5] AIATOR, Shenzhen, Peoples R China
关键词
Semi-supervised learning; Knowledge distillation; Domain adaptation; Vision-based robot guidance; Smart manufacturing; DOMAIN ADAPTATION; RECOGNITION; MODELS;
D O I
10.1016/j.rcim.2023.102639
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The complexity and diversity of scenarios, along with the presence of environmental noise in factory settings, pose significant challenges to the implementation of deep learning-based vision-guided robots for smart manufacturing. In response to these challenges, we introduce a novel Semi-Supervised Knowledge Distillation (SSKD) framework that has been extensively validated and deployed across numerous real-world production lines. The proposed SSKD framework combines the advantages of semi-supervised learning and knowledge distillation to offer optimization for the majority of deep learning models. Experiments conducted in real-world factory settings demonstrate that the SSKD framework significantly enhances the performance of deep learning models, reducing inference time from 185 ms to 45 ms and improving generalizability across different working environments, achieving recall and precision values that exceed 99.5% and 92.6%, respectively, achieved a remarkable 200% improvement in labor efficiency. Our innovative SSKD framework provides a reliable and scalable solution for enhancing manufacturing productivity and product quality. The success of this approach in transforming vision-guided robotic systems for smart manufacturing highlights its potential for broader industry adoption. The SSKD framework offers a reliable and scalable solution for enhancing manufacturing productivity and product quality. Our results underscore the potential of this innovative approach to transform vision-guided robot systems in smart manufacturing, making it an attractive candidate for widespread adoption in the industry. We are proud to report that, as of the end of 2022, the SSKD framework has been successfully implemented in 50 robots - a more than ten-fold increase from the initial 4 in 2020 - resulting in an annual yarn production capacity exceeding 100,000 kg. This accomplishment underscores the practical impact and effectiveness of the SSKD framework in real-world production lines.
引用
收藏
页数:18
相关论文
共 92 条
  • [1] ToF cameras for active vision in robotics
    Alenya, G.
    Foix, S.
    Torras, C.
    [J]. SENSORS AND ACTUATORS A-PHYSICAL, 2014, 218 : 10 - 22
  • [2] Novel Transfer Learning Approach for Medical Imaging with Limited Labeled Data
    Alzubaidi, Laith
    Al-Amidie, Muthana
    Al-Asadi, Ahmed
    Humaidi, Amjad J.
    Al-Shamma, Omran
    Fadhel, Mohammed A.
    Zhang, Jinglan
    Santamaria, J.
    Duan, Ye
    [J]. CANCERS, 2021, 13 (07)
  • [3] [Anonymous], 2017, An analysis of deep neural network models for practical applications
  • [4] Bachman P., 2014, LEARNING PSEUDO ENSE
  • [5] Bamne Bulbul, 2020, 2020 International Conference on Electronics and Sustainable Communication Systems (ICESC). Proceedings, P328, DOI 10.1109/ICESC48915.2020.9156060
  • [6] SURF: Speeded up robust features
    Bay, Herbert
    Tuytelaars, Tinne
    Van Gool, Luc
    [J]. COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 : 404 - 417
  • [7] Benhimane S, 2008, VISAPP 2008: PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER VISION THEORY AND APPLICATIONS, VOL 2, P337
  • [8] Borangiu Theodor, 2010, Robot arms with 3D vision capabilities, DOI [10.5772/9668, DOI 10.5772/9668]
  • [9] Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networks
    Bousmalis, Konstantinos
    Silberman, Nathan
    Dohan, David
    Erhan, Dumitru
    Krishnan, Dilip
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 95 - 104
  • [10] Brunelli Roberto, 2009, Template matching techniques in computer vision: theory and practice