Toward generalizable robot vision guidance in real-world operational manufacturing factories: A Semi-Supervised Knowledge Distillation approach

被引:6
作者
Zhao, Zizhou [1 ]
Lyu, Junyu [2 ]
Chu, Yinghao [3 ]
Liu, Ke [1 ,2 ]
Cao, Daofan [1 ]
Wu, Changning [2 ]
Qin, Longjun [4 ]
Qin, Shiwei [5 ]
机构
[1] Southern Univ Sci & Technol, Dept Chem, Shenzhen, Peoples R China
[2] Southern Univ Sci & Technol, Sch Innovat & Entrepreneurship, Shenzhen, Peoples R China
[3] City Univ Hong Kong, Dept Syst Engn, Hong Kong, Peoples R China
[4] Peking Univ, Shenzhen Grad Sch, Sch Environm & Energy, Shenzhen 518055, Peoples R China
[5] AIATOR, Shenzhen, Peoples R China
关键词
Semi-supervised learning; Knowledge distillation; Domain adaptation; Vision-based robot guidance; Smart manufacturing; DOMAIN ADAPTATION; RECOGNITION; MODELS;
D O I
10.1016/j.rcim.2023.102639
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The complexity and diversity of scenarios, along with the presence of environmental noise in factory settings, pose significant challenges to the implementation of deep learning-based vision-guided robots for smart manufacturing. In response to these challenges, we introduce a novel Semi-Supervised Knowledge Distillation (SSKD) framework that has been extensively validated and deployed across numerous real-world production lines. The proposed SSKD framework combines the advantages of semi-supervised learning and knowledge distillation to offer optimization for the majority of deep learning models. Experiments conducted in real-world factory settings demonstrate that the SSKD framework significantly enhances the performance of deep learning models, reducing inference time from 185 ms to 45 ms and improving generalizability across different working environments, achieving recall and precision values that exceed 99.5% and 92.6%, respectively, achieved a remarkable 200% improvement in labor efficiency. Our innovative SSKD framework provides a reliable and scalable solution for enhancing manufacturing productivity and product quality. The success of this approach in transforming vision-guided robotic systems for smart manufacturing highlights its potential for broader industry adoption. The SSKD framework offers a reliable and scalable solution for enhancing manufacturing productivity and product quality. Our results underscore the potential of this innovative approach to transform vision-guided robot systems in smart manufacturing, making it an attractive candidate for widespread adoption in the industry. We are proud to report that, as of the end of 2022, the SSKD framework has been successfully implemented in 50 robots - a more than ten-fold increase from the initial 4 in 2020 - resulting in an annual yarn production capacity exceeding 100,000 kg. This accomplishment underscores the practical impact and effectiveness of the SSKD framework in real-world production lines.
引用
收藏
页数:18
相关论文
共 92 条
[41]   Feature Pyramid Networks for Object Detection [J].
Lin, Tsung-Yi ;
Dollar, Piotr ;
Girshick, Ross ;
He, Kaiming ;
Hariharan, Bharath ;
Belongie, Serge .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :936-944
[42]   Path Aggregation Network for Instance Segmentation [J].
Liu, Shu ;
Qi, Lu ;
Qin, Haifang ;
Shi, Jianping ;
Jia, Jiaya .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8759-8768
[43]   SSD: Single Shot MultiBox Detector [J].
Liu, Wei ;
Anguelov, Dragomir ;
Erhan, Dumitru ;
Szegedy, Christian ;
Reed, Scott ;
Fu, Cheng-Yang ;
Berg, Alexander C. .
COMPUTER VISION - ECCV 2016, PT I, 2016, 9905 :21-37
[44]  
Liu Xiaoyang, 2019, Convolutional backbone with FPN RPN FCN regression classification feature map with RoIs RoIAlign
[45]   Multiple source partial knowledge transfer for manufacturing system modelling [J].
Liu, Xu ;
Li, Yingguang ;
Chen, Lu ;
Chen, Gengxiang ;
Zhao, Boya .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2023, 80
[46]   Scheduling of decentralized robot services in cloud manufacturing with deep reinforcement learning [J].
Liu, Yongkui ;
Ping, Yaoyao ;
Zhang, Lin ;
Wang, Lihui ;
Xu, Xun .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2023, 80
[47]  
Liu Z, 2014, IEEE ANN INT CONF CY, P574, DOI 10.1109/CYBER.2014.6917527
[48]  
Long MS, 2015, PR MACH LEARN RES, V37, P97
[49]   Distinctive image features from scale-invariant keypoints [J].
Lowe, DG .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2004, 60 (02) :91-110
[50]   Deep learning-assisted real-time defect detection and closed-loop adjustment for additive manufacturing of continuous fiber-reinforced polymer composites [J].
Lu, Lu ;
Hou, Jie ;
Yuan, Shangqin ;
Yao, Xiling ;
Li, Yamin ;
Zhu, Jihong .
ROBOTICS AND COMPUTER-INTEGRATED MANUFACTURING, 2023, 79