Deep industrial transfer learning at runtime for image recognition

被引:14
作者
Maschler, Benjamin [1 ]
Kamm, Simon [1 ]
Weyrich, Michael [1 ]
机构
[1] Univ Stuttgart, Inst Ind Automat & Software Engn, Pfaffenwaldring 47, D-70550 Stuttgart, Germany
关键词
continual learning; deep learning; incremental class learning; live image recognition; transfer learning;
D O I
10.1515/auto-2020-0119
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The utilization of deep learning in the field of industrial automation is hindered by two factors: The amount and diversity of training data needed as well as the need to continuously retrain as the use case changes over time. Both problems can be addressed by industrial deep transfer learning allowing for the performant, continuous and potentially distributed training on small, dispersed datasets. As a specific example, a dual memory algorithm for computer vision problems is developed and evaluated. It shows the potential for state-of-the-art performance while being trained only on fractions of the complete ImageNet dataset at multiple locations at once.
引用
收藏
页码:211 / 220
页数:10
相关论文
共 31 条
[1]  
Carpenter G.A., 2010, Adaptive resonance theory
[2]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[3]   Catastrophic forgetting in connectionist networks [J].
French, RM .
TRENDS IN COGNITIVE SCIENCES, 1999, 3 (04) :128-135
[4]  
Goodfellow I, 2016, ADAPT COMPUT MACH LE, P1
[5]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[6]  
Hsu Y.-C., 2018, ARXIV181012488
[7]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[8]  
Kagermann H, 2015, Management of permanent change, P23, DOI [10.1007/978-3-658-05014-6_2, DOI 10.1007/978-3-658-05014-6_2]
[9]  
Kemker R, 2018, AAAI CONF ARTIF INTE, P3390
[10]   Learning without Forgetting [J].
Li, Zhizhong ;
Hoiem, Derek .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (12) :2935-2947