ON TRAINING DEEP NEURAL NETWORKS USING A STREAMING APPROACH

被引:21
作者
Duda, Piotr [1 ]
Jaworski, Maciej [1 ]
Cader, Andrzej [2 ,3 ]
Wang, Lipo [4 ]
机构
[1] Czestochowa Tech Univ, Dept Comp Engn, Czestochowa, Poland
[2] Clark Univ, Worcester, MA 01610 USA
[3] Univ Social Sci, Informat Technol Inst, Lodz, Poland
[4] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore, Singapore
关键词
deep learning; data streams; convolutional neural networks; CONCEPT DRIFT;
D O I
10.2478/jaiscr-2020-0002
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many deep learning methods, allowed for a significant improvement of systems based on artificial intelligence methods. Their effectiveness results from an ability to analyze large labeled datasets. The price for such high accuracy is the long training time, necessary to process such large amounts of data. On the other hand, along with the increase in the number of collected data, the field of data stream analysis was developed. It enables to process data immediately, with no need to store them. In this work, we decided to take advantage of the benefits of data streaming in order to accelerate the training of deep neural networks. The work includes an analysis of two approaches to network learning, presented on the background of traditional stochastic and batch-based methods.
引用
收藏
页码:15 / 26
页数:12
相关论文
共 43 条
[1]  
Abdulsalam H, 2008, LECT NOTES COMPUT SC, V5181, P643, DOI 10.1007/978-3-540-85654-2_54
[2]  
Abdulsalam H, 2007, INT DATABASE ENG APP, P225
[3]  
Ackley, 1984, BOLTZMANN MACHINES C
[4]  
[Anonymous], 2010, MNIST handwritten digit database
[5]  
[Anonymous], PROC CVPR IEEE
[6]  
[Anonymous], 2014, ARXIV14091556
[7]  
[Anonymous], 2017, INFORM FUSION, DOI DOI 10.1016/j.inffus.2017.02.004
[8]  
[Anonymous], 2014, NIPS 2014 WORKSH DEE
[9]  
[Anonymous], ADV NEURAL INFORM PR
[10]  
[Anonymous], ARTIFICIAL INTELLIGE