Evolving Spiking Neural Networks for online learning over drifting data streams

被引:52
作者
Lobo, Jesus L. [1 ]
Lana, Ibai [1 ]
Del Ser, Javier [1 ,2 ,3 ]
Bilbao, Miren Nekane [2 ]
Kasabov, Nikola [4 ]
机构
[1] TECNALIA, Div ICT, Parque Tecnol Bizkaia, Derio 48160, Spain
[2] Univ Basque Country UPV EHU, Bilbao 48013, Spain
[3] BCAM, Bilbao 48009, Spain
[4] Auckland Univ Technol, KEDRI, Auckland 1010, New Zealand
关键词
Spiking Neural Networks; Data reduction; Online learning; Concept drift; SELF-GENERATING PROTOTYPES; PRINCIPLES;
D O I
10.1016/j.neunet.2018.07.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays huge volumes of data are produced in the form of fast streams, which are further affected by non-stationary phenomena. The resulting lack of stationarity in the distribution of the produced data calls for efficient and scalable algorithms for online analysis capable of adapting to such changes (concept drift). The online learning field has lately turned its focus on this challenging scenario, by designing incremental learning algorithms that avoid becoming obsolete after a concept drift occurs. Despite the noted activity in the literature, a need for new efficient and scalable algorithms that adapt to the drift still prevails as a research topic deserving further effort. Surprisingly, Spiking Neural Networks, one of the major exponents of the third generation of artificial neural networks, have not been thoroughly studied as an online learning approach, even though they are naturally suited to easily and quickly adapting to changing environments. This work covers this research gap by adapting Spiking Neural Networks to meet the processing requirements that online learning scenarios impose. In particular the work focuses on limiting the size of the neuron repository and making the most of this limited size by resorting to data reduction techniques. Experiments with synthetic and real data sets are discussed, leading to the empirically validated assertion that, by virtue of a tailored exploitation of the neuron repository, Spiking Neural Networks adapt better to drifts, obtaining higher accuracy scores than naive versions of Spiking Neural Networks for online learning environments. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 74 条
  • [11] Bifet A, 2006, LECT NOTES ARTIF INT, V4265, P29
  • [12] Bifet A, 2009, LECT NOTES ARTIF INT, V5828, P23, DOI 10.1007/978-3-642-05224-8_4
  • [13] Bifet A, 2007, PROCEEDINGS OF THE SEVENTH SIAM INTERNATIONAL CONFERENCE ON DATA MINING, P443
  • [14] Bohte S. M., 2000, 8th European Symposium on Artificial Neural Networks. ESANN"2000. Proceedings, P419
  • [15] Error-backpropagation in temporally encoded networks of spiking neurons
    Bohte, SM
    Kok, JN
    La Poutré, H
    [J]. NEUROCOMPUTING, 2002, 48 : 17 - 37
  • [16] Random forests
    Breiman, L
    [J]. MACHINE LEARNING, 2001, 45 (01) : 5 - 32
  • [17] Cohen E., 2003, Proceedings of the Twenty-Second ACM SIGMOD-SIGACT-SIGART Symposium on Principles of Database Systems, P223
  • [18] Prequential probability: principles and properties
    Dawid, AP
    Vovk, VG
    [J]. BERNOULLI, 1999, 5 (01) : 125 - 162
  • [19] Learning in Nonstationary Environments: A Survey
    Ditzler, Gregory
    Roveri, Manuel
    Alippi, Cesare
    Polikar, Robi
    [J]. IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2015, 10 (04) : 12 - 25
  • [20] A general framework for mining massive data streams
    Domingos, P
    Hulten, G
    [J]. JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2003, 12 (04) : 945 - 949