Evolving Spiking Neural Networks for online learning over drifting data streams

被引:52
作者
Lobo, Jesus L. [1 ]
Lana, Ibai [1 ]
Del Ser, Javier [1 ,2 ,3 ]
Bilbao, Miren Nekane [2 ]
Kasabov, Nikola [4 ]
机构
[1] TECNALIA, Div ICT, Parque Tecnol Bizkaia, Derio 48160, Spain
[2] Univ Basque Country UPV EHU, Bilbao 48013, Spain
[3] BCAM, Bilbao 48009, Spain
[4] Auckland Univ Technol, KEDRI, Auckland 1010, New Zealand
关键词
Spiking Neural Networks; Data reduction; Online learning; Concept drift; SELF-GENERATING PROTOTYPES; PRINCIPLES;
D O I
10.1016/j.neunet.2018.07.014
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Nowadays huge volumes of data are produced in the form of fast streams, which are further affected by non-stationary phenomena. The resulting lack of stationarity in the distribution of the produced data calls for efficient and scalable algorithms for online analysis capable of adapting to such changes (concept drift). The online learning field has lately turned its focus on this challenging scenario, by designing incremental learning algorithms that avoid becoming obsolete after a concept drift occurs. Despite the noted activity in the literature, a need for new efficient and scalable algorithms that adapt to the drift still prevails as a research topic deserving further effort. Surprisingly, Spiking Neural Networks, one of the major exponents of the third generation of artificial neural networks, have not been thoroughly studied as an online learning approach, even though they are naturally suited to easily and quickly adapting to changing environments. This work covers this research gap by adapting Spiking Neural Networks to meet the processing requirements that online learning scenarios impose. In particular the work focuses on limiting the size of the neuron repository and making the most of this limited size by resorting to data reduction techniques. Experiments with synthetic and real data sets are discussed, leading to the empirically validated assertion that, by virtue of a tailored exploitation of the neuron repository, Spiking Neural Networks adapt better to drifts, obtaining higher accuracy scores than naive versions of Spiking Neural Networks for online learning environments. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1 / 19
页数:19
相关论文
共 74 条
  • [1] Aggarwal C.C., 2006, P 32 INT C VER LARG, P607
  • [2] Alippi C, 2014, Intelligence for Embedded Systems: A Methodological Approach
  • [3] Just-in-Time Adaptive Classifiers-Part II: Designing the Classifier
    Alippi, Cesare
    Roveri, Manuel
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (12): : 2053 - 2064
  • [4] A Spiking Neural Network with Dynamic Memory for a Real Autonomous Mobile Robot in Dynamic Environment
    Alnajjar, Fady
    Zin, Indra Bin Mohd
    Murase, Kazuyuki
    [J]. 2008 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-8, 2008, : 2207 - +
  • [5] [Anonymous], 2010, MEMET COMPUT, DOI DOI 10.1007/S12293-010-0048-1
  • [6] [Anonymous], 2018, EVOL SYST-GER, DOI DOI 10.1007/s12530-016-9168-2
  • [7] [Anonymous], 2002, SPIKING NEURON MODEL
  • [8] Baena-Garcia M., 2006, P 4 ECML PKDD INT WO, P77, DOI DOI 10.1007/978-3-642-23857-4_12
  • [9] A survey on feature drift adaptation: Definition, benchmark, challenges and future directions
    Barddal, Jean Paul
    Gomes, Heitor Murilo
    Enembreck, Fabricio
    Pfahringer, Bernhard
    [J]. JOURNAL OF SYSTEMS AND SOFTWARE, 2017, 127 : 278 - 294
  • [10] Belatreche A, 2007, SOFT COMPUT, V11, P239, DOI [10.1007/s00500-006-0065-7, 10.1007/S00500-006-0065-7]