Hardware Friendly Probabilistic Spiking Neural Network With Long-Term and Short-Term Plasticity

被引:14
作者
Hsieh, Hung-Yi [1 ]
Tang, Kea-Tiong [1 ]
机构
[1] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
关键词
Gradient descent learning; hardware compatible; Hebbian learning; probabilistic spiking neural network; resolution requirement reduction; short-term plasticity; ELECTRONIC NOSE; SAR ADC; CLASSIFICATION; NEURONS; ARRAY; IMPLEMENTATION; SYSTEM;
D O I
10.1109/TNNLS.2013.2271644
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a probabilistic spiking neural network (PSNN) with unimodal weight distribution, possessing long-and short-term plasticity. The proposed algorithm is derived by both the arithmetic gradient decent calculation and bioinspired algorithms. The algorithm is benchmarked by the Iris and Wisconsin breast cancer (WBC) data sets. The network features fast convergence speed and high accuracy. In the experiment, the PSNN took not more than 40 epochs for convergence. The average testing accuracy for Iris and WBC data is 96.7% and 97.2%, respectively. To test the usefulness of the PSNN to real world application, the PSNN was also tested with the odor data, which was collected by our self-developed electronic nose (e-nose). Compared with the algorithm (K-nearest neighbor) that has the highest classification accuracy in the e-nose for the same odor data, the classification accuracy of the PSNN is only 1.3% less but the memory requirement can be reduced at least 40%. All the experiments suggest that the PSNN is hardware friendly. First, it requires only nine-bits weight resolution for training and testing. Second, the PSNN can learn complex data sets with a little number of neurons that in turn reduce the cost of VLSI implementation. In addition, the algorithm is insensitive to synaptic noise and the parameter variation induced by the VLSI fabrication. Therefore, the algorithm can be implemented by either software or hardware, making it suitable for wider application.
引用
收藏
页码:2063 / 2074
页数:12
相关论文
共 47 条
[1]   Synaptic computation [J].
Abbott, LF ;
Regehr, WG .
NATURE, 2004, 431 (7010) :796-803
[2]   Implementation of Biologically Plausible Spiking Neural Network Models On the Memristor Crossbar-based CMOS/Nano Circuits [J].
Afifi, A. ;
Ayatollahi, A. ;
Raissi, F. .
2009 EUROPEAN CONFERENCE ON CIRCUIT THEORY AND DESIGN, VOLS 1 AND 2, 2009, :563-+
[3]  
[Anonymous], IEEE ISSCC
[4]  
[Anonymous], P IEEE INT S CIRC SY
[5]  
[Anonymous], IEEE T NEURAL NETW
[6]   Point-to-point connectivity between neuromorphic chips using address events [J].
Boahen, KA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2000, 47 (05) :416-434
[7]   Error-backpropagation in temporally encoded networks of spiking neurons [J].
Bohte, SM ;
Kok, JN ;
La Poutré, H .
NEUROCOMPUTING, 2002, 48 :17-37
[8]   AN ANALOG NEURAL NETWORK PROCESSOR WITH PROGRAMMABLE TOPOLOGY [J].
BOSER, BE ;
SACKINGER, E ;
BROMLEY, J ;
LECUN, Y ;
JACKEL, LD .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1991, 26 (12) :2017-2025
[9]   Learning real-world stimuli in a neural network with spike-driven synaptic dynamics [J].
Brader, Joseph M. ;
Senn, Walter ;
Fusi, Stefano .
NEURAL COMPUTATION, 2007, 19 (11) :2881-2912
[10]   Real-Time Simulation of Biologically Realistic Stochastic Neurons in VLSI [J].
Chen, Hsin ;
Saighi, Sylvain ;
Buhry, Laure ;
Renaud, Sylvie .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (09) :1511-1517