Training a Multi-Layer Photonic Spiking Neural Network With Modified Supervised Learning Algorithm Based on Photonic STDP

被引:33
作者
Xiang, Shuiying [1 ,2 ]
Ren, Zhenxing [1 ]
Zhang, Yahui [1 ]
Song, Ziwei [1 ]
Guo, Xingxing [1 ]
Han, Genquan [2 ]
Hao, Yue [2 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Microelect, State Key Discipline Lab Wide Bandgap Semicond Te, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Photonic spiking neural network; vertical-cavity surface-emitting lasers; multi-layer spiking neural network; spike timing dependent plasticity; supervised learning; TIMING-DEPENDENT PLASTICITY; NEUROMORPHIC PHOTONICS; INHIBITORY DYNAMICS; NEURONS; CLASSIFICATION; IMPLEMENTATION; INTELLIGENCE; VCSELS; GAME; GO;
D O I
10.1109/JSTQE.2020.3005589
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a framework for hardware architecture and learning algorithm co-design of multi-layer photonic spiking neural network (SNN). The vertical-cavity surface-emitting laser with an embedded saturable absorber (VCSEL-SA) which contains two polarization-resolved modes is employed as a spiking neuron. The connection between two identical polarization modes is considered as the excitatory synapse, whereas the connection between two orthogonal polarization modes is regarded as the inhibitory synapse. The physical model of the photonic spiking neuron is derived based on the combination of spin-flip model and Yamada model. The photonic spike timing dependent plasticity (STDP) is applied to design a hardware-friendly biologically plausible supervised learning algorithm for a multi-layer photonic SNN. Thanks to the polarization mode competition effect in the VCSEL-SA, the proposed neuromorphic network is capable of solving the classical XOR problem. The effect of physical parameters of photonic neuron on the training convergence is also considered. We further extend the multi-layer photonic SNN to realize other logic learning tasks. To the best of our knowledge, such a modified supervised learning algorithm dedicated for a multi-layer photonic SNN has not yet been reported, which is interesting for spiking learning of neuromorphic photonics.
引用
收藏
页数:9
相关论文
共 71 条
  • [1] Synaptic plasticity: taming the beast
    Abbott, L. F.
    Nelson, Sacha B.
    [J]. NATURE NEUROSCIENCE, 2000, 3 (11) : 1178 - 1183
  • [2] [Anonymous], 2017, A Survey of Neuromorphic Computing and Neural Networks in Hardware"
  • [3] Synaptic modification by correlated activity: Hebb's postulate revisited
    Bi, GQ
    Poo, MM
    [J]. ANNUAL REVIEW OF NEUROSCIENCE, 2001, 24 : 139 - 166
  • [4] Synaptic modifications in cultured hippocampal neurons: Dependence on spike timing, synaptic strength, and postsynaptic cell type
    Bi, GQ
    Poo, MM
    [J]. JOURNAL OF NEUROSCIENCE, 1998, 18 (24) : 10464 - 10472
  • [5] Error-backpropagation in temporally encoded networks of spiking neurons
    Bohte, SM
    Kok, JN
    La Poutré, H
    [J]. NEUROCOMPUTING, 2002, 48 : 17 - 37
  • [6] Neuromorphic computing with multi-memristive synapses
    Boybat, Irem
    Le Gallo, Manuel
    Nandakumar, S. R.
    Moraitis, Timoleon
    Parnell, Thomas
    Tuma, Tomas
    Rajendran, Bipin
    Leblebici, Yusuf
    Sebastian, Abu
    Eleftheriou, Evangelos
    [J]. NATURE COMMUNICATIONS, 2018, 9
  • [7] Photonic In-Memory Computing Primitive for Spiking Neural Networks Using Phase-Change Materials
    Chakraborty, Indranil
    Saha, Gobinda
    Roy, Kaushik
    [J]. PHYSICAL REVIEW APPLIED, 2019, 11 (01):
  • [8] On-chip photonic synapse
    Cheng, Zengguang
    Rios, Carlos
    Pernice, Wolfram H. P.
    Wright, C. David
    Bhaskaran, Harish
    [J]. SCIENCE ADVANCES, 2017, 3 (09):
  • [9] Loihi: A Neuromorphic Manycore Processor with On-Chip Learning
    Davies, Mike
    Srinivasa, Narayan
    Lin, Tsung-Han
    Chinya, Gautham
    Cao, Yongqiang
    Choday, Sri Harsha
    Dimou, Georgios
    Joshi, Prasad
    Imam, Nabil
    Jain, Shweta
    Liao, Yuyun
    Lin, Chit-Kwan
    Lines, Andrew
    Liu, Ruokun
    Mathaikutty, Deepak
    Mccoy, Steve
    Paul, Arnab
    Tse, Jonathan
    Venkataramanan, Guruguhanathan
    Weng, Yi-Hsin
    Wild, Andreas
    Yang, Yoonseok
    Wang, Hong
    [J]. IEEE MICRO, 2018, 38 (01) : 82 - 99
  • [10] Machine Learning With Neuromorphic Photonics
    de Lima, Thomas Ferreira
    Peng, Hsuan-Tung
    Tait, Alexander N.
    Nahmias, Mitchell A.
    Miller, Heidi B.
    Shastri, Bhavin J.
    Prucnal, Paul R.
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2019, 37 (05) : 1515 - 1534