Training a Multi-Layer Photonic Spiking Neural Network With Modified Supervised Learning Algorithm Based on Photonic STDP

被引:33
作者
Xiang, Shuiying [1 ,2 ]
Ren, Zhenxing [1 ]
Zhang, Yahui [1 ]
Song, Ziwei [1 ]
Guo, Xingxing [1 ]
Han, Genquan [2 ]
Hao, Yue [2 ]
机构
[1] Xidian Univ, State Key Lab Integrated Serv Networks, Xian 710071, Peoples R China
[2] Xidian Univ, Sch Microelect, State Key Discipline Lab Wide Bandgap Semicond Te, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Photonic spiking neural network; vertical-cavity surface-emitting lasers; multi-layer spiking neural network; spike timing dependent plasticity; supervised learning; TIMING-DEPENDENT PLASTICITY; NEUROMORPHIC PHOTONICS; INHIBITORY DYNAMICS; NEURONS; CLASSIFICATION; IMPLEMENTATION; INTELLIGENCE; VCSELS; GAME; GO;
D O I
10.1109/JSTQE.2020.3005589
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
We propose a framework for hardware architecture and learning algorithm co-design of multi-layer photonic spiking neural network (SNN). The vertical-cavity surface-emitting laser with an embedded saturable absorber (VCSEL-SA) which contains two polarization-resolved modes is employed as a spiking neuron. The connection between two identical polarization modes is considered as the excitatory synapse, whereas the connection between two orthogonal polarization modes is regarded as the inhibitory synapse. The physical model of the photonic spiking neuron is derived based on the combination of spin-flip model and Yamada model. The photonic spike timing dependent plasticity (STDP) is applied to design a hardware-friendly biologically plausible supervised learning algorithm for a multi-layer photonic SNN. Thanks to the polarization mode competition effect in the VCSEL-SA, the proposed neuromorphic network is capable of solving the classical XOR problem. The effect of physical parameters of photonic neuron on the training convergence is also considered. We further extend the multi-layer photonic SNN to realize other logic learning tasks. To the best of our knowledge, such a modified supervised learning algorithm dedicated for a multi-layer photonic SNN has not yet been reported, which is interesting for spiking learning of neuromorphic photonics.
引用
收藏
页数:9
相关论文
共 71 条
  • [51] Mastering the game of Go without human knowledge
    Silver, David
    Schrittwieser, Julian
    Simonyan, Karen
    Antonoglou, Ioannis
    Huang, Aja
    Guez, Arthur
    Hubert, Thomas
    Baker, Lucas
    Lai, Matthew
    Bolton, Adrian
    Chen, Yutian
    Lillicrap, Timothy
    Hui, Fan
    Sifre, Laurent
    van den Driessche, George
    Graepel, Thore
    Hassabis, Demis
    [J]. NATURE, 2017, 550 (7676) : 354 - +
  • [52] Mastering the game of Go with deep neural networks and tree search
    Silver, David
    Huang, Aja
    Maddison, Chris J.
    Guez, Arthur
    Sifre, Laurent
    van den Driessche, George
    Schrittwieser, Julian
    Antonoglou, Ioannis
    Panneershelvam, Veda
    Lanctot, Marc
    Dieleman, Sander
    Grewe, Dominik
    Nham, John
    Kalchbrenner, Nal
    Sutskever, Ilya
    Lillicrap, Timothy
    Leach, Madeleine
    Kavukcuoglu, Koray
    Graepel, Thore
    Hassabis, Demis
    [J]. NATURE, 2016, 529 (7587) : 484 - +
  • [53] Spike Sequence Learning in a Photonic Spiking Neural Network Consisting of VCSELs-SA With Supervised Training
    Song, Ziwei
    Xiang, Shuiying
    Ren, Zhenxing
    Han, Genquan
    Hao, Yue
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS, 2020, 26 (05)
  • [54] Supervised Learning in Multilayer Spiking Neural Networks
    Sporea, Ioana
    Gruening, Andre
    [J]. NEURAL COMPUTATION, 2013, 25 (02) : 473 - 509
  • [55] A review of learning in biologically plausible spiking neural networks
    Taherkhani, Aboozar
    Belatreche, Ammar
    Li, Yuhua
    Cosma, Georgina
    Maguire, Liam P.
    McGinnity, T. M.
    [J]. NEURAL NETWORKS, 2020, 122 : 253 - 272
  • [56] Silicon Photonic Modulator Neuron
    Tait, Alexander N.
    de Lima, Thomas Ferreira
    Nahmias, Mitchell A.
    Miller, Heidi B.
    Peng, Hsuan-Tung
    Shastri, Bhavin J.
    Prucnal, Paul R.
    [J]. PHYSICAL REVIEW APPLIED, 2019, 11 (06):
  • [57] Deep learning in spiking neural networks
    Tavanaei, Amirhossein
    Ghodrati, Masoud
    Kheradpisheh, Saeed Reza
    Masquelier, Timothee
    Maida, Anthony
    [J]. NEURAL NETWORKS, 2019, 111 : 47 - 63
  • [58] Photonic Implementation of Spike-Timing-Dependent Plasticity and Learning Algorithms of Biological Neural Systems
    Toole, Ryan
    Tait, Alexander N.
    de Lima, Thomas Ferreira
    Nahmias, Mitchell A.
    Shastri, Bhavin J.
    Prucnal, Paul R.
    Fok, Mable P.
    [J]. JOURNAL OF LIGHTWAVE TECHNOLOGY, 2016, 34 (02) : 470 - 476
  • [59] Photonic implementation of a neuronal algorithm applicable towards angle of arrival detection and localization
    Toole, Ryan
    Fok, Mable P.
    [J]. OPTICS EXPRESS, 2015, 23 (12): : 16133 - 16141
  • [60] Fully memristive neural networks for pattern classification with unsupervised learning
    Wang, Zhongrui
    Joshi, Saumil
    Savel'ev, Sergey
    Song, Wenhao
    Midya, Rivu
    Li, Yunning
    Rao, Mingyi
    Yan, Peng
    Asapu, Shiva
    Zhuo, Ye
    Jiang, Hao
    Lin, Peng
    Li, Can
    Yoon, Jung Ho
    Upadhyay, Navnidhi K.
    Zhang, Jiaming
    Hu, Miao
    Strachan, John Paul
    Barnell, Mark
    Wu, Qing
    Wu, Huaqiang
    Williams, R. Stanley
    Xia, Qiangfei
    Yang, J. Joshua
    [J]. NATURE ELECTRONICS, 2018, 1 (02): : 137 - 145