An all-optical neuron with sigmoid activation function

被引：172
作者：
Mourgias-Alexandris, G. [1 ,2 ]
Tsakyridis, A. [1 ,2 ]
Passalis, N. [1 ]
Tefas, A. [1 ]
Vyrsokinos, K. [2 ,3 ]
Pleros, N. [1 ,2 ]
机构：
[1] Aristotle Univ Thessaloniki, Dept Informat, Thessaloniki 54124, Greece
[2] Balkan Ctr, Ctr Interdisciplinary Res & Innovat CIRI AUTH, Bldg A&B,10th Km Thessaloniki Therrni Rd,POB 8318, GR-57001 Thessaloniki, Greece
[3] Aristotle Univ Thessaloniki, Dept Phys, Thessaloniki 54124, Greece
来源：
OPTICS EXPRESS | 2019年 / 27卷 / 07期
基金：
欧盟地平线“2020”;
关键词：
INTERFEROMETER;
D O I：
10.1364/OE.27.009620
中图分类号：
O43 [光学];
学科分类号：
070207 ; 0803 ;
摘要：
We present an all-optical neuron that utilizes a logistic sigmoid activation function, using a Wavelength-Division Multiplexing (WDM) input & weighting scheme. The activation function is realized by means of a deeply-saturated differentially-biased Semiconductor Optical Amplifier-Mach-Zehnder Interferometer (SOA-MZI) followed by a SOA-Cross-Gain-Modulation (XGM) gate. Its transfer function is both experimentally and theoretically analyzed, showing excellent agreement between theory and experiment and an almost perfect fitting with a logistic sigmoid function. The optical sigmoid transfer function is then exploited in the experimental demonstration of a photonic neuron, demonstrating successful thresholding over a 100psec-long pulse sequence with 4 different weighted-and-summed power levels. (C) 2019 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
引用
收藏
页码：9620 / 9630
页数：11
相关论文
共 32 条
[1]   True North: Design and Tool Flow of a 65 mW 1 Million Neuron Programmable Neurosynaptic Chip [J].
Akopyan, Filipp ;
Sawada, Jun ;
Cassidy, Andrew ;
Alvarez-Icaza, Rodrigo ;
Arthur, John ;
Merolla, Paul ;
Imam, Nabil ;
Nakamura, Yutaka ;
Datta, Pallab ;
Nam, Gi-Joon ;
Taba, Brian ;
Beakes, Michael ;
Brezzo, Bernard ;
Kuang, Jente B. ;
Manohar, Rajit ;
Risk, William P. ;
Jackson, Bryan ;
Modha, Dharmendra S. .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2015, 34 (10) :1537-1557
[2]  
[Anonymous], 2011, P 14 INT C ARTIFICIA
[3]   Toward Fast Neural Computing using All-Photonic Phase Change Spiking Neurons [J].
Chakraborty, Indranil ;
Saha, Gobinda ;
Sengupta, Abhronil ;
Roy, Kaushik .
SCIENTIFIC REPORTS, 2018, 8
[4]   Overview of the SpiNNaker System Architecture [J].
Furber, Steve B. ;
Lester, David R. ;
Plana, Luis A. ;
Garside, Jim D. ;
Painkras, Eustace ;
Temple, Steve ;
Brown, Andrew D. .
IEEE TRANSACTIONS ON COMPUTERS, 2013, 62 (12) :2454-2467
[5]  
George J., 2018, ADV PHOTONICS 2018 B
[6]  
Gregor K, 2015, PR MACH LEARN RES, V37, P1462
[7]  
Hochreiter S, 1997, NEURAL COMPUT, V9, P1735, DOI [10.1162/neco.1997.9.8.1735, 10.1007/978-3-642-24797-2, 10.1162/neco.1997.9.1.1]
[8]   Neuromorphic Photonic Integrated Circuits [J].
Peng, Hsuan-Tung ;
Nahmias, Mitchell A. ;
de Lima, Thomas Ferreira ;
Tait, Alexander N. ;
Shastri, Bhavin J. ;
Prucnal, Paul R. .
IEEE JOURNAL OF SELECTED TOPICS IN QUANTUM ELECTRONICS, 2018, 24 (06)
[9]   In-Datacenter Performance Analysis of a Tensor Processing Unit [J].
Jouppi, Norman P. ;
Young, Cliff ;
Patil, Nishant ;
Patterson, David ;
Agrawal, Gaurav ;
Bajwa, Raminder ;
Bates, Sarah ;
Bhatia, Suresh ;
Boden, Nan ;
Borchers, Al ;
Boyle, Rick ;
Cantin, Pierre-luc ;
Chao, Clifford ;
Clark, Chris ;
Coriell, Jeremy ;
Daley, Mike ;
Dau, Matt ;
Dean, Jeffrey ;
Gelb, Ben ;
Ghaemmaghami, Tara Vazir ;
Gottipati, Rajendra ;
Gulland, William ;
Hagmann, Robert ;
Ho, C. Richard ;
Hogberg, Doug ;
Hu, John ;
Hundt, Robert ;
Hurt, Dan ;
Ibarz, Julian ;
Jaffey, Aaron ;
Jaworski, Alek ;
Kaplan, Alexander ;
Khaitan, Harshit ;
Killebrew, Daniel ;
Koch, Andy ;
Kumar, Naveen ;
Lacy, Steve ;
Laudon, James ;
Law, James ;
Le, Diemthu ;
Leary, Chris ;
Liu, Zhuyuan ;
Lucke, Kyle ;
Lundin, Alan ;
MacKean, Gordon ;
Maggiore, Adriana ;
Mahony, Maire ;
Miller, Kieran ;
Nagarajan, Rahul ;
Narayanaswami, Ravi .
44TH ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA 2017), 2017, :1-12
[10]  
Kim Yoon, 2017, Structured attention networks
1234