A Photoelectric Spiking Neuron for Visual Depth Perception

被引:113
作者
Chen, Chunsheng [1 ,2 ]
He, Yongli [1 ,2 ]
Mao, Huiwu [1 ,2 ]
Zhu, Li [1 ,2 ]
Wang, Xiangjing [1 ,2 ]
Zhu, Ying [1 ,2 ]
Zhu, Yixin [1 ,2 ]
Shi, Yi [1 ,2 ]
Wan, Changjin [1 ,2 ]
Wan, Qing [1 ,2 ]
机构
[1] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210093, Peoples R China
[2] Nanjing Univ, Collaborat Innovat Ctr Adv Microstruct, Nanjing 210093, Peoples R China
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
artificial visual systems; leaky integrate-and-fire neurons; photoelectric spiking neuron; TaOX memristors; NETWORK; MODEL;
D O I
10.1002/adma.202201895
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
The biological visual system encodes optical information into spikes and processes them by the neural network, which enables the perception with high throughput of visual processing with ultralow energy budget. This has inspired a wide spectrum of devices to imitate such neural process, while precise mimicking such procedure is still highly required. Here, a highly bio-realistic photoelectric spiking neuron for visual depth perception is presented. The firing spikes generated by the TaOX memristive spiking encoders have a biologically similar frequency range of 1-200 Hz and sub-micro watts power. Such spiking encoder is integrated with a photodetector and a network of neuromorphic transistors, for information collection and recognition tasks, respectively. The distance-dependent response and eye fatigue of biological visual systems have been mimicked based on such photoelectric spiking neuron. The simulated depth perception shows a recognition improvement by adapting to sights at different distances. The results can advance the technologies in bioinspired or robotic systems that may be endowed with depth perception and power efficiency at the same time.
引用
收藏
页数:9
相关论文
共 43 条
[1]   Synaptic computation [J].
Abbott, LF ;
Regehr, WG .
NATURE, 2004, 431 (7010) :796-803
[2]   A bioinspired optoelectronically engineered artificial neurorobotics device with sensorimotor functionalities [J].
Akbari, Mohammad Karbalaei ;
Zhuiykov, Serge .
NATURE COMMUNICATIONS, 2019, 10 (1)
[3]   Artificial Shape Perception Retina Network Based on Tunable Memristive Neurons [J].
Bao, Lin ;
Kang, Jian ;
Fang, Yichen ;
Yu, Zhizhen ;
Wang, Zongwei ;
Yang, Yuchao ;
Cai, Yimao ;
Huang, Ru .
SCIENTIFIC REPORTS, 2018, 8
[4]   A review of the integrate-and-fire neuron model: I. Homogeneous synaptic input [J].
Burkitt, A. N. .
BIOLOGICAL CYBERNETICS, 2006, 95 (01) :1-19
[5]   An Artificial Flexible Visual Memory System Based on an UV-Motivated Memristor [J].
Chen, Shuai ;
Lou, Zheng ;
Chen, Di ;
Shen, Guozhen .
ADVANCED MATERIALS, 2018, 30 (07)
[6]   Emerging Memristive Artificial Synapses and Neurons for Energy-Efficient Neuromorphic Computing [J].
Choi, Sanghyeon ;
Yang, Jehyeon ;
Wang, Gunuk .
ADVANCED MATERIALS, 2020, 32 (51)
[7]   Nonvolatile programmable silicon photonics using an ultralow-loss Sb2Se3 phase change material [J].
Delaney, Matthew ;
Zeimpekis, Ioannis ;
Du, Han ;
Yan, Xingzhao ;
Banakar, Mehdi ;
Thomson, David J. ;
Hewak, Daniel W. ;
Muskens, Otto L. .
SCIENCE ADVANCES, 2021, 7 (25)
[8]   NbOx based oscillation neuron for neuromorphic computing [J].
Gao, Ligang ;
Chen, Pai-Yu ;
Yu, Shimeng .
APPLIED PHYSICS LETTERS, 2017, 111 (10)
[9]   SPIKING NEURAL NETWORKS [J].
Ghosh-Dastidar, Samanwoy ;
Adeli, Hojjat .
INTERNATIONAL JOURNAL OF NEURAL SYSTEMS, 2009, 19 (04) :295-308
[10]   A Single Transistor Neuron With Independently Accessed Double-Gate for Excitatory-Inhibitory Function and Tunable Firing Threshold Voltage [J].
Han, Joon-Kyu ;
Seo, Myungsoo ;
Yu, Ji-Man ;
Suh, Yoon-Je ;
Choi, Yang-Kyu .
IEEE ELECTRON DEVICE LETTERS, 2020, 41 (08) :1157-1160