Power-efficient neural network with artificial dendrites

被引:215
作者
Li, Xinyi [1 ]
Tang, Jianshi [1 ,2 ]
Zhang, Qingtian [1 ]
Gao, Bin [1 ,2 ]
Yang, J. Joshua [3 ]
Song, Sen [4 ]
Wu, Wei [1 ]
Zhang, Wenqiang [1 ]
Yao, Peng [1 ]
Deng, Ning [1 ,2 ]
Deng, Lei [5 ]
Xie, Yuan [5 ,6 ]
Qian, He [1 ,2 ]
Wu, Huaqiang [1 ,2 ]
机构
[1] Tsinghua Univ, Beijing Innovat Ctr Future Chips ICFC, Inst Microelect, Beijing, Peoples R China
[2] Tsinghua Univ, Beijing Natl Res Ctr Informat Sci & Technol BNRis, Beijing, Peoples R China
[3] Univ Massachusetts, Dept Elect & Comp Engn, Amherst, MA 01003 USA
[4] Tsinghua Univ, Sch Med, Dept Biomed Engn, Beijing, Peoples R China
[5] Univ Calif Santa Barbara, Dept Elect & Comp Engn, Santa Barbara, CA 93106 USA
[6] Alibaba DAMO Acad, Hangzhou, Peoples R China
基金
中国国家自然科学基金;
关键词
INTEGRATION; CLASSIFICATION; PLASTICITY;
D O I
10.1038/s41565-020-0722-5
中图分类号
TB3 [工程材料学];
学科分类号
0805 ; 080502 ;
摘要
A memristor-based artificial dendrite enables the neural network to perform high-accuracy computation tasks with reduced power consumption. In the nervous system, dendrites, branches of neurons that transmit signals between synapses and soma, play a critical role in processing functions, such as nonlinear integration of postsynaptic signals. The lack of these critical functions in artificial neural networks compromises their performance, for example in terms of flexibility, energy efficiency and the ability to handle complex tasks. Here, by developing artificial dendrites, we experimentally demonstrate a complete neural network fully integrated with synapses, dendrites and soma, implemented using scalable memristor devices. We perform a digit recognition task and simulate a multilayer network using experimentally derived device characteristics. The power consumption is more than three orders of magnitude lower than that of a central processing unit and 70 times lower than that of a typical application-specific integrated circuit chip. This network, equipped with functional dendrites, shows the potential of substantial overall performance improvement, for example by extracting critical information from a noisy background with significantly reduced power consumption and enhanced accuracy.
引用
收藏
页码:776 / +
页数:17
相关论文
共 54 条
[1]   The role of dendrites in auditory coincidence detection [J].
Agmon-Snir, H ;
Carr, CE ;
Rinzel, J .
NATURE, 1998, 393 (6682) :268-272
[2]   Equivalent-accuracy accelerated neural-network training using analogue memory [J].
Ambrogio, Stefano ;
Narayanan, Pritish ;
Tsai, Hsinyu ;
Shelby, Robert M. ;
Boybat, Irem ;
di Nolfo, Carmelo ;
Sidler, Severin ;
Giordano, Massimo ;
Bodini, Martina ;
Farinha, Nathan C. P. ;
Killeen, Benjamin ;
Cheng, Christina ;
Jaoudi, Yassine ;
Burr, Geoffrey W. .
NATURE, 2018, 558 (7708) :60-+
[3]   The Decade of the Dendritic NMDA Spike [J].
Antic, Srdjan D. ;
Zhou, Wen-Liang ;
Moore, Anna R. ;
Short, Shaina M. ;
Ikonomu, Katerina D. .
JOURNAL OF NEUROSCIENCE RESEARCH, 2010, 88 (14) :2991-3001
[4]   Spiking Neural Classifier with Lumped Dendritic Nonlinearity and Binary Synapses: A Current Mode VLSI Implementation and Analysis [J].
Bhaduri, Aritra ;
Banerjee, Amitava ;
Roy, Subhrajit ;
Kar, Sougata ;
Basu, Arindam .
NEURAL COMPUTATION, 2018, 30 (03) :723-760
[5]   Modeling somatic and dendritic spike mediated plasticity at the single neuron and network level [J].
Bono, Jacopo ;
Clopath, Claudia .
NATURE COMMUNICATIONS, 2017, 8
[6]   Dendritic Discrimination of Temporal Input Sequences in Cortical Neurons [J].
Branco, Tiago ;
Clark, Beverley A. ;
Haeusser, Michael .
SCIENCE, 2010, 329 (5999) :1671-1675
[7]   Connectomic Analysis of Brain Networks: Novel Techniques and Future Directions [J].
Cazemier, J. Leonie ;
Clasca, Francisco ;
Tiesinga, Paul H. E. .
FRONTIERS IN NEUROANATOMY, 2016, 10
[8]   Short-Term Memory to Long-Term Memory Transition in a Nanoscale Memristor [J].
Chang, Ting ;
Jo, Sung-Hyun ;
Lu, Wei .
ACS NANO, 2011, 5 (09) :7669-7676
[9]   DeepDriving: Learning Affordance for Direct Perception in Autonomous Driving [J].
Chen, Chenyi ;
Seff, Ari ;
Kornhauser, Alain ;
Xiao, Jianxiong .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :2722-2730
[10]   SiGe epitaxial memory for neuromorphic computing with reproducible high performance based on engineered dislocations [J].
Choi, Shinhyun ;
Tan, Scott H. ;
Li, Zefan ;
Kim, Yunjo ;
Choi, Chanyeol ;
Chen, Pai-Yu ;
Yeon, Hanwool ;
Yu, Shimeng ;
Kim, Jeehwan .
NATURE MATERIALS, 2018, 17 (04) :335-+