Memristor-Based Circuit Design for Multilayer Neural Networks

被引:171
作者
Zhang, Yang [1 ,2 ]
Wang, Xiaoping [1 ]
Friedman, Eby G. [3 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Automat, Wuhan 430074, Hubei, Peoples R China
[2] Shenzhen Univ, Sch Comp Sci & Software Engn, Comp Vis Inst, Shenzhen Key Lab Spatial Smart Sensing & Serv, Shenzhen 518060, Peoples R China
[3] Univ Rochester, Dept Elect & Comp Engn, Rochester, NY 14627 USA
基金
中国国家自然科学基金;
关键词
Memristor; synaptic weight; crossbar array; multilayer neural networks; XOR function; character recognition; NEUROMORPHIC NETWORK; SPICE MODEL; MEMORY; SYSTEM; ARCHITECTURE;
D O I
10.1109/TCSI.2017.2729787
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Memristors are promising components for applications in nonvolatile memory, logic circuits, and neuromorphic computing. In this paper, a novel circuit for memristor-based multilayer neural networks is presented, which can use a single memristor array to realize both the plus and minus weight of the neural synapses. In addition, memristor-based switches are utilized during the learning process to update the weight of the memristor-based synapses. Moreover, an adaptive back propagation algorithm suitable for the proposed memristor-based multilayer neural network is applied to train the neural networks and perform the XOR function and character recognition. Another highlight of this paper is that the robustness of the proposed memristor-based multilayer neural network exhibits higher recognition rates and fewer cycles as compared with other multilayer neural networks.
引用
收藏
页码:677 / 686
页数:10
相关论文
共 48 条
[1]   A Circuit-Based Learning Architecture for Multilayer Neural Networks With Memristor Bridge Synapses [J].
Adhikari, Shyam Prasad ;
Kim, Hyongsuk ;
Budhathoki, Ram Kaji ;
Yang, Changju ;
Chua, Leon O. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2015, 62 (01) :215-223
[2]   Three Fingerprints of Memristor [J].
Adhikari, Shyam Prasad ;
Sah, Maheshwar Pd ;
Kim, Hyongsuk ;
Chua, Leon O. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2013, 60 (11) :3008-3021
[3]   Memristor Bridge Synapse-Based Neural Network and Its Learning [J].
Adhikari, Shyam Prasad ;
Yang, Changju ;
Kim, Hyongsuk ;
Chua, Leon O. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (09) :1426-1435
[4]   Memristor Model Comparison [J].
Ascoli, Alon ;
Corinto, Fernando ;
Senger, Vanessa ;
Tetzlaff, Ronald .
IEEE CIRCUITS AND SYSTEMS MAGAZINE, 2013, 13 (02) :89-105
[5]   A Memristor SPICE Implementation and a New Approach for Magnetic Flux-Controlled Memristor Modeling [J].
Batas, Daniel ;
Fiedler, Horst .
IEEE TRANSACTIONS ON NANOTECHNOLOGY, 2011, 10 (02) :250-255
[6]   Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations [J].
Benjamin, Ben Varkey ;
Gao, Peiran ;
McQuinn, Emmett ;
Choudhary, Swadesh ;
Chandrasekaran, Anand R. ;
Bussat, Jean-Marie ;
Alvarez-Icaza, Rodrigo ;
Arthur, John V. ;
Merolla, Paul A. ;
Boahen, Kwabena .
PROCEEDINGS OF THE IEEE, 2014, 102 (05) :699-716
[7]  
Biolek Z, 2009, RADIOENGINEERING, V18, P210
[8]   Neural Learning Circuits Utilizing Nano-Crystalline Silicon Transistors and Memristors [J].
Cantley, Kurtis D. ;
Subramaniam, Anand ;
Stiegler, Harvey J. ;
Chapman, Richard A. ;
Vogel, Eric M. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (04) :565-573
[9]  
Chabi D, 2014, IEEE INT SYMP NANO, P7, DOI 10.1109/NANOARCH.2014.6880483
[10]   Neuromorphic Hardware System for Visual Pattern Recognition With Memristor Array and CMOS Neuron [J].
Chu, Myonglae ;
Kim, Byoungho ;
Park, Sangsu ;
Hwang, Hyunsang ;
Jeon, Moongu ;
Lee, Byoung Hun ;
Lee, Byung-Geun .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2015, 62 (04) :2410-2419