Perceptrons from memristors

被引:20
作者
Silva, Francisco [1 ]
Sanz, Mikel [2 ]
Seixas, Joao [1 ,3 ,4 ,5 ]
Solano, Enrique [2 ,6 ,7 ,8 ]
Omar, Yasser [1 ,3 ]
机构
[1] Inst Telecomunicacoes, Phys Informat & Quantum Technol Grp, Aveiro, Portugal
[2] Univ Basque Country, UPV EHU, Dept Phys Chem, Apartado 644, E-48080 Bilbao, Spain
[3] Univ Lisbon, Inst Super Tecn, Lisbon, Portugal
[4] Univ Lisbon, Inst Super Tecn, CeFEMA, Lisbon, Portugal
[5] Lab Instrumentacao & Fis Expt Particulas LIP, Lisbon, Portugal
[6] Ikerbasque, Basque Fdn Sci, Maria Diaz Haro 3, Bilbao 48013, Spain
[7] Shanghai Univ, Int Ctr Quantum Artificial Intelligence Sci & Tec, Shanghai 200444, Peoples R China
[8] Shanghai Univ, Dept Phys, Shanghai 200444, Peoples R China
基金
欧盟地平线“2020”;
关键词
Perceptron; Memristor; Backpropagation; Delta rule; Neural network; NEURAL-NETWORKS; BEHAVIOR; DESIGN;
D O I
10.1016/j.neunet.2019.10.013
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Memristors, resistors with memory whose outputs depend on the history of their inputs, have been used with success in neuromorphic architectures, particularly as synapses and non-volatile memories. However, to the best of our knowledge, no model for a network in which both the synapses and the neurons are implemented using memristors has been proposed so far. In the present work we introduce models for single and multilayer perceptrons based exclusively on memristors. We adapt the delta rule to the memristor-based single-layer perceptron and the backpropagation algorithm to the memristor-based multilayer perceptron. Our results show that both perform as expected for perceptrons, including satisfying Minsky-Papert's theorem. As a consequence of the Universal Approximation Theorem, they also show that memristors are universal function approximators. By using memristors for both the neurons and the synapses, our models pave the way for novel memristor-based neural network architectures and algorithms. A neural network based on memristors could show advantages in terms of energy conservation and open up possibilities for other learning systems to be adapted to a memristor-based paradigm, both in the classical and quantum learning realms. (c) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:273 / 278
页数:6
相关论文
共 45 条
[1]   Memristor Bridge Synapse-Based Neural Network and Its Learning [J].
Adhikari, Shyam Prasad ;
Yang, Changju ;
Kim, Hyongsuk ;
Chua, Leon O. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (09) :1426-1435
[2]  
[Anonymous], MATH PROBLEMS ENG
[3]  
[Anonymous], 2010, JMLR WORKSH C P
[4]  
[Anonymous], SCI REPORTS
[5]   SWITCHING PHENOMENA IN TITANIUM OXIDE THIN FILMS [J].
ARGALL, F .
SOLID-STATE ELECTRONICS, 1968, 11 (05) :535-&
[6]   Composite Behavior of Multiple Memristor Circuits [J].
Budhathoki, Ram Kaji ;
Sah, Maheshwar Pd. ;
Adhikari, Shyam Prasad ;
Kim, Hyongsuk ;
Chua, Leon .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2013, 60 (10) :2688-2700
[7]  
Chakrabarti B., 2017, ICCAD-IEEE ACM INT, DOI 10.1109/ICCAD.2017.8203825
[8]   MEMRISTOR - MISSING CIRCUIT ELEMENT [J].
CHUA, LO .
IEEE TRANSACTIONS ON CIRCUIT THEORY, 1971, CT18 (05) :507-+
[9]  
Cybenko G., 1989, Mathematics of Control, Signals, and Systems, V2, P303, DOI 10.1007/BF02551274
[10]   Hardware elementary perceptron based on polyaniline memristive devices [J].
Demin, V. A. ;
Erokhin, V. V. ;
Emelyanov, A. V. ;
Battistoni, S. ;
Baldi, G. ;
Iannotta, S. ;
Kashkarov, P. K. ;
Kovalchuk, M. V. .
ORGANIC ELECTRONICS, 2015, 25 :16-20