Memristor Based Binary Convolutional Neural Network Architecture With Configurable Neurons

被引:30
作者
Huang, Lixing [1 ]
Diao, Jietao [1 ]
Nie, Hongshan [2 ]
Wang, Wei [1 ]
Li, Zhiwei [1 ]
Li, Qingjiang [1 ]
Liu, Haijun [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha, Peoples R China
[2] Hunan Univ, Coll Elect & Informat Engn, Changsha, Peoples R China
基金
中国国家自然科学基金;
关键词
memristor; binarized neural networks; convolutional neural networks; device defects effect; configurable neuron; neuromorphic computing; ARRAY;
D O I
10.3389/fnins.2021.639526
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The memristor-based convolutional neural network (CNN) gives full play to the advantages of memristive devices, such as low power consumption, high integration density, and strong network recognition capability. Consequently, it is very suitable for building a wearable embedded application system and has broad application prospects in image classification, speech recognition, and other fields. However, limited by the manufacturing process of memristive devices, high-precision weight devices are currently difficult to be applied in large-scale. In the same time, high-precision neuron activation function also further increases the complexity of network hardware implementation. In response to this, this paper proposes a configurable full-binary convolutional neural network (CFB-CNN) architecture, whose inputs, weights, and neurons are all binary values. The neurons are proportionally configured to two modes for different non-ideal situations. The architecture performance is verified based on the MNIST data set, and the influence of device yield and resistance fluctuations under different neuron configurations on network performance is also analyzed. The results show that the recognition accuracy of the 2-layer network is about 98.2%. When the yield rate is about 64% and the hidden neuron mode is configured as -1 and +1, namely +/- 1 MD, the CFB-CNN architecture achieves about 91.28% recognition accuracy. Whereas the resistance variation is about 26% and the hidden neuron mode configuration is 0 and 1, namely 01 MD, the CFB-CNN architecture gains about 93.43% recognition accuracy. Furthermore, memristors have been demonstrated as one of the most promising devices in neuromorphic computing for its synaptic plasticity. Therefore, the CFB-CNN architecture based on memristor is SNN-compatible, which is verified using the number of pulses to encode pixel values in this paper.
引用
收藏
页数:14
相关论文
共 22 条
[1]   Neuromorphic computing with multi-memristive synapses [J].
Boybat, Irem ;
Le Gallo, Manuel ;
Nandakumar, S. R. ;
Moraitis, Timoleon ;
Parnell, Thomas ;
Tuma, Tomas ;
Rajendran, Bipin ;
Leblebici, Yusuf ;
Sebastian, Abu ;
Eleftheriou, Evangelos .
NATURE COMMUNICATIONS, 2018, 9
[2]  
Girshick R., 2015, arXiv preprint, arXiv:1504.08083
[3]   Memristor Crossbar-Based Neuromorphic Computing System: A Case Study [J].
Hu, Miao ;
Li, Hai ;
Chen, Yiran ;
Wu, Qing ;
Rose, Garrett S. ;
Linderman, Richard W. .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (10) :1864-1878
[4]  
Hubara I, 2018, J MACH LEARN RES, V18
[5]   Memristor Binarized Neural Networks [J].
Khoa Van Pham ;
Tien Van Nguyen ;
Son Bao Tran ;
Nam, Hyunkyung ;
Lee, Mi Jung ;
Choi, Byung Joon ;
Son Ngoc Truong ;
Min, Kyeong-Sik .
JOURNAL OF SEMICONDUCTOR TECHNOLOGY AND SCIENCE, 2018, 18 (05) :568-577
[6]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[7]  
Li H., 2017, P 2017 54 ACM EDAC I
[8]   Design of Ternary Neural Network With 3-D Vertical RRAM Array [J].
Li, Zhiwei ;
Chen, Pai-Yu ;
Xu, Hui ;
Yu, Shimeng .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 2017, 64 (06) :2721-2727
[9]   Highly improved resistive switching performances of the self-doped Pt/HfO2:Cu/Cu devices by atomic layer deposition [J].
Liu, Sen ;
Wang, Wei ;
Li, QingJiang ;
Zhao, XiaoLong ;
Li, Nan ;
Xu, Hui ;
Liu, Qi ;
Liu, Ming .
SCIENCE CHINA-PHYSICS MECHANICS & ASTRONOMY, 2016, 59 (12)
[10]   NEUROMORPHIC ELECTRONIC SYSTEMS [J].
MEAD, C .
PROCEEDINGS OF THE IEEE, 1990, 78 (10) :1629-1636