On-chip adaptive matching learning with charge-trap synapse device and ReLU activation circuit

被引:12
作者
Ahn, Ji-Hoon [1 ]
Choi, Hyun-Seok [1 ]
Kim, Jung Nam [1 ]
Park, Byung-Gook [2 ,3 ]
Kim, Sungjun [4 ]
Lee, Jaehong [5 ]
Kim, Yoon [1 ]
机构
[1] Univ Seoul, Sch Elect & Comp Engn, Seoul 02504, South Korea
[2] Seoul Natl Univ, Dept Elect Engn & Comp Sci, Seoul 08826, South Korea
[3] Seoul Natl Univ, Inter Univ Semicond Res Ctr, Seoul 08826, South Korea
[4] Dongguk Univ, Div Elect & Elect Engn, Seoul 04620, South Korea
[5] Samsung Elect Co Ltd, Hwasung 445701, South Korea
基金
新加坡国家研究基金会;
关键词
Neuromorphic; On-chip learning; On-chip training; FLASH; NETWORK;
D O I
10.1016/j.sse.2021.108177
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
For the hardware implementation of artificial intelligence, neuromorphic systems have major advantages in terms of their energy consumption and massively parallel operation compared to conventional computing systems. For general-purpose neuromorphic systems, the on-chip learning of large-scale deep neural networks (DNN) is an essential function. However, compared to a backpropagation algorithm of DNN, an on-chip learning technology, which can be efficiently implemented in hardware without accuracy degradation, has not yet been developed. Consequently, off-chip learning-based neuromorphic systems that perform only inference operations are a promising approach to the first step in the commercialization of neuromorphic systems. To address the limitation of off-chip learning that cannot cope with real-time errors, we proposed on-chip adaptive matching learning (AML). By adding a spare single-layer neural network where an on-chip AML was carried out in parallel to the main neural network, it was possible to implement an adaptive neuromorphic system that can correct errors during real-time applications. For hardware implementation, we proposed a synapse device, synapse array, and neuron circuit. Finally, we conducted a system-level simulation of the adaptive neuromorphic system to verify the feasibility of the proposed on-chip AML.
引用
收藏
页数:7
相关论文
共 26 条
[1]   Synaptic plasticity: taming the beast [J].
Abbott, L. F. ;
Nelson, Sacha B. .
NATURE NEUROSCIENCE, 2000, 3 (11) :1178-1183
[2]   Low-Power, Adaptive Neuromorphic Systems: Recent Progress and Future Directions [J].
Basu, Arindam ;
Acharya, Jyotibdha ;
Karnik, Tanay ;
Liu, Huichu ;
Li, Hai ;
Seo, Jae-Sun ;
Song, Chang .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2018, 8 (01) :6-27
[3]   Neuromorphic computing using non-volatile memory [J].
Burr, Geoffrey W. ;
Shelby, Robert M. ;
Sebastian, Abu ;
Kim, Sangbum ;
Kim, Seyoung ;
Sidler, Severin ;
Virwani, Kumar ;
Ishii, Masatoshi ;
Narayanan, Pritish ;
Fumarola, Alessandro ;
Sanches, Lucas L. ;
Boybat, Irem ;
Le Gallo, Manuel ;
Moon, Kibong ;
Woo, Jiyoo ;
Hwang, Hyunsang ;
Leblebici, Yusuf .
ADVANCES IN PHYSICS-X, 2017, 2 (01) :89-124
[4]   A fully integrated reprogrammable memristor-CMOS system for efficient multiply-accumulate operations [J].
Cai, Fuxi ;
Correll, Justin M. ;
Lee, Seung Hwan ;
Lim, Yong ;
Bothra, Vishishtha ;
Zhang, Zhengya ;
Flynn, Michael P. ;
Lu, Wei D. .
NATURE ELECTRONICS, 2019, 2 (07) :290-299
[5]   Eyeriss: An Energy-Efficient Reconfigurable Accelerator for Deep Convolutional Neural Networks [J].
Chen, Yu-Hsin ;
Krishna, Tushar ;
Emer, Joel S. ;
Sze, Vivienne .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2017, 52 (01) :127-138
[6]   AND Flash Array Based on Charge Trap Flash for Implementation of Convolutional Neural Networks [J].
Choi, Hyun-Seok ;
Kim, Hyungjin ;
Lee, Jong-Ho ;
Park, Byung-Gook ;
Kim, Yoon .
IEEE ELECTRON DEVICE LETTERS, 2020, 41 (11) :1653-1656
[7]   3-D Synapse Array Architecture Based on Charge-Trap Flash Memory for Neuromorphic Application [J].
Choi, Hyun-Seok ;
Park, Yu Jeong ;
Lee, Jong-Ho ;
Kim, Yoon .
ELECTRONICS, 2020, 9 (01)
[8]  
Gonugondla SK, 2018, ISSCC DIG TECH PAP I, P490, DOI 10.1109/ISSCC.2018.8310398
[9]  
Horowitz M, 2014, ISSCC DIG TECH PAP I, V57, P10, DOI 10.1109/ISSCC.2014.6757323
[10]   Three-dimensional AND flash memory [J].
Kim, Y. ;
Park, I. H. ;
Kwon, H. T. ;
Wee, D. ;
Park, B. -G. .
ELECTRONICS LETTERS, 2017, 53 (11) :743-744