An analog VLSI neural network with on-chip perturbation learning

被引:20
作者
Montalvo, AJ
Gyurcsik, RS
Paulos, JJ
机构
[1] N CAROLINA STATE UNIV,DEPT ELECT & COMP ENGN,RALEIGH,NC 27695
[2] CRYSTAL SEMICOND,AUSTIN,TX 78744
关键词
analog nonvolatile memory; analog VLSI neural network; on-chip learning; perturbation learning; reconfigurable neural network topology; temperature-independent CMOS transconductance;
D O I
10.1109/4.563675
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
An analog very large scale integration (VLSI) neural network intended for cost-sensitive, battery-powered, high-volume applications is described. Weights are stored in the analog domain using a combination of dynamic and nonvolatile memory that allows both fast learning and reliable long-term storage. The synapse occupies 4.9 K mu m(2) in a 2-mu m technology. On-chip controlled perturbation-based gradient descent allows fast learning with very little external support. Other distinguishing features include a reconfigurable topology and a temperature-independent feedforward path. An eight-neuron, 64-synapse proof-of-concept chip reliably solves the exclusive-or problem in ten's of milliseconds and 4-b parity in hundred's of milliseconds.
引用
收藏
页码:535 / 543
页数:9
相关论文
共 37 条
[11]   ARTIFICIAL NEURAL NETWORKS USING MOS ANALOG MULTIPLIERS [J].
HOLLIS, PW ;
PAULOS, JJ .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1990, 25 (03) :849-855
[12]   A NEURAL-NETWORK LEARNING ALGORITHM TAILORED FOR VLSI IMPLEMENTATION [J].
HOLLIS, PW ;
PAULOS, JJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (05) :784-791
[13]  
IWATA A, 1990, INT JOINT C NEUR NET, V2, P43
[14]   WEIGHT PERTURBATION - AN OPTIMAL ARCHITECTURE AND LEARNING TECHNIQUE FOR ANALOG VLSI FEEDFORWARD AND RECURRENT MULTILAYER NETWORKS [J].
JABRI, M ;
FLOWER, B .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (01) :154-157
[15]   A NON-QUASI-STATIC ANALYSIS OF THE TRANSIENT-BEHAVIOR OF THE LONG-CHANNEL MOST VALID IN ALL REGIONS OF OPERATION [J].
MANCINI, P ;
TURCHETTI, C ;
MASETTI, G .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 1987, 34 (02) :325-334
[16]  
MANN J, 1989, ADV NEURAL INFORMATI, V1, P226
[17]  
MCCARTOR H, 1991, ADV NEURAL INFORMATI, V3, P1028
[18]  
Mead C, 1989, ANALOG VLSI NEURAL S
[19]   Toward a general-purpose analog VLSI neural network with on-chip learning [J].
Montalvo, AJ ;
Gyurcsik, RS ;
Paulos, JJ .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1997, 8 (02) :413-423
[20]   IMPROVED FLOATING-GATE DEVICES USING STANDARD CMOS TECHNOLOGY [J].
MONTALVO, AJ ;
PAULOS, JJ .
IEEE ELECTRON DEVICE LETTERS, 1993, 14 (08) :372-374