An On-Chip-Trainable Gaussian-Kernel Analog Support Vector Machine

被引:65
作者
Kang, Kyunghee [1 ]
Shibata, Tadashi [1 ]
机构
[1] Univ Tokyo, Sch Engn, Dept Elect Engn & Informat Syst, Tokyo 1130032, Japan
关键词
Analog VLSI; Gaussian circuit; hardware-friendly algorithm; machine learning; on-chip learning; subthreshold circuit; support vector machine; NEURAL-NETWORK; STABILITY;
D O I
10.1109/TCSI.2009.2034234
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
An analog circuit architecture of Gaussian-kernel support vector machines having on-chip training capability has been developed. It has a scalable array processor configuration and the circuit size increases only in proportion to the number of learning samples. Thanks to the hardware-friendly algorithm employed in the present work, the learning function is realized by attaching a small additional circuitry to the SVM classifying hardware. The SVM classifying hardware is composed as an array of Gaussian circuits. Although the system is inherently analog, the input and output signals including training results are all available in digital format. Therefore, the learned parameters are easily stored and reused after training sessions. A proof-of concept chip containing 2-class, 2-D, 12-template classifier was designed and fabricated in a 0.18-mu m CMOS technology. The experimental results obtained from the fabricated chips are presented and compared with theoretical calculation results. It can classify 8.7 x 10(5) vectors per second and the average power dissipation was 220 mu W. The learning capability was tested using eight fabricated chips and the variability among these chips were evaluated. Successful operation of the chips was confirmed by measurement results, which demonstrates that on-chip-learning can compensate for analog imperfections.
引用
收藏
页码:1513 / 1524
页数:12
相关论文
共 25 条
[11]   Silicon support vector machine with on-line learning [J].
Genov, R ;
Chakrabartty, S ;
Cauwenberghs, G .
INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, 2003, 17 (03) :385-404
[12]   Kerneltron: Support vector "machine" in silicon [J].
Genov, R ;
Cauwenberghs, G .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (05) :1426-1434
[13]   A PRECISE 4-QUADRANT MULTIPLIER WITH SUBNANOSECOND RESPONSE [J].
GILBERT, B .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 1968, SC 3 (04) :365-&
[14]  
Kang K, 2009, IEEE INT SYMP CIRC S, P2661, DOI 10.1109/ISCAS.2009.5118349
[15]   Analog VLSI implementation of support vector machine learning and classification [J].
Peng, Sheng-Yu ;
Minch, Bradley A. ;
Hasler, Paul .
PROCEEDINGS OF 2008 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-10, 2008, :860-+
[16]   An analog programmable multidimensional radial basis function based classifier [J].
Peng, Sheng-Yu ;
Hasler, Paul E. ;
Anderson, David V. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2007, 54 (10) :2148-2158
[17]   Analog neural network for support vector machine learning [J].
Perfetti, Renzo ;
Ricci, Elisa .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (04) :1085-1091
[18]   Comparing support vector machines with Gaussian kernels to radial basis function classifiers [J].
Scholkopf, B ;
Sung, KK ;
Burges, CJC ;
Girosi, F ;
Niyogi, P ;
Poggio, T ;
Vapnik, V .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1997, 45 (11) :2758-2765
[19]  
SUAREZ RE, 1975, IEEE J SOLID-ST CIRC, V10, P379, DOI 10.1109/JSSC.1975.1050630
[20]   A scalable low voltage analog Gaussian radial basis circuit [J].
Theogarajan, L ;
Akers, LA .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-ANALOG AND DIGITAL SIGNAL PROCESSING, 1997, 44 (11) :977-979