An On-Chip-Trainable Gaussian-Kernel Analog Support Vector Machine

被引:65
作者
Kang, Kyunghee [1 ]
Shibata, Tadashi [1 ]
机构
[1] Univ Tokyo, Sch Engn, Dept Elect Engn & Informat Syst, Tokyo 1130032, Japan
关键词
Analog VLSI; Gaussian circuit; hardware-friendly algorithm; machine learning; on-chip learning; subthreshold circuit; support vector machine; NEURAL-NETWORK; STABILITY;
D O I
10.1109/TCSI.2009.2034234
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
An analog circuit architecture of Gaussian-kernel support vector machines having on-chip training capability has been developed. It has a scalable array processor configuration and the circuit size increases only in proportion to the number of learning samples. Thanks to the hardware-friendly algorithm employed in the present work, the learning function is realized by attaching a small additional circuitry to the SVM classifying hardware. The SVM classifying hardware is composed as an array of Gaussian circuits. Although the system is inherently analog, the input and output signals including training results are all available in digital format. Therefore, the learned parameters are easily stored and reused after training sessions. A proof-of concept chip containing 2-class, 2-D, 12-template classifier was designed and fabricated in a 0.18-mu m CMOS technology. The experimental results obtained from the fabricated chips are presented and compared with theoretical calculation results. It can classify 8.7 x 10(5) vectors per second and the average power dissipation was 220 mu W. The learning capability was tested using eight fabricated chips and the variability among these chips were evaluated. Successful operation of the chips was confirmed by measurement results, which demonstrates that on-chip-learning can compensate for analog imperfections.
引用
收藏
页码:1513 / 1524
页数:12
相关论文
共 25 条
[1]   A digital architecture for support vector machines: Theory, algorithm, and FPGA implementation [J].
Anguita, D ;
Boni, A ;
Ridella, S .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2003, 14 (05) :993-1009
[2]   Improved neural network for SVM learning [J].
Anguita, D ;
Boni, A .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (05) :1243-1244
[3]   Circuital implementation of support vector machines [J].
Anguita, D ;
Ridella, S ;
Rovetta, S .
ELECTRONICS LETTERS, 1998, 34 (16) :1596-1597
[4]  
ANGUITA D, 1999, ELECT LETT, V35
[5]  
[Anonymous], P 27 EUR SOL STAT CI
[6]   Compact bell-shaped analog matching-cell module for digital-memory-based associative processors [J].
Bui, Trong Tu ;
Shibata, Tadashi .
JAPANESE JOURNAL OF APPLIED PHYSICS, 2008, 47 (04) :2788-2796
[7]   Sub-microwatt analog VLSI trainable pattern classifier [J].
Chakrabartty, Shantanu ;
Cauwenberghs, Gert .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2007, 42 (05) :1169-1179
[8]   On Global Asymptotic Stability of Cohen-Grossberg Neural Networks With Variable Delays [J].
Chen, Wu-Hua ;
Zheng, Wei Xing .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2008, 55 (10) :3145-3159
[9]  
Christianini N., 2000, INTRO SUPPORT VECTOR, P189
[10]  
DELBRUCK T, 1991, INT NEUR SOC SEATTL