K-means Data Clustering with Memristor Networks

被引:92
作者
Jeong, YeonJoo [1 ,2 ]
Lee, Jihang [1 ,2 ]
Moon, John [1 ]
Shin, Jong Hoon [1 ]
Lu, Wei D. [1 ]
机构
[1] Univ Michigan, Dept Elect Engn & Comp Sci, Ann Arbor, MI 48109 USA
[2] Univ Michigan, Dept Mat Sci & Engn, Ann Arbor, MI 48109 USA
基金
美国国家科学基金会;
关键词
Unsupervised learning; Euclidean distance; neuromorphic computing; analog switching; RRAM; Ta2O5; FEATURE-EXTRACTION; NEURAL-NETWORKS; CLASSIFICATION; DIMENSIONALITY; DEVICE;
D O I
10.1021/acs.nanolett.8b01526
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
Memristor-based neuromorphic networks have been actively studied as a promising candidate to overcome the von-Neumann bottleneck in future computing applications. Several recent studies have demonstrated memristor network's capability to perform supervised as well as unsupervised learning, where features inherent in the input are identified and analyzed by comparing with features stored in the memristor network. However, even though in some cases the stored feature vectors can be normalized so that the winning neurons can be directly found by the (input) vector (stored) vector dot-products, in many other cases, normalization of the feature vectors is not trivial or practically feasible, and calculation of the actual Euclidean distance between the input vector and the stored vector is required. Here we report experimental implementation of memristor crossbar hardware systems that can allow direct comparison of the Euclidean distances without normalizing the weights. The experimental system enables unsupervised K-means clustering algorithm through online learning, and produces high classification accuracy (93.3%) for the standard IRIS data set. The approaches and devices can be used in other unsupervised learning systems, and significantly broaden the range of problems a memristor-based network can solve.
引用
收藏
页码:4447 / 4453
页数:7
相关论文
共 32 条
[1]  
[Anonymous], ARXIV171201253
[2]  
[Anonymous], COMPUTERS MATH APPL
[3]  
[Anonymous], M ASS COMP LING
[4]   Oxide stoichiometry-controlled TaOx-based resistive switching behaviors [J].
Baek, Gwang Ho ;
Lee, Ah Rahm ;
Kim, Tae Yoon ;
Im, Hyun Sik ;
Hong, Jin Pyo .
APPLIED PHYSICS LETTERS, 2016, 109 (14)
[5]   Learning Deep Architectures for AI [J].
Bengio, Yoshua .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01) :1-127
[6]   Experimental Demonstration of Feature Extraction and Dimensionality Reduction Using Memristor Networks [J].
Choi, Shinhyun ;
Shin, Jong Hoon ;
Lee, Jihang ;
Sheridan, Patrick ;
Lu, Wei D. .
NANO LETTERS, 2017, 17 (05) :3113-3118
[7]  
Coates Adam, 2012, Neural Networks: Tricks of the Trade. Second Edition: LNCS 7700, P561, DOI 10.1007/978-3-642-35289-8_30
[8]   A survey of kernel and spectral methods for clustering [J].
Filippone, Maurizio ;
Camastra, Francesco ;
Masulli, Francesco ;
Rovetta, Stefano .
PATTERN RECOGNITION, 2008, 41 (01) :176-190
[9]   A Novel Defect-Engineering-Based Implementation for High-Performance Multilevel Data Storage in Resistive Switching Memory [J].
Gao, Bin ;
Chen, Bing ;
Zhang, Feifei ;
Liu, Lifeng ;
Liu, Xiaoyan ;
Kang, Jinfeng ;
Yu, Hongyu ;
Yu, Bin .
IEEE TRANSACTIONS ON ELECTRON DEVICES, 2013, 60 (04) :1379-1383
[10]  
Goodfellow I., 2014, Advances in neural information processing systems, P2672