Implementing in-situ self-organizing maps with memristor crossbar arrays for data mining and optimization

被引:55
作者
Wang, Rui [1 ,2 ,3 ]
Shi, Tuo [1 ,3 ,4 ]
Zhang, Xumeng [2 ]
Wei, Jinsong [1 ,4 ]
Lu, Jian [1 ,4 ]
Zhu, Jiaxue [1 ,3 ]
Wu, Zuheng [1 ,3 ]
Liu, Qi [1 ,2 ,3 ]
Liu, Ming [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Key Lab Microelect Devices & Integrated Technol, Inst Microelect, Beijing 100029, Peoples R China
[2] Fudan Univ, Frontier Inst Chip & Syst, Shanghai 200433, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Zhejiang Lab, Inst Intelligent Comp, Hangzhou 311122, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
ANALOG MEMRISTOR; NEURAL-NETWORK; SOM; DIMENSIONALITY;
D O I
10.1038/s41467-022-29411-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
A self-organizing map (SOM) is a powerful unsupervised learning neural network for analyzing high-dimensional data in various applications. However, hardware implementation of SOM is challenging because of the complexity in calculating the similarities and determining neighborhoods. We experimentally demonstrated a memristor-based SOM based on Ta/TaOx/Pt 1T1R chips for the first time, which has advantages in computing speed, throughput, and energy efficiency compared with the CMOS digital counterpart, by utilizing the topological structure of the array and physical laws for computing without complicated circuits. We employed additional rows in the crossbar arrays and identified the best matching units by directly calculating the similarities between the input vectors and the weight matrix in the hardware. Using the memristor-based SOM, we demonstrated data clustering, image processing and solved the traveling salesman problem with much-improved energy efficiency and computing throughput. The physical implementation of SOM in memristor crossbar arrays extends the capability of memristor-based neuromorphic computing systems in machine learning and artificial intelligence. Self-organizing maps are data mining tools for unsupervised learning algorithms dealing with big data problems. The authors experimentally demonstrate a memristor-based self-organizing map that is more efficient in computing speed and energy consumption for data clustering, image processing and solving optimization problems.
引用
收藏
页数:10
相关论文
共 56 条
[1]   SELF-ORGANIZING FEATURE MAPS AND THE TRAVELING SALESMAN PROBLEM [J].
ANGENIOL, B ;
VAUBOIS, GD ;
LETEXIER, JY .
NEURAL NETWORKS, 1988, 1 (04) :289-293
[2]  
[Anonymous], 2015, 2015 IEEE International ElectronDevices Meeting (IEDM)
[3]  
[Anonymous], 1995, READ UNDERST MULTIVA
[4]  
Barbalho JM, 2001, IEEE IJCNN, P442, DOI 10.1109/IJCNN.2001.939060
[5]   Power-efficient combinatorial optimization using intrinsic noise in memristor Hopfield neural networks [J].
Cai, Fuxi ;
Kumar, Suhas ;
Van Vaerenbergh, Thomas ;
Sheng, Xia ;
Liu, Rui ;
Li, Can ;
Liu, Zhan ;
Foltin, Martin ;
Yu, Shimeng ;
Xia, Qiangfei ;
Yang, J. Joshua ;
Beausoleil, Raymond ;
Lu, Wei D. ;
Strachan, John Paul .
NATURE ELECTRONICS, 2020, 3 (07) :409-418
[6]   A fully integrated reprogrammable memristor-CMOS system for efficient multiply-accumulate operations [J].
Cai, Fuxi ;
Correll, Justin M. ;
Lee, Seung Hwan ;
Lim, Yong ;
Bothra, Vishishtha ;
Zhang, Zhengya ;
Flynn, Michael P. ;
Lu, Wei D. .
NATURE ELECTRONICS, 2019, 2 (07) :290-299
[7]   AW-SOM, an Algorithm for High-Speed Learning in Hardware Self-Organizing Maps [J].
Cardarilli, Gian Carlo ;
Di Nunzio, Luca ;
Fazzolari, Rocco ;
Re, Marco ;
Spano, Sergio .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2020, 67 (02) :380-384
[8]  
Carroll J.D., 1998, Handbook of Perception and Cognition, P179
[9]   A study of hybrid neural network approaches and the effects of missing data on traffic forecasting [J].
Chen, HB ;
Grant-Muller, S ;
Mussone, L ;
Montgomery, F .
NEURAL COMPUTING & APPLICATIONS, 2001, 10 (03) :277-286
[10]   Comparison of SOM-based optimization and particle swarm optimization for minimizing the construction time of a secant pile wall [J].
Chen, Jieh-Haur ;
Yang, Li-Ren ;
Su, Mu-Chun .
AUTOMATION IN CONSTRUCTION, 2009, 18 (06) :844-848