Implementing in-situ self-organizing maps with memristor crossbar arrays for data mining and optimization

被引:44
|
作者
Wang, Rui [1 ,2 ,3 ]
Shi, Tuo [1 ,3 ,4 ]
Zhang, Xumeng [2 ]
Wei, Jinsong [1 ,4 ]
Lu, Jian [1 ,4 ]
Zhu, Jiaxue [1 ,3 ]
Wu, Zuheng [1 ,3 ]
Liu, Qi [1 ,2 ,3 ]
Liu, Ming [1 ,2 ,3 ]
机构
[1] Chinese Acad Sci, Key Lab Microelect Devices & Integrated Technol, Inst Microelect, Beijing 100029, Peoples R China
[2] Fudan Univ, Frontier Inst Chip & Syst, Shanghai 200433, Peoples R China
[3] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[4] Zhejiang Lab, Inst Intelligent Comp, Hangzhou 311122, Peoples R China
基金
中国国家自然科学基金; 国家重点研发计划;
关键词
ANALOG MEMRISTOR; NEURAL-NETWORK; SOM; DIMENSIONALITY;
D O I
10.1038/s41467-022-29411-4
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
A self-organizing map (SOM) is a powerful unsupervised learning neural network for analyzing high-dimensional data in various applications. However, hardware implementation of SOM is challenging because of the complexity in calculating the similarities and determining neighborhoods. We experimentally demonstrated a memristor-based SOM based on Ta/TaOx/Pt 1T1R chips for the first time, which has advantages in computing speed, throughput, and energy efficiency compared with the CMOS digital counterpart, by utilizing the topological structure of the array and physical laws for computing without complicated circuits. We employed additional rows in the crossbar arrays and identified the best matching units by directly calculating the similarities between the input vectors and the weight matrix in the hardware. Using the memristor-based SOM, we demonstrated data clustering, image processing and solved the traveling salesman problem with much-improved energy efficiency and computing throughput. The physical implementation of SOM in memristor crossbar arrays extends the capability of memristor-based neuromorphic computing systems in machine learning and artificial intelligence. Self-organizing maps are data mining tools for unsupervised learning algorithms dealing with big data problems. The authors experimentally demonstrate a memristor-based self-organizing map that is more efficient in computing speed and energy consumption for data clustering, image processing and solving optimization problems.
引用
收藏
页数:10
相关论文
共 24 条
  • [1] From CPU to FPGA - Acceleration of Self-Organizing Maps for Data Mining
    Lachmair, Jan
    Mieth, Thomas
    Griessl, Rene
    Hagemeyer, Jens
    Porrmann, Mario
    2017 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2017, : 4299 - 4308
  • [2] Data Clustering through Particle Swarm Optimization Driven Self-Organizing Maps
    Gonsalves, Tad
    Nishimoto, Yasuaki
    INTELLIGENCE IN THE ERA OF BIG DATA, ICSIIT 2015, 2015, 516 : 212 - 219
  • [3] Hierarchical self-organizing maps for clustering spatiotemporal data
    Hagenauer, Julian
    Helbich, Marco
    INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2013, 27 (10) : 2026 - 2042
  • [4] Architecture optimization model for the probabilistic self-organizing maps and classification
    En-naimani, Z.
    Lazaar, M.
    Ettaouil, M.
    2014 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS: THEORIES AND APPLICATIONS (SITA'14), 2014,
  • [5] A general framework for multilingual text mining using self-organizing maps
    Al-Marghilani, Abdulsamad
    Zedan, Husien
    Ayesh, Aladdin
    PROCEEDINGS OF THE IASTED INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND APPLICATIONS, 2007, : 520 - +
  • [6] Kohonen's self-organizing maps in contextual analysis of data
    Honkela, T
    Koskinen, I
    Koskenniemi, T
    Karvonen, S
    INFORMATION ORGANIZATION AND DATABASES: FOUNDATIONS OF DATA ORGANIZATION, 2000, 579 : 135 - 148
  • [7] Sparse Online Self-Organizing Maps for Large Relational Data
    Olteanu, Madalina
    Villa-Vialaneix, Nathalie
    ADVANCES IN SELF-ORGANIZING MAPS AND LEARNING VECTOR QUANTIZATION, WSOM 2016, 2016, 428 : 73 - 82
  • [8] The Research Using Self-Organizing Maps on Enterprise Economic Data
    Wang Heyong
    2009 ASIA-PACIFIC CONFERENCE ON INFORMATION PROCESSING (APCIP 2009), VOL 2, PROCEEDINGS, 2009, : 611 - 613
  • [9] hSOM: Visualizing Self-Organizing Maps to Accomodate Categorical Data
    Kilgore, Phillip C. S. R.
    Trutschl, Marjan
    Cvek, Urska
    Nam, Hyung W.
    2020 24TH INTERNATIONAL CONFERENCE INFORMATION VISUALISATION (IV 2020), 2020, : 644 - 650
  • [10] Quality assessment of data discrimination using self-organizing maps
    Mekler, Alexey
    Schwarz, Dmitri
    JOURNAL OF BIOMEDICAL INFORMATICS, 2014, 51 : 210 - 218