Hyperdimensional Computing for Robust and Efficient Unsupervised Learning

被引:3
作者
Yun, Sanggeon [1 ]
Barkam, Hamza Errahmouni [1 ]
Genssler, Paul R. [2 ]
Latapie, Hugo [3 ]
Amrouch, Hussam [2 ,4 ,5 ]
Imani, Mohsen [1 ]
机构
[1] Univ Calif Irvine, Irvine, CA 92697 USA
[2] Univ Stuttgart, Stuttgart, Germany
[3] CISCO Syst, San Jose, CA USA
[4] Munich Inst Robot & Machine Intelligence, Munich, Germany
[5] Tech Univ Munich, Munich, Germany
来源
FIFTY-SEVENTH ASILOMAR CONFERENCE ON SIGNALS, SYSTEMS & COMPUTERS, IEEECONF | 2023年
基金
美国国家科学基金会;
关键词
clustering; data science; computing in memory; FeFET; hyperdimensional computing; RELIABILITY;
D O I
10.1109/IEEECONF59524.2023.10476861
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Clustering has emerged as a critical tool in diverse fields. Nevertheless, its high computational cost has been a persistent challenge, particularly for large-scale datasets. To address this, various compute-in-memory (CiM) approaches have been proposed, including the use of Ferroelectric FET (FeFET) technology due to its ultra-efficient and compact CiM architecture. However, non-idealities resulting from cell thickness and device temperature have impeded the scaling of FeFETs and thus hindered their potential to be used for clustering. In light of this, we propose a Hyper-Dimensional Computing (HDC) framework specifically for FeFET technology in the context of clustering. Our approach involves a cross-layer FeFET reliability model that captures the effects of scaling on multi-bit FeFETs, taking into account the impact of process variation and inherent stochasticity. We use two models in our HDC framework, a full-precision, ideal model for training, and a quantized error-impacted version for validation and inference. This iterative adaptation strategy helps to overcome the challenges associated with the non-idealities of FeFET technology. Our results demonstrate the proposed HDC framework performs better than traditional algorithms such as k-means and BIRCH. Moreover, our model can function as its ideal counterpart without noise, proving its potential to scale FeFET technology for clustering applications.
引用
收藏
页码:281 / 288
页数:8
相关论文
共 29 条
[1]   HDGIM: Hyperdimensional Genome Sequence Matching on Unreliable highly scaled FeFET [J].
Barkam, Hamza Errahmouni ;
Yun, Sanggeon ;
Genssler, Paul R. ;
Zou, Zhuowen ;
Liu, Che-Kai ;
Amrouch, Hussam ;
Imani, Mohsen .
2023 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION, DATE, 2023,
[2]  
Chatterjee S., 2022, IEEE TED
[3]   A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects [J].
Ezugwu, Absalom E. ;
Ikotun, Abiodun M. ;
Oyelade, Olaide O. ;
Abualigah, Laith ;
Agushaka, Jeffery O. ;
Eke, Christopher I. ;
Akinyelu, Andronicus A. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 110
[4]  
Garcia J, 2018, IEEE WCNC
[5]   Brain-Inspired Computing for Wafer Map Defect Pattern Classification [J].
Genssler, Paul R. ;
Amrouch, Hussam .
2021 IEEE INTERNATIONAL TEST CONFERENCE (ITC 2021), 2021, :123-132
[6]   On the Reliability of FeFET On-Chip Memory [J].
Genssler, Paul R. ;
van Santen, Victor M. ;
Henkel, Joerg ;
Amrouch, Hussam .
IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (04) :947-958
[7]   Brain-Inspired Computing for Circuit Reliability Characterization [J].
Genssler, Paul R. R. ;
Amrouch, Hussam .
IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (12) :3336-3348
[8]   Application of k-means and hierarchical clustering techniques for analysis of air pollution: A review (1980-2019) [J].
Govender, P. ;
Sivakumar, V .
ATMOSPHERIC POLLUTION RESEARCH, 2020, 11 (01) :40-56
[9]  
Hartigan J. A., 1979, Applied Statistics, V28, P100, DOI 10.2307/2346830
[10]  
Hernández-Cano A, 2021, PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), P56