MEMRISTOR-BASED LSTM NETWORK FOR TEXT CLASSIFICATION

被引:50
|
作者
Dou, Gang [1 ]
Zhao, Kaixuan [1 ]
Guo, Mei [1 ]
Mou, Jun [2 ]
机构
[1] Shandong Univ Sci & Technol, Coll Elect Engn & Automat, Qingdao 266590, Peoples R China
[2] Dalian Polytech Univ, Sch Informat Sci & Engn, Dalian 116034, Peoples R China
基金
中国国家自然科学基金;
关键词
Memristor; LSTM; Circuit Design; Text Classification; PREDICTION; MODEL;
D O I
10.1142/S0218348X23400406
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Long short-term memory (LSTM) with significantly increased complexity and a large number of parameters have a bottleneck in computing power resulting from limited memory capacity. Hardware acceleration of LSTM using memristor circuit is an effective solution. This paper presents a complete design of memristive LSTM network system. Both the LSTM cell and the fully connected layer circuit are implemented through memristor crossbars, and the 1T1R design avoids the influence of the sneak current which helps to improve the accuracy of network calculation. To reduce the power consumption, the word embedding dimensionality was reduced using the GloVe model, and the number of features in the hidden layer was reduced. The effectiveness of the proposed scheme is verified by performing the text classification task on the IMDB dataset and the hardware training accuracy reached as high as 88.58%.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Text classification in memristor-based spiking neural networks
    Huang, Jinqi
    Serb, Alexantrou
    Stathopoulos, Spyros
    Prodromakis, Themis
    NEUROMORPHIC COMPUTING AND ENGINEERING, 2023, 3 (01):
  • [2] Memristor-based LSTM network with in situ training and its applications
    Liu, Xiaoyang
    Zeng, Zhigang
    Wunsch, Donald C., II
    NEURAL NETWORKS, 2020, 131 : 300 - 311
  • [3] Memristor-Based Parallel Computing Circuit Optimization for LSTM Network Fault Diagnosis
    Sun, Junwei
    Cao, Yuhan
    Yue, Yi
    Wen, Shiping
    Wang, Yanfeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2025, 72 (02) : 907 - 917
  • [4] Memristor-based in-memory processor for high precision semantic text classification
    Viswakumar, Aditya
    Ganganaik, Priyanka B.
    Raj, P. Michael Preetam
    Rao, B. V. V. S. N. Prabhakar
    Kundu, Souvik
    COMPUTERS & ELECTRICAL ENGINEERING, 2021, 92
  • [5] Memristor-based feature learning for pattern classification
    Shi, Tuo
    Gao, Lili
    Tian, Yang
    Tang, Shuangzhu
    Liu, Jinchang
    Li, Yiqi
    Zhou, Ruixi
    Cui, Shiyu
    Zhang, Hui
    Li, Yu
    Wu, Zuheng
    Zhang, Xumeng
    Li, Taihao
    Yan, Xiaobing
    Liu, Qi
    NATURE COMMUNICATIONS, 2025, 16 (01)
  • [6] Memristor-Based Analog Computation and Neural Network Classification with a Dot Product Engine
    Hu, Miao
    Graves, Catherine E.
    Li, Can
    Li, Yunning
    Ge, Ning
    Montgomery, Eric
    Davila, Noraica
    Jiang, Hao
    Williams, R. Stanley
    Yang, J. Joshua
    Xia, Qiangfei
    Strachan, John Paul
    ADVANCED MATERIALS, 2018, 30 (09)
  • [7] Chimera in a network of memristor-based Hopfield neural network
    Parastesh, Fatemeh
    Jafari, Sajad
    Azarnoush, Hamed
    Hatef, Boshra
    Namazi, Hamidreza
    Dudkowski, Dawid
    EUROPEAN PHYSICAL JOURNAL-SPECIAL TOPICS, 2019, 228 (10): : 2023 - 2033
  • [8] Chimera in a network of memristor-based Hopfield neural network
    Fatemeh Parastesh
    Sajad Jafari
    Hamed Azarnoush
    Boshra Hatef
    Hamidreza Namazi
    Dawid Dudkowski
    The European Physical Journal Special Topics, 2019, 228 : 2023 - 2033
  • [9] The LSTM Neural Network Based on Memristor
    Chu, Ziqi
    Xu, Hui
    Liu, Haijun
    2020 3RD INTERNATIONAL CONFERENCE ON COMPUTER INFORMATION SCIENCE AND APPLICATION TECHNOLOGY (CISAT) 2020, 2020, 1634
  • [10] Hierarchical LSTM network for text classification
    Borna, Keivan
    Ghanbari, Reza
    SN APPLIED SCIENCES, 2019, 1 (09):