An RRAM-Based Digital Computing-in-Memory Macro With Dynamic Voltage Sense Amplifier and Sparse-Aware Approximate Adder Tree

被引:14
作者
He, Yifan [1 ]
Yue, Jinshan [2 ]
Feng, Xiaoyu [1 ]
Huang, Yuxuan [1 ]
Jia, Hongyang [1 ]
Wang, Jingyu [1 ]
Zhang, Lu [1 ]
Sun, Wenyu [3 ]
Yang, Huazhong [1 ]
Liu, Yongpan [1 ]
机构
[1] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[2] Chinese Acad Sci, Key Lab Microelect Devices & Integrated Technol, Inst Microelect, Beijing 100029, Peoples R China
[3] Tsinghua Shenzhen Int Grad Sch, Shenzhen 518000, Peoples R China
基金
中国博士后科学基金;
关键词
Adders; Voltage; Logic gates; Neural networks; Computer architecture; Sensors; Resistance; Computing-in-memory; RRAM; Approximate computing; energy efficiency; neural network; sparsity;
D O I
10.1109/TCSII.2022.3209872
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
RRAM is a promising candidate to implement large-capacity in-memory computing on edge AI devices due to its high density. However, the efficiency and accuracy of RRAM-based computing-in-memory (CIM) works are limited by large accumulation currents and device variations. The SRAM-based digital CIM achieves superior performance and efficiency while the adder tree dominates the area. In this brief, a digital RRAM CIM macro is proposed to achieve a better trade-off between accuracy, energy, and performance by three techniques. First, a dynamic voltage sense amplifier is designed to reduce > 90% read currents of low resistance state (LRS) cell. Second, an OR gate approximate adder tree is proposed to reduce the area of the adder tree by 40%. Third, a sparse-aware finetuning algorithm is proposed to reduce the accuracy loss of approximate arithmetic to 0.4% on Cifar-10 dataset. The proposed design achieves 1966TOPS/W energy efficiency and 51.2GOPS/Kb normalized throughput at 1-bit precision which is 1.2x and 1.8x higher than previous RRAM-based designs. This brief demonstrates the advantage of digital CIM using RRAM devices.
引用
收藏
页码:416 / 420
页数:5
相关论文
共 18 条
  • [1] [Anonymous], 2013, P S VLSI TECHN
  • [2] Challenges and Circuit Techniques for Energy-Efficient On-Chip Nonvolatile Memory Using Memristive Devices
    Chang, Meng-Fan
    Lee, Albert
    Chen, Pin-Cheng
    Lin, Chrong Jung
    King, Ya-Chin
    Sheu, Shyh-Shyuan
    Ku, Tzu-Kun
    [J]. IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2015, 5 (02) : 183 - 193
  • [3] PRIME: A Novel Processing-in-memory Architecture for Neural Network Computation in ReRAM-based Main Memory
    Chi, Ping
    Li, Shuangchen
    Xu, Cong
    Zhang, Tao
    Zhao, Jishen
    Liu, Yongpan
    Wang, Yu
    Xie, Yuan
    [J]. 2016 ACM/IEEE 43RD ANNUAL INTERNATIONAL SYMPOSIUM ON COMPUTER ARCHITECTURE (ISCA), 2016, : 27 - 39
  • [4] An 89TOPS/W and 16.3TOPS/mm2 All-Digital SRAM-Based Full-Precision Compute-In Memory Macro in 22nm for Machine-Learning Edge Applications
    Chih, Yu-Der
    Lee, Po-Hao
    Fujiwara, Hidehiro
    Shih, Yi-Chun
    Lee, Chia-Fu
    Naous, Rawan
    Chen, Yu-Lin
    Lo, Chieh-Pu
    Lu, Cheng-Han
    Mori, Haruki
    Zhao, Wei-Cheng
    Sun, Dar
    Sinangil, Mahmut E.
    Chen, Yen-Huei
    Chou, Tan-Li
    Akarvardar, Kerem
    Liao, Hung-Jen
    Wang, Yih
    Chang, Meng-Fan
    Chang, Tsung-Yung Jonathan
    [J]. 2021 IEEE INTERNATIONAL SOLID-STATE CIRCUITS CONFERENCE (ISSCC), 2021, 64 : 252 - +
  • [5] Correll Justin M., 2022, 2022 IEEE Symposium on VLSI Technology and Circuits (VLSI Technology and Circuits), P264, DOI 10.1109/VLSITechnologyandCir46769.2022.9830490
  • [6] Dewei Wang, 2022, 2022 IEEE International Solid- State Circuits Conference (ISSCC), P266, DOI 10.1109/ISSCC42614.2022.9731659
  • [7] Low-Overhead Implementation of Binarized Neural Networks Employing Robust 2T2R Resistive RAM Bridges
    Ezzadeen, M.
    Majumdar, A.
    Bocquet, M.
    Giraud, B.
    Noel, J-P
    Andrieu, F.
    Querlioz, D.
    Portal, J-M
    [J]. ESSCIRC 2021 - IEEE 47TH EUROPEAN SOLID STATE CIRCUITS CONFERENCE (ESSCIRC), 2021, : 83 - 86
  • [8] Study of Drift in RRAM Devices Under Various Operating Conditions
    Hochman, Brett
    Jha, Rashmi
    Leedy, Kevin
    [J]. PROCEEDINGS OF THE 2021 IEEE NATIONAL AEROSPACE AND ELECTRONICS CONFERENCE (NAECON), 2021, : 405 - 410
  • [9] Hsieh MC, 2013, 2013 IEEE INTERNATIONAL ELECTRON DEVICES MEETING (IEDM)
  • [10] Huang Y. He, IEEE T CIR SYST REG