TAIM: Ternary Activation In-Memory Computing Hardware with 6T SRAM Array

被引:1
作者
Kang, Nameun [1 ]
Kim, Hyungjun [1 ,2 ]
Oh, Hyunmyung [1 ]
Kim, Jae-Joon [3 ]
机构
[1] POSTECH, Pohang, South Korea
[2] SqueezeBits Inc, Seoul, South Korea
[3] Seoul Natl Univ, Seoul, South Korea
来源
PROCEEDINGS OF THE 59TH ACM/IEEE DESIGN AUTOMATION CONFERENCE, DAC 2022 | 2022年
基金
新加坡国家研究基金会;
关键词
Deep Neural Network; In-Memory Computing; Ternary Activation;
D O I
10.1145/3489517.3530574
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, various in-memory computing accelerators for low precision neural networks have been proposed. While in-memory Binary Neural Network (BNN) accelerators achieved significant energy efficiency, BNNs show severe accuracy degradation compared to their full precision counterpart models. To mitigate the problem, we propose TAIM, an in-memory computing hardware that can support ternary activation with negligible hardware overhead. In TAIM, a 6T SRAM cell can compute the multiplication between ternary activation and binary weight. Since the 6T SRAM cell consumes no energy when the input activation is 0, the proposed TAIM hardware can achieve even higher energy efficiency compared to BNN case by exploiting input 0's. We fabricated the proposed TAIM hardware in 28nm CMOS process and evaluated the energy efficiency on various image classification benchmarks. The experimental results show that the proposed TAIM hardware can achieve 3.61x higher energy efficiency on average
引用
收藏
页码:1081 / 1086
页数:6
相关论文
共 50 条
  • [41] ADC-Less Reprogrammable RRAM Array Architecture for In-Memory Computing
    Dongre, Ashvinikumar
    Boro, Bipul
    Trivedi, Gaurav
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2023, 31 (12) : 2053 - 2060
  • [42] Impact of Analog Non-Idealities on the Design Space of 6T-SRAM Current-Domain Dot-Product Operators for In-Memory Computing
    Kneip, Adrian
    Bol, David
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2021, 68 (05) : 1931 - 1944
  • [43] Fast 6T SRAM Bit-Line Computing with Consecutive Short Pulse Word-Lines and Skewed Inverter
    Jeong, Jinho
    Park, Jongsun
    2020 17TH INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC 2020), 2020, : 292 - 293
  • [44] A Zero-Skipping Reconfigurable SRAM In-Memory Computing Macro with Binary-Searching ADC
    Yu, Chengshuo
    Chai, Kevin Tshun Chuan
    Kim, Tony Tae-Hyoung
    Kim, Bongjin
    IEEE 51ST EUROPEAN SOLID-STATE DEVICE RESEARCH CONFERENCE (ESSDERC 2021), 2021, : 131 - 134
  • [45] Testing of Configurable 8T SRAMs for In-Memory Computing
    Li, Jin-Fu
    Tsai, Tsai-Ling
    Hsu, Chun-Lung
    Sun, Chi-Tien
    2020 IEEE 29TH ASIAN TEST SYMPOSIUM (ATS), 2020, : 71 - 75
  • [46] Zero-Skipping Reconfigurable SRAM In-Memory Computing Macro with Binary-Searching ADC
    Yu, Chengshuo
    Chai, Kevin Tshun Chuan
    Kim, Tony Tae-Hyoung
    Kim, Bongjin
    ESSCIRC 2021 - IEEE 47TH EUROPEAN SOLID STATE CIRCUITS CONFERENCE (ESSCIRC), 2021, : 131 - 134
  • [47] An Area-Efficient In-Memory Implementation Method of Arbitrary Boolean Function Based on SRAM Array
    Zhang, Sunrui
    Cui, Xiaole
    Wei, Feng
    Cui, Xiaoxin
    IEEE TRANSACTIONS ON COMPUTERS, 2023, 72 (12) : 3416 - 3430
  • [48] ±CIM SRAM for Signed In-Memory Broad-Purpose Computing From DSP to Neural Processing
    Jain, Saurabh
    Lin, Longyang
    Alioto, Massimo
    IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2021, 56 (10) : 2981 - 2992
  • [49] Hardware/Software Co-Design With ADC-Less In-Memory Computing Hardware for Spiking Neural Networks
    Apolinario, Marco Paul E.
    Kosta, Adarsh Kumar
    Saxena, Utkarsh
    Roy, Kaushik
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2024, 12 (01) : 35 - 47
  • [50] Design and Optimization of Non-Volatile Capacitive Crossbar Array for In-Memory Computing
    Luo, Yuan-Chun
    Lu, Anni
    Hur, Jae
    Li, Shaolan
    Yu, Shimeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (03) : 784 - 788