A Novel Method for Scalable VLSI Implementation of Hyperbolic Tangent Function

被引:3
|
作者
Chandra, Mahesh [1 ]
机构
[1] NXP Semicond, Noida 201301, India
关键词
Deep learning; Table lookup; Biological neural networks; Newton method; Interpolation; Very large scale integration; Taylor series; Artificial neural networks; Neural network; Hyperbolic tangent; nonlinear activation function; VLSI implementation;
D O I
10.1109/MDAT.2021.3063308
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Editor's notes: Building efficient hardware accelerators to speed up the hardware implementation of deep neural networks (DNNs) continues to present many challenges. This article discusses a novel approach to building hyperbolic tangent and Sigmoid functions that can be easily tuned for different accuracy and precision.-Vivek Chickermane, Cadence
引用
收藏
页码:85 / 91
页数:7
相关论文
共 50 条
  • [1] Efficient VLSI Implementation of Neural Networks With Hyperbolic Tangent Activation Function
    Zamanlooy, Babak
    Mirhassani, Mitra
    IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2014, 22 (01) : 39 - 48
  • [2] Very High Accuracy Hyperbolic Tangent Function Implementation in FPGAs
    Hajduk, Zbigniew
    Dec, Grzegorz Rafal
    IEEE ACCESS, 2023, 11 : 23701 - 23713
  • [3] Implementation of PWL and LUT based Approximation for Hyperbolic Tangent Activation Function in VLSI
    Saranya, S.
    Elango, B.
    2014 INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND SIGNAL PROCESSING (ICCSP), 2014,
  • [4] PWL Approximation of Hyperbolic Tangent and the First Derivative for VLSI Implementation
    Rasekh, Ehsan
    Rasekh, Iman
    Eshghi, Mohammad
    2010 23RD CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE), 2010,
  • [5] Efficient Hardware Implementation of the Hyperbolic Tangent Sigmoid Function
    Namin, Ashkan Hosseinzadeh
    Leboeuf, Karl
    Muscedere, Roberto
    Wu, Huapeng
    Ahmadi, Majid
    ISCAS: 2009 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOLS 1-5, 2009, : 2117 - 2120
  • [6] Novel Analog Implementation of a Hyperbolic Tangent Neuron in Artificial Neural Networks
    Shakiba, Fatemeh Mohammadi
    Zhou, MengChu
    IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2021, 68 (11) : 10856 - 10867
  • [7] Hardware Implementation of Hyperbolic Tangent Activation Function for Floating Point Formats
    Arvind, T. K. R.
    Brand, Marcel
    Heidorn, Christian
    Boppu, Srinivas
    Hannig, Frank
    Teich, Rirgen
    2020 24TH INTERNATIONAL SYMPOSIUM ON VLSI DESIGN AND TEST (VDAT), 2020,
  • [8] Hardware implementation of hyperbolic tangent and sigmoid activation functions
    Hajduk, Z.
    BULLETIN OF THE POLISH ACADEMY OF SCIENCES-TECHNICAL SCIENCES, 2018, 66 (05) : 563 - 577
  • [9] Low-resource hardware implementation of the hyperbolic tangent for artificial neural networks
    Darío Baptista
    Fernando Morgado-Dias
    Neural Computing and Applications, 2013, 23 : 601 - 607
  • [10] Low-resource hardware implementation of the hyperbolic tangent for artificial neural networks
    Baptista, Dario
    Morgado-Dias, Fernando
    NEURAL COMPUTING & APPLICATIONS, 2013, 23 (3-4): : 601 - 607