Hardware Implementation of Tanh Exponential Activation Function using FPGA

被引：9
|
作者：
Bouguezzi, Safa [1 ,2 ]
Faiedh, Hassene [1 ,3 ]
Souani, Chokri [1 ,3 ]
机构：
[1] Univ Monastir, Microelect & Instrumentat Lab, Monastir, Tunisia
[2] Univ Monastir, Fac Sci Monastir, Monastir, Tunisia
[3] Univ Sousse, Higher Inst Appl Sci & Technol Sousse, Sousse, Tunisia
来源：
2021 18TH INTERNATIONAL MULTI-CONFERENCE ON SYSTEMS, SIGNALS & DEVICES (SSD) | 2021年
关键词：
FPGA; activation function; Tanh Exponential (TanhExp); Piecewise Linear approximation (PWL); Convolutional Neural Network (CNN); hardware resources;
D O I：
10.1109/SSD52085.2021.9429506
中图分类号：
TM [电工技术]; TN [电子技术、通信技术];
学科分类号：
0808 ; 0809 ;
摘要：
The most active research area for Field Programmable Gate Arrays is the Convolution Neural Network (CNN), and the gist of any CNN is an activation function. Therefore, various non-linear activation functions aloe required for deeper CNNo In this paper, we aim to implement the Tanh Exponential (TanhExp) activation function on Artix-7 and Zynq-7000. To this end, we will use the piecewise linear approximation and the second-order polynomial approximation while using the IEEE754 2008 floating-point representation. We present an investigation of the required hardware resources. We also evaluate the efficiency of each method of approximation and its derivative.
引用
收藏
页码：1020 / 1025
页数：6
相关论文
共 50 条
  • [1] A Configurable FPGA Implementation of the Tanh Function using DCT Interpolation
    Abdelsalam, Ahmed M.
    Langlois, J. M. Pierre
    Cheriet, F.
    2017 IEEE 25TH ANNUAL INTERNATIONAL SYMPOSIUM ON FIELD-PROGRAMMABLE CUSTOM COMPUTING MACHINES (FCCM 2017), 2017, : 168 - 171
  • [2] Hardware Implementation of Sigmoid Activation Functions using FPGA
    Tsmots, Ivan
    Rabyk, Vasyl
    Skorokhoda, Oleksa
    2019 IEEE 15TH INTERNATIONAL CONFERENCE ON THE EXPERIENCE OF DESIGNING AND APPLICATION OF CAD SYSTEMS (CADSM'2019), 2019,
  • [3] Hardware Implementation of the Exponential Function Using Taylor Series
    Nilsson, Peter
    Shaik, Ateeq Ur Rahman
    Gangarajaiah, Rakesh
    Hertz, Erik
    2014 NORCHIP, 2014,
  • [4] PhD Forum: Why TanH is a Hardware Friendly Activation Function for CNNs
    Abdelouahab, Kamel
    Pelcat, Maxime
    Berry, Francois
    11TH INTERNATIONAL CONFERENCE ON DISTRIBUTED SMART CAMERAS (ICDSC 2017), 2017, : 199 - 201
  • [5] Design and Implementation of Hardware Firewall using FPGA
    Keni, Swati Maloji
    Mande, Sudhakar
    2018 3RD INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2018,
  • [6] Hardware Implementation of KLMS Algorithm using FPGA
    Ren, Xiaowei
    Ren, Pengju
    Chen, Badong
    Min, Tai
    Zheng, Nanning
    PROCEEDINGS OF THE 2014 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2014, : 2276 - 2281
  • [7] Hardware Implementation of OFDM Transceiver using FPGA
    Krishna, E. Hari
    Sivani, K.
    Reddy, K. Ashoka
    2015 INTERNATIONAL CONFERENCE ON COMPUTER AND COMPUTATIONAL SCIENCES (ICCCS), 2015, : 3 - 7
  • [8] Hardware implementation of genetic algorithms using FPGA
    Tang, W
    Yip, L
    2004 47TH MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS, VOL I, CONFERENCE PROCEEDINGS, 2004, : 549 - 552
  • [9] Simplified Hardware Implementation of the Softmax Activation Function
    Kouretas, I.
    Paliouras, V.
    2019 8TH INTERNATIONAL CONFERENCE ON MODERN CIRCUITS AND SYSTEMS TECHNOLOGIES (MOCAST), 2019,
  • [10] FPGA implementation of 64-bit exponential function for HPC
    Jamro, Ernest
    Wiatr, Kazimierz
    Wielgosz, Maciej
    2007 INTERNATIONAL CONFERENCE ON FIELD PROGRAMMABLE LOGIC AND APPLICATIONS, PROCEEDINGS, VOLS 1 AND 2, 2007, : 718 - 721
12345