Accuracy Analysis of Node Activation Function Based on Hardware Implementation of Artificial Neural Network

被引:0
作者
Jiang, Nan [1 ]
Hou, Ligang [1 ]
Guo, Jia [1 ]
Zhang, Xinyi [1 ]
Lv, Ang [1 ]
机构
[1] Beijing Univ Technol, VLSI & Syst Lab, Beijing, Peoples R China
来源
2018 3RD IEEE INTERNATIONAL CONFERENCE ON INTEGRATED CIRCUITS AND MICROSYSTEMS (ICICM) | 2018年
关键词
artificial neural network; VLSI; piecewise nonlinear approximation; bit level mapping;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
One of the difficulties encountered in realizing artificial neural network based on VLSI is the choice of the implementation method of activation function. At present, the main approaches to solve this problem are piecewise nonlinear approximation and bit level mapping. Based on hyperbolic tangent, the final output error of the two methods is discussed through the hardware implementation and software analysis of the artificial neural network nodes. We found that the nonlinear approximation method has the problem of large output fluctuation, and the amplification effect of the backpropagation can not be ignored. Therefore, this paper proposes that the bit level mapping method has more advantages in practical applications in the implementation of high-precision artificial neural nodes.
引用
收藏
页码:278 / 281
页数:4
相关论文
共 10 条
[1]   Piecewise linear approximation applied to nonlinear function of a neural network [J].
Amin, H ;
Curtis, KM ;
Hayes-Gill, BR .
IEE PROCEEDINGS-CIRCUITS DEVICES AND SYSTEMS, 1997, 144 (06) :313-317
[2]  
Ferreira P, 2004, INT C FIELD PROGR LO, P0830
[3]  
Gomar S, 2016, CONF REC ASILOMAR C, P1586, DOI 10.1109/ACSSC.2016.7869646
[4]  
MOLZ R F, CODESIGN FULLY PARAL
[5]   EFFICIENT IMPLEMENTATION OF PIECEWISE LINEAR ACTIVATION FUNCTION FOR DIGITAL VLSI NEURAL NETWORKS [J].
MYERS, DJ ;
HUTCHINSON, RA .
ELECTRONICS LETTERS, 1989, 25 (24) :1662-1663
[6]  
OUAL J, 1990, INT NEUR NETW C
[7]  
Tommiska M., 2003, IEEECOMPUT DIGITAL T
[8]  
Xie Xiao, 2009, SHANG DONG SIENCE, V22, P7
[9]  
Xie Zhenzhe, 2012 IEEE 5 INT C AD
[10]  
Zamanlooy B., 2013, IEEE Trans. VLSI Syst, V22, P39, DOI DOI 10.1109/TVLSI.2012.2232321