Reconfigurable Hardware Design Approach for Economic Neural Network

被引:24
作者
Khalil, Kasem [1 ,2 ]
Kumar, Ashok [3 ]
Bayoumi, Magdy [4 ]
机构
[1] Univ Mississippi, Elect & Comp Engn Dept, Oxford, MS 38677 USA
[2] Assiut Univ, Elect Engn Dept, Asyut 71515, Egypt
[3] Univ Louisiana Lafayette, Ctr Adv Comp Studies, Lafayette, LA 70504 USA
[4] Univ Louisiana Lafayette, Dept Elect & Comp Engn, Lafayette, LA 70504 USA
关键词
Artificial neural network; hardware neural network; image recognition; pattern recognition; FPGA implementation;
D O I
10.1109/TCSII.2022.3191342
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Hardware-based neural networks are becoming attractive because of their superior performance. One of the research challenges is to design such hardware using less area to minimize the cost of on-chip implementation. This brief proposes an area-efficient implementation of an Artificial Neural Network (ANN). The proposed method reduces the number of layers in the ANN by nearly half through a novel, dual use of some layers denoted as hidden layers. The hidden layers are non-traditional layers proposed in this brief. They are adaptable, and each such layer performs two separate functions through judicious use of different weights. Thus, each hidden or flexible layer does the work of two traditional ANN layers. The other type of layers used in the proposed design is the fixed layers that are used traditionally. The fixed layers are not flexible and serve the functionality of a single layer. The proposed design keeps the number of the fixed layers as low as possible. One or more fixed layers may still be needed for some applications besides the proposed flexible layers. The proposed method is implemented in Verilog HDL on Altera Arria 10 GX FPGA. Its area usage is only 41% of the state-of-the-art method, while its power consumption and speed overheads are small.
引用
收藏
页码:5094 / 5098
页数:5
相关论文
共 24 条
[1]   State-of-the-art in artificial neural network applications: A survey [J].
Abiodun, Oludare Isaac ;
Jantan, Aman ;
Omolara, Abiodun Esther ;
Dada, Kemi Victoria ;
Mohamed, Nachaat AbdElatif ;
Arshad, Humaira .
HELIYON, 2018, 4 (11)
[2]  
Alghoul A., 2018, International Journal of Academic Engineering Research (IJAER), V2, P8
[3]  
[Anonymous], 2009, Rep. TR-2009
[4]  
Colangelo P, 2019, IEEE HIGH PERF EXTR, DOI 10.1109/hpec.2019.8916533
[5]   Tool-wear prediction and pattern-recognition using artificial neural network and DNA-based computing [J].
D'Addona, Doriana M. ;
Ullah, A. M. M. Sharif ;
Matarazzo, D. .
JOURNAL OF INTELLIGENT MANUFACTURING, 2017, 28 (06) :1285-1301
[6]  
Nguyen DA, 2018, PROCEEDINGS OF 2018 5TH NAFOSTED CONFERENCE ON INFORMATION AND COMPUTER SCIENCE (NICS 2018), P237, DOI 10.1109/NICS.2018.8606843
[7]   DNN-Life: An Energy-Efficient Aging Mitigation Framework for Improving the Lifetime of On-Chip Weight Memories in Deep Neural Network Hardware Architectures [J].
Hanif, Muhammad Abdullah ;
Shafique, Muhammad .
PROCEEDINGS OF THE 2021 DESIGN, AUTOMATION & TEST IN EUROPE CONFERENCE & EXHIBITION (DATE 2021), 2021, :729-734
[8]  
Huang CW, 2017, IEEE INT CON MULTI, P583, DOI 10.1109/ICME.2017.8019296
[9]   A DATABASE FOR HANDWRITTEN TEXT RECOGNITION RESEARCH [J].
HULL, JJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (05) :550-554
[10]   Designing Novel AAD Pooling in Hardware for a Convolutional Neural Network Accelerator [J].
Khalil, Kasem ;
Eldash, Omar ;
Kumar, Ashok ;
Bayoumi, Magdy .
IEEE TRANSACTIONS ON VERY LARGE SCALE INTEGRATION (VLSI) SYSTEMS, 2022, 30 (03) :303-314