Design and Implementation of Convolutional Neural Networks Accelerator Based on Multidie

被引:5
作者
Song, Qingzeng [1 ]
Zhang, Jiabing [1 ]
Sun, Liankun [1 ]
Jin, Guanghao [2 ]
机构
[1] Tiangong Univ, Sch Comp Sci & Technol, Tianjin 300387, Peoples R China
[2] Beijing Polytech, Sch Telecommun Engn, Beijing 100176, Peoples R China
来源
IEEE ACCESS | 2022年 / 10卷
基金
中国国家自然科学基金;
关键词
Convolutional neural networks; Quantization (signal); Object detection; Field programmable gate arrays; Mathematical models; Hardware acceleration; Hardware accelerator; multi-die; object detection; YOLOv4-tiny;
D O I
10.1109/ACCESS.2022.3199441
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To achieve real-time object detection tasks with high throughput and low latency, this paper proposes a multi-die hardware accelerator architecture. It implements three accelerators on the VU9P chip, each of which is bound to an independent super logic region (SLR). To reduce off-chip memory access and power consumption, this design uses three on-chip buffers to store the weights and intermediate result data on one hand; on the other hand, it minimizes data access and movement and maximizes data reuse. This design uses an 8-bit quantization strategy for both weights and feature maps to achieve twice the throughput and computational efficiency of a single digital signal processor (DSP). In addition, many operators are designed in the accelerator, and all of them are fully parameterized, so it is easy to extend the network, and the control of the accelerator can be realized by configuring the instruction group. By accelerating the YOLOv4-tiny algorithm, the accelerator architecture can achieve a frame rate of 148.14 frames per second (FPS) and a peak throughput of 2.76 tera operations per second (TOPS) at 200 MHz with an energy efficiency ratio of 93.15 GOPS/W. The code can be found at https://github.com/19801201/Verilog_CNN_Accelerator.
引用
收藏
页码:91497 / 91508
页数:12
相关论文
共 22 条
  • [21] Deep Guidance Network for Biomedical Image Segmentation
    Yin, Pengshuai
    Yuan, Rui
    Cheng, Yiming
    Wu, Qingyao
    [J]. IEEE ACCESS, 2020, 8 : 116106 - 116116
  • [22] Big Data Image Classification Based on Distributed Deep Representation Learning Model
    Zhu, Minjun
    Chen, Qinghua
    [J]. IEEE ACCESS, 2020, 8 : 133890 - 133904