An Efficient Real-Time Object Detection Framework on Resource-Constricted Hardware Devices via Software and Hardware Co-design (Invited Paper)

被引:6
|
作者
Liu, Mingshuo [1 ]
Luo, Shiyi [1 ]
Han, Kevin [1 ]
Yuan, Bo [2 ]
DeMara, Ronald F. [3 ]
Bai, Yu [1 ]
机构
[1] Calif State Univ Fullerton, Fullerton, CA 92634 USA
[2] Rutgers State Univ, New Brunswick, NJ USA
[3] Univ Cent Florida, Orlando, FL 32816 USA
来源
2021 IEEE 32ND INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS (ASAP 2021) | 2021年
基金
美国国家科学基金会;
关键词
Deep learning; FPGA; Tensor Train; Energy Efficiency; RECURRENT NEURAL-NETWORKS;
D O I
10.1109/ASAP52443.2021.00020
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
The fast development of object detection techniques has attracted attention to developing efficient Deep Neural Networks (DNNs). However, the current state-of-the-art DNN models can not provide a balanced solution among accuracy, speed, and model size. This paper proposes an efficient real-time object detection framework on resource-constricted hardware devices through hardware and software co-design. The Tensor Train (TT) decomposition is proposed for compressing the YOLOv5 model. By unitizing the unique characteristics given by the TT decomposition, we develop an efficient hardware accelerator based on FPGA devices. Experimental results show that the proposed method can significantly reduce the model size and improve the execution time.
引用
收藏
页码:77 / 84
页数:8
相关论文
共 50 条
  • [1] A Hardware/Software Co-Design Approach for Real-Time Object Detection and Tracking on Embedded Devices
    Bui, Casey
    Patel, Nirali
    Patel, Dishant
    Rogers, Samuel
    Sawant, Adarsh
    Manwatkar, Rishiraj
    Tabkhi, Hamed
    IEEE SOUTHEASTCON 2018, 2018,
  • [2] A Hardware-Software Co-Design Framework for Real-Time Video Stabilization
    Javed, Hassan
    Bilal, Muhammad
    Masud, Shahid
    JOURNAL OF CIRCUITS SYSTEMS AND COMPUTERS, 2020, 29 (02)
  • [3] Hardware-Software Co-Design for Efficient and Scalable Real-Time Emulation of SNNs on the Edge
    Angel Oltra-Oltra, Josep
    Madrenas, Jordi
    Zapata, Mireya
    Vallejo, Bernardo
    Mata-Hernandez, Diana
    Sato, Shigeo
    2021 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS (ISCAS), 2021,
  • [4] Invited Paper: Software/Hardware Co-design for LLM and Its Application for Design Verification
    Wan, Lily Jiaxin
    Huang, Yingbing
    Li, Yuhong
    Ye, Hanchen
    Wang, Jinghua
    Zhang, Xiaofan
    Chen, Deming
    29TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE, ASP-DAC 2024, 2024, : 435 - 441
  • [5] Hardware/software co-design of a real-time kernel based tracking system
    Ali, Usman
    Malik, Mohammad Bilal
    JOURNAL OF SYSTEMS ARCHITECTURE, 2010, 56 (08) : 317 - 326
  • [6] Co-design of Hardware and Algorithms for Real-time Optimization
    Kerrigan, Eric C.
    2014 EUROPEAN CONTROL CONFERENCE (ECC), 2014, : 2484 - 2489
  • [7] Hardware/software co-design of run-time schedulers for real-time systems
    Mooney III V.J.
    De Micheli G.
    Design Automation for Embedded Systems, 2000, 6 (01) : 89 - 144
  • [8] A Real-Time Face Recognition System by Efficient Hardware-Software Co-Design on FPGA SoCs
    Wang, Hao
    Cao, Shan
    Xu, Shugong
    2021 IEEE 3RD INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS), 2021,
  • [9] Hardware/software co-design for DSP applications via the HMS framework
    Sheliga, M
    Sha, EHM
    1996 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, CONFERENCE PROCEEDINGS, VOLS 1-6, 1996, : 1248 - 1251
  • [10] A Hardware/Software Co-Design Approach for Control Applications with Static Real-Time Reallocation
    Janssen, Benedikt
    Naserddin, Moataz
    Huebner, Michael
    2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW), 2016, : 241 - 246