ILP-based Multi-Branch CNNs Mapping on Processing-in-Memory Architecture

被引:0
|
作者
Han, Haodong [1 ]
Wang, Junpeng [1 ]
Ding, Bo [1 ]
Chen, Song [1 ]
机构
[1] Univ Sci & Technol China, Hefei, Anhui, Peoples R China
来源
2024 IEEE 6TH INTERNATIONAL CONFERENCE ON AI CIRCUITS AND SYSTEMS, AICAS 2024 | 2024年
关键词
convolutional neural network; mapping; 3D-stacked DRAM; processing in memory;
D O I
10.1109/AICAS59952.2024.10595921
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D-stacked-DRAM-based processing-in-memory (DRAM-PIM) architectures demonstrate benefits in memory access bandwidth and energy efficiency and effectively mitigate the storage wall challenge posed by CNNs. However, DRAM-PIM architectures have a huge mapping space for multi-branch CNNs and inadequate mapping increases the latency of CNNs and the memory requirement of nodes. In this work, we propose an integer linear programming (ILP) method that integrates layer scheduling and resource quantity allocation to minimize overall latency. An ILP-based binding method is introduced to bind layers onto a node array of DRAM-PIM architectures with the maximum memory requirement of nodes reduced. Experimental results demonstrate that our method reduces the latency of branching structures in CNNs and achieves better memory balancing between nodes compared to the baseline method.
引用
收藏
页码:179 / 183
页数:5
相关论文
共 50 条
  • [31] DrPIM: An Adaptive and Less-blocking Data Replication Framework for Processing-in-Memory Architecture
    Xu, Sheng
    Xue, Hongyu
    Luo, Le
    Yan, Liang
    Zou, Xingqi
    PROCEEDINGS OF THE GREAT LAKES SYMPOSIUM ON VLSI 2023, GLSVLSI 2023, 2023, : 385 - 389
  • [32] FeMPIM: A FeFET-Based Multifunctional Processing-in-Memory Cell
    Yan, Aibin
    Chen, Yu
    Gao, Zhongyu
    Ni, Tianming
    Huang, Zhengfeng
    Cui, Jie
    Girard, Patrick
    Wen, Xiaoqing
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2024, 71 (04) : 2299 - 2303
  • [33] A prototype Processing-in-Memory (PIM) chip for the Data-Intensive Architecture (DIVA) system
    Draper, J
    Barrett, J
    Sondeen, J
    Mediratta, S
    Kang, C
    Kim, I
    Daglikoca, G
    JOURNAL OF VLSI SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2005, 40 (01): : 73 - 84
  • [34] Ultra-High-Speed Accelerator Architecture for Convolutional Neural Network Based on Processing-in-Memory Using Resistive Random Access Memory
    Wang, Hongzhe
    Wang, Junjie
    Hu, Hao
    Li, Guo
    Hu, Shaogang
    Yu, Qi
    Liu, Zhen
    Chen, Tupei
    Zhou, Shijie
    Liu, Yang
    SENSORS, 2023, 23 (05)
  • [35] A Prototype Processing-In-Memory (PIM) Chip for the Data-Intensive Architecture (DIVA) System
    Jaffrey Draper
    J. Tim Barrett
    Jeff Sondeen
    Sumit Mediratta
    Chang Woo Kang
    Ihn Kim
    Gokhan Daglikoca
    Journal of VLSI signal processing systems for signal, image and video technology, 2005, 40 : 73 - 84
  • [36] Connection-based Processing-In-Memory Engine Design Based on Resistive Crossbars
    Zhang, Shuhang
    Li, Hai
    Schlichtmann, Ulf
    2021 26TH ASIA AND SOUTH PACIFIC DESIGN AUTOMATION CONFERENCE (ASP-DAC), 2021, : 107 - 113
  • [37] A multi-branch convolutional neural network for snoring detection based on audio
    Dong, Hao
    Wu, Haitao
    Yang, Guan
    Zhang, Junming
    Wan, Keqin
    COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING, 2024,
  • [38] Deep Multi-Branch CNN Architecture for Early Alzheimer's Detection from Brain MRIs
    Mandal, Paul K.
    Mahto, Rakeshkumar V.
    SENSORS, 2023, 23 (19)
  • [39] A Survey of ReRAM-Based Architectures for Processing-In-Memory and Neural Networks
    Mittal, Sparsh
    MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2019, 1 (01): : 75 - 114
  • [40] SISA: Set-Centric Instruction Set Architecture for Graph Mining on Processing-in-Memory Systems
    Besta, Maciej
    Kanakagiri, Raghavendra
    Kwasniewski, Grzegorz
    Ausavarungnirun, Rachata
    Beranek, Jakub
    Kanellopoulos, Konstantinos
    Janda, Kacper
    Vonarburg-Shmaria, Zur
    Gianinazzi, Lukas
    Stefan, Ioana
    Gomez-Luna, Juan
    Copik, Marcin
    Kapp-Schwoerer, Lukas
    Di Girolamo, Salvatore
    Blach, Nils
    Konieczny, Marek
    Mutlu, Onur
    Hoefler, Torsten
    PROCEEDINGS OF 54TH ANNUAL IEEE/ACM INTERNATIONAL SYMPOSIUM ON MICROARCHITECTURE, MICRO 2021, 2021, : 282 - 297