Hardware Acceleration of Large-Scale CMOS Invertible Logic Based on Sparse Hamiltonian Matrices

被引:2
|
作者
Onizawa, Naoya [1 ]
Tamakoshi, Akira [1 ]
Hanyu, Takahiro [1 ]
机构
[1] Tohoku Univ, Res Inst Elect Commun, Sendai, Miyagi 9808577, Japan
来源
IEEE OPEN JOURNAL OF CIRCUITS AND SYSTEMS | 2021年 / 2卷
关键词
Training; Circuits and systems; Memory architecture; Neural networks; Central Processing Unit; Sparse matrices; Hardware acceleration; Boltzmann machine; sparse matrix; FPGA; integer factorization; COMPUTATION;
D O I
10.1109/OJCAS.2021.3116584
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Invertible logic has been recently presented that can realize bidirectional computing based on Hamiltonians for solving several critical issues, such as integer factorization and training neural networks. However, a hardware architecture for supporting large-scale general-purpose invertible logic has not been studied. In this paper, we introduce a scalable hardware architecture based on sparse Hamiltonian matrices. In order to store and compute the Hamiltonians efficiently in hardware, a sparse matrix representation of PTELL (partitioned and transposed ELLPACK) is proposed. A memory size of PTELL can be smaller than that of a conventional ELL by reducing the number of paddings while parallel reading of non-zero values are realized for high-throughput operations. As a result, PTELL achieves around 1% and 10% memory usages of a conventional dense and ELL matrices, respectively, in case of invertible multipliers. In addition, the proposed hardware accelerator of invertible logic for supporting arbitrary Hamiltonians is implemented on Xilinx VU9P FPGA, which achieves around two orders of magnitude faster than a 16-core Intel Xeon implementation.
引用
收藏
页码:782 / 791
页数:10
相关论文
共 50 条
  • [1] Scalable Hardware Architecture for Invertible Logic with Sparse Hamiltonian Matrices
    Onizawa, Naoya
    Tamakoshi, Akira
    Hanyu, Takahiro
    2021 IEEE WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS 2021), 2021, : 223 - 228
  • [2] Training Hardware for Binarized Convolutional Neural Network Based on CMOS Invertible Logic
    Shin, Duckgyu
    Onizawa, Naoya
    Gross, Warren J.
    Hanyu, Takahiro
    IEEE ACCESS, 2020, 8 : 188004 - 188014
  • [3] In-Hardware Training Chip Based on CMOS Invertible Logic for Machine Learning
    Onizawa, Naoya
    Smithson, Sean C.
    Meyer, Brett H.
    Gross, Warren J.
    Hanyu, Takahiro
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2020, 67 (05) : 1541 - 1550
  • [4] LARGE-SCALE VISUALIZATION OF SPARSE MATRICES
    Langr, D.
    Simecek, I.
    Tvrdiki, P.
    Dytrych, T.
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2014, 15 (01): : 21 - 31
  • [5] FAST HARDWARE-BASED LEARNING ALGORITHM FOR BINARIZED PERCEPTRONS USING CMOS INVERTIBLE LOGIC
    Onizawa, Naoya
    Shin, Duckgyu
    Hanyu, Takahiro
    JOURNAL OF APPLIED LOGICS-IFCOLOG JOURNAL OF LOGICS AND THEIR APPLICATIONS, 2020, 7 (01): : 41 - 58
  • [6] Hardware Acceleration in Large-Scale Tensor Decomposition for Neural Network Compression
    Kao, Chen-Chien
    Hsieh, Yi-Yen
    Chen, Chao-Hung
    Yang, Chia-Hsiang
    2022 IEEE 65TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS 2022), 2022,
  • [7] Neural Acceleration of Graph Based Utility Functions for Sparse Matrices
    Booth, Joshua Dennis
    Bolet, Gregory S.
    IEEE ACCESS, 2023, 11 : 31619 - 31635
  • [8] FSHMEM: Supporting Partitioned Global Address Space on FPGAs for Large-Scale Hardware Acceleration Infrastructure
    Arthanto, Yashael Faith
    Ojika, David
    Kim, Joo-Young
    2022 32ND INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE LOGIC AND APPLICATIONS, FPL, 2022, : 218 - 224
  • [9] An Evolutionary Algorithm for Large-Scale Sparse Multiobjective Optimization Problems
    Tian, Ye
    Zhang, Xingyi
    Wang, Chao
    Jin, Yaochu
    IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2020, 24 (02) : 380 - 393
  • [10] Efficient Sparse Large-Scale Multiobjective Optimization Based on Cross-Scale Knowledge Fusion
    Ding, Zhuanlian
    Chen, Lei
    Sun, Dengdi
    Zhang, Xingyi
    Liu, Wei
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2024, 54 (11): : 6989 - 7001