Hybrid Binary Neural Networks: A Tutorial Review

被引:1
作者
Cetin, Ahmet Enis [1 ]
Pan, Hongyi [1 ]
机构
[1] Univ Illinois, Dept Elect & Engn, Chicago, IL 60680 USA
来源
2023 IEEE 41ST VLSI TEST SYMPOSIUM, VTS | 2023年
关键词
Binary neurons; Binary Neural Networks; Walsh-Hadamard Transform; RECOGNITION;
D O I
10.1109/VTS56346.2023.10139963
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, we review neural networks which have neurons with binary operations or networks that use binary transforms such as the Walsh-Hadamard transform (WHT). Neural networks with binary neurons or binary layers can be used in edge applications and/or applications requiring energy-efficient decision-making. WHT-based network is as accurate as the regular neural networks in the CIFAR-10 and the Tiny ImageNet image databases.
引用
收藏
页数:12
相关论文
共 50 条
  • [21] A flexible learning algorithm for binary neural networks
    Yamamoto, A
    Saito, T
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 1998, E81A (09): : 1925 - 1930
  • [22] Sparse Dynamic Binary Neural Networks for Storage and Switching of Binary Periodic Orbits
    Anzai, Shota
    Koyama, Seitaro
    Aoki, Shunsuke
    Saito, Toshimichi
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 : 536 - 542
  • [23] SecBNN: Efficient Secure Inference on Binary Neural Networks
    Chen, Hanxiao
    Li, Hongwei
    Hao, Meng
    Hu, Jia
    Xu, Guowen
    Zhang, Xilin
    Zhang, Tianwei
    IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 : 10273 - 10286
  • [24] TRAINING ACCURATE BINARY NEURAL NETWORKS FROM SCRATCH
    Bethge, Joseph
    Yang, Haojin
    Meinel, Christoph
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 899 - 903
  • [25] Adaptive Linear Unit for Accurate Binary Neural Networks
    Mo, Ruchan
    Xu, Ke
    Liu, Li
    Liu, Lingzhi
    Wang, Dong
    2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, : 223 - 228
  • [26] A Simple Class of Binary Neural Networks and Logical Synthesis
    Nakayama, Yuta
    Ito, Ryo
    Saito, Toshimichi
    IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2011, E94A (09) : 1856 - 1859
  • [27] Efficient FeFET Crossbar Accelerator for Binary Neural Networks
    Soliman, Taha
    Olivo, Ricardo
    Kirchner, Tobias
    De la Parra, Cecilia
    Lederer, Maximilian
    Kampfe, Thomas
    Guntoro, Andre
    Wehn, Norbert
    2020 IEEE 31ST INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS (ASAP 2020), 2020, : 109 - 112
  • [28] Memory Efficient Binary Convolutional Neural Networks on Microcontrollers
    Sakr, Fouad
    Berta, Riccardo
    Doyle, Joseph
    Younes, Hamoud
    De Gloria, Alessandro
    Bellotti, Francesco
    2022 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING & COMMUNICATIONS (IEEE EDGE 2022), 2022, : 169 - 177
  • [29] Designed Dithering Sign Activation for Binary Neural Networks
    Monroy, Brayan
    Estupinan, Juan
    Gelvez-Barrera, Tatiana
    Bacca, Jorge
    Arguello, Henry
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2024, 18 (06) : 1100 - 1107
  • [30] Exploring the Connection Between Binary and Spiking Neural Networks
    Lu, Sen
    Sengupta, Abhronil
    FRONTIERS IN NEUROSCIENCE, 2020, 14