Hybrid Binary Neural Networks: A Tutorial Review

被引：1

作者：

Cetin, Ahmet Enis ^{[1
]}

Pan, Hongyi ^{[1
]}

机构：

[1] Univ Illinois, Dept Elect & Engn, Chicago, IL 60680 USA

来源：

2023 IEEE 41ST VLSI TEST SYMPOSIUM, VTS | 2023年

关键词：

Binary neurons; Binary Neural Networks; Walsh-Hadamard Transform; RECOGNITION;

D O I：

10.1109/VTS56346.2023.10139963

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this article, we review neural networks which have neurons with binary operations or networks that use binary transforms such as the Walsh-Hadamard transform (WHT). Neural networks with binary neurons or binary layers can be used in edge applications and/or applications requiring energy-efficient decision-making. WHT-based network is as accurate as the regular neural networks in the CIFAR-10 and the Tiny ImageNet image databases.

引用

页数：12

共 50 条

[31] Universal Binary Neural Networks Design by Improved Differentiable Neural Architecture Search [J].

Tan, Menghao ;

Gao, Weifeng ;

Li, Hong ;

Xie, Jin ;

Gong, Maoguo .

IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (10) :9153-9165

[32] Massively Parallel Combinational Binary Neural Networks for Edge Processing [J].

Murovic, Tadej ;

Trost, Andrej .

ELEKTROTEHNISKI VESTNIK, 2019, 86 (1-2) :47-53

[33] Attention-Based Batch Normalization for Binary Neural Networks [J].

Gu, Shan ;

Zhang, Guoyin ;

Jia, Chengwei ;

Wu, Yanxia .

ENTROPY, 2025, 27 (06)

[34] Accelerating Inference on Binary Neural Networks with Digital RRAM Processing [J].

Vieira, Joao ;

Giacomin, Edouard ;

Qureshi, Yasir ;

Zapater, Marina ;

Tang, Xifan ;

Kvatinsky, Shahar ;

Atienza, David ;

Gaillardon, Pierre-Emmanuel .

VLSI-SOC: NEW TECHNOLOGY ENABLER, VLSI-SOC 2019, 2020, 586 :257-278

[35] BitStream: An efficient framework for inference of binary neural networks on CPUs [J].

Jiang, Yanshu ;

Zhao, Tianli ;

He, Xiangyu ;

Leng, Cong ;

Cheng, Jian .

PATTERN RECOGNITION LETTERS, 2019, 125 :303-309

[36] Evolved binary neural networks through harnessing FPGA capabilities [J].

Valencia, Raul ;

Sham, Chiu Wing ;

Sinnen, Oliver .

2019 INTERNATIONAL CONFERENCE ON FIELD-PROGRAMMABLE TECHNOLOGY (ICFPT 2019), 2019, :395-398

[37] Re-quantization based binary graph neural networks [J].

Yao, Kai-Lang ;

Li, Wu-Jun .

SCIENCE CHINA-INFORMATION SCIENCES, 2024, 67 (07)

[38] A GA-based learning algorithm for binary neural networks [J].

Shimada, M ;

Saito, T .

IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2002, E85A (11) :2544-2546

[39] Scaling Deep Spiking Neural Networks with Binary Stochastic Activations [J].

Roy, Deboleena ;

Chakraborty, Indranil ;

Roy, Kaushik .

2019 IEEE INTERNATIONAL CONFERENCE ON COGNITIVE COMPUTING (IEEE ICCC 2019), 2019, :50-58

[40] OvSW: Overcoming Silent Weights for Accurate Binary Neural Networks [J].

Xiang, Jingyang ;

Chen, Zuohui ;

Li, Siqi ;

Wu, Qing ;

Liu, Yong .

COMPUTER VISION - ECCV 2024, PT XXXIII, 2025, 15091 :1-18

← 1 2 3 4 5 →