Hybrid Binary Neural Networks: A Tutorial Review

被引：1

作者：

Cetin, Ahmet Enis ^{[1
]}

Pan, Hongyi ^{[1
]}

机构：

[1] Univ Illinois, Dept Elect & Engn, Chicago, IL 60680 USA

来源：

2023 IEEE 41ST VLSI TEST SYMPOSIUM, VTS | 2023年

关键词：

Binary neurons; Binary Neural Networks; Walsh-Hadamard Transform; RECOGNITION;

D O I：

10.1109/VTS56346.2023.10139963

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this article, we review neural networks which have neurons with binary operations or networks that use binary transforms such as the Walsh-Hadamard transform (WHT). Neural networks with binary neurons or binary layers can be used in edge applications and/or applications requiring energy-efficient decision-making. WHT-based network is as accurate as the regular neural networks in the CIFAR-10 and the Tiny ImageNet image databases.

引用

页数：12

共 50 条

[11] Training binary neural networks with knowledge transfer [J].

Leroux, Sam ;

Vankeirsbilck, Bert ;

Verbelen, Tim ;

Simoens, Pieter ;

Dhoedt, Bart .

NEUROCOMPUTING, 2020, 396 :534-541

[12] On-Device Learning with Binary Neural Networks [J].

Vorabbi, Lorenzo ;

Maltoni, Davide ;

Santi, Stefano .

IMAGE ANALYSIS AND PROCESSING - ICIAP 2023 WORKSHOPS, PT I, 2024, 14365 :39-50

[13] BALANCED BINARY NEURAL NETWORKS WITH GATED RESIDUAL [J].

Shen, Mingzhu ;

Liu, Xianglong ;

Gong, Ruihao ;

Han, Kai .

2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, :4197-4201

[14] Learning Adaptive Gradients for Binary Neural Networks [J].

Wang Z.-W. ;

Lu J.-W. ;

Zhou J. .

Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2023, 51 (02) :257-266

[15] PIMBALL Binary Neural Networks in Spintronic Memory [J].

Resch, Salonik ;

Khatamifard, S. Karen ;

Chowdhury, Zamshed Iqbal ;

Zabihi, Masoud ;

Zhao, Zhengyang ;

Wang, Jian-Ping ;

Sapatnekar, Sachin S. ;

Karpuzcu, Ulya R. .

ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2019, 16 (04)

[16] Structured Binary Neural Networks for Image Recognition [J].

Bohan Zhuang ;

Chunhua Shen ;

Mingkui Tan ;

Peng Chen ;

Lingqiao Liu ;

Ian Reid .

International Journal of Computer Vision, 2022, 130 :2081-2102

[17] Feature distribution guided binary neural networks [J].

Liu C. ;

Chen Y. .

Kongzhi yu Juece/Control and Decision, 2024, 39 (06) :1840-1848

[18] SGDAT: An optimization method for binary neural networks [J].

Gu, Shan ;

Zhang, Guoyin ;

Jia, Chengwei ;

Wu, Yanxia .

NEUROCOMPUTING, 2023, 555

[19] Structured Binary Neural Networks for Image Recognition [J].

Zhuang, Bohan ;

Shen, Chunhua ;

Tan, Mingkui ;

Chen, Peng ;

Liu, Lingqiao ;

Reid, Ian .

INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (09) :2081-2102

[20] Optimizing Data Flow in Binary Neural Networks [J].

Vorabbi, Lorenzo ;

Maltoni, Davide ;

Santi, Stefano .

SENSORS, 2024, 24 (15)

← 1 2 3 4 5 →