Hybrid Binary Neural Networks: A Tutorial Review

被引：1

作者：

Cetin, Ahmet Enis ^{[1
]}

Pan, Hongyi ^{[1
]}

机构：

[1] Univ Illinois, Dept Elect & Engn, Chicago, IL 60680 USA

来源：

2023 IEEE 41ST VLSI TEST SYMPOSIUM, VTS | 2023年

关键词：

Binary neurons; Binary Neural Networks; Walsh-Hadamard Transform; RECOGNITION;

D O I：

10.1109/VTS56346.2023.10139963

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this article, we review neural networks which have neurons with binary operations or networks that use binary transforms such as the Walsh-Hadamard transform (WHT). Neural networks with binary neurons or binary layers can be used in edge applications and/or applications requiring energy-efficient decision-making. WHT-based network is as accurate as the regular neural networks in the CIFAR-10 and the Tiny ImageNet image databases.

引用

页数：12

共 50 条

[21] A flexible learning algorithm for binary neural networks [J].

Yamamoto, A ;

Saito, T .

IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 1998, E81A (09) :1925-1930

[22] Sparse Dynamic Binary Neural Networks for Storage and Switching of Binary Periodic Orbits [J].

Anzai, Shota ;

Koyama, Seitaro ;

Aoki, Shunsuke ;

Saito, Toshimichi .

NEURAL INFORMATION PROCESSING (ICONIP 2019), PT II, 2019, 11954 :536-542

[23] SecBNN: Efficient Secure Inference on Binary Neural Networks [J].

Chen, Hanxiao ;

Li, Hongwei ;

Hao, Meng ;

Hu, Jia ;

Xu, Guowen ;

Zhang, Xilin ;

Zhang, Tianwei .

IEEE TRANSACTIONS ON INFORMATION FORENSICS AND SECURITY, 2024, 19 :10273-10286

[24] TRAINING ACCURATE BINARY NEURAL NETWORKS FROM SCRATCH [J].

Bethge, Joseph ;

Yang, Haojin ;

Meinel, Christoph .

2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, :899-903

[25] Adaptive Linear Unit for Accurate Binary Neural Networks [J].

Mo, Ruchan ;

Xu, Ke ;

Liu, Li ;

Liu, Lingzhi ;

Wang, Dong .

2022 16TH IEEE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP2022), VOL 1, 2022, :223-228

[26] A Simple Class of Binary Neural Networks and Logical Synthesis [J].

Nakayama, Yuta ;

Ito, Ryo ;

Saito, Toshimichi .

IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2011, E94A (09) :1856-1859

[27] Efficient FeFET Crossbar Accelerator for Binary Neural Networks [J].

Soliman, Taha ;

Olivo, Ricardo ;

Kirchner, Tobias ;

De la Parra, Cecilia ;

Lederer, Maximilian ;

Kampfe, Thomas ;

Guntoro, Andre ;

Wehn, Norbert .

2020 IEEE 31ST INTERNATIONAL CONFERENCE ON APPLICATION-SPECIFIC SYSTEMS, ARCHITECTURES AND PROCESSORS (ASAP 2020), 2020, :109-112

[28] Memory Efficient Binary Convolutional Neural Networks on Microcontrollers [J].

Sakr, Fouad ;

Berta, Riccardo ;

Doyle, Joseph ;

Younes, Hamoud ;

De Gloria, Alessandro ;

Bellotti, Francesco .

2022 IEEE INTERNATIONAL CONFERENCE ON EDGE COMPUTING & COMMUNICATIONS (IEEE EDGE 2022), 2022, :169-177

[29] Exploring the Connection Between Binary and Spiking Neural Networks [J].

Lu, Sen ;

Sengupta, Abhronil .

FRONTIERS IN NEUROSCIENCE, 2020, 14

[30] Designed Dithering Sign Activation for Binary Neural Networks [J].

Monroy, Brayan ;

Estupinan, Juan ;

Gelvez-Barrera, Tatiana ;

Bacca, Jorge ;

Arguello, Henry .

IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2024, 18 (06) :1100-1107

← 1 2 3 4 5 →