Towards Quantized Stochastic Computing by Leveraging Reduced Precision Binary Numbers through Bit Truncation

被引:3
作者
Lee, Donghui [1 ]
Kim, Yongtae [1 ]
机构
[1] Kyungpook Natl Univ, Sch Comp Sci & Engn, Daegu, South Korea
来源
2023 IEEE 41ST INTERNATIONAL CONFERENCE ON COMPUTER DESIGN, ICCD | 2023年
关键词
stochastic computing; quantization; bit truncation; stochastic number generator; comparator;
D O I
10.1109/ICCD58817.2023.00069
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Stochastic computing (SC) offers high hardware efficiency and error tolerance but faces challenges, such as the overhead of converting between binary and stochastic forms. This paper introduces a novel quantized SC architecture, significantly reducing stochastic number generator (SNG) hardware complexity. We achieve this by quantizing binary numbers to lower precision using various bit truncation schemes, thereby reducing SNG overhead. Implemented in a 65-nm CMOS process, our proposed quantized SNG reduces area and power by up to 65.5% and 73.0%, respectively, compared to the conventional full-precision SNG. We also demonstrate that our SC schemes have minimal impact on processing quality while greatly improving hardware efficiency, as seen in a digital image processing application.
引用
收藏
页码:419 / 422
页数:4
相关论文
共 10 条
[1]   The Promise and Challenge of Stochastic Computing [J].
Alaghi, Armin ;
Qian, Weikang ;
Hayes, John P. .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2018, 37 (08) :1515-+
[2]  
Gaines B. R., 1969, Stochastic Computing Systems, V2, P37
[3]   Compact and Accurate Digital Filters Based on Stochastic Computing [J].
Ichihara, Hideyuki ;
Sugino, Tatsuyoshi ;
Ishii, Shota ;
Iwagaki, Tsuyoshi ;
Inoue, Tomoo .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2019, 7 (01) :31-43
[4]   An Accurate and Efficient Stochastic Computing Adder Exploiting Bit Shuffle Control Scheme [J].
Lee, Donghui ;
Baik, Junhyuk ;
Kim, Yongtae .
2022 19TH INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2022, :51-52
[5]   Architecture Considerations for Stochastic Computing Accelerators [J].
Lee, Vincent T. ;
Alaghi, Armin ;
Pamula, Rajesh ;
Sathe, Visvesh S. ;
Ceze, Luis ;
Oskin, Mark .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2018, 37 (11) :2277-2289
[6]  
Liu ST, 2020, DES AUT TEST EUROPE, P604, DOI 10.23919/DATE48585.2020.9116562
[7]   A Survey of Stochastic Computing Neural Networks for Machine Learning Applications [J].
Liu, Yidong ;
Liu, Siting ;
Wang, Yanzhi ;
Lombardi, Fabrizio ;
Han, Jie .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (07) :2809-2824
[8]   An FPGA Implementation of Stochastic Computing-based LSTM [J].
Maor, Guy ;
Zeng, Xiaoming ;
Wang, Zhendong ;
Hu, Yang .
2019 IEEE 37TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD 2019), 2019, :38-46
[9]   A VLSI Digital Circuit Platform for Performing Deterministic Stochastic Computing in the Time Dimension Using Fraction Operations on Rational Numbers [J].
Wei, Xiangye ;
Xiu, Liming .
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTING, 2023, 11 (01) :194-207
[10]   Accurate and Efficient Stochastic Computing Hardware for Convolutional Neural Networks [J].
Yu, Joonsang ;
Kim, Kyounghoon ;
Lee, Jongeun ;
Choi, Kiyoung .
2017 IEEE 35TH INTERNATIONAL CONFERENCE ON COMPUTER DESIGN (ICCD), 2017, :105-112