Fair and Comprehensive Benchmarking of Machine Learning Processing Chips

被引:13
作者
Burr, Geoffrey W. [1 ]
Lim, SukHwan [2 ]
Murmann, Boris [3 ]
Venkatesan, Rangharajan [4 ]
Verhelst, Marian [5 ,6 ]
机构
[1] IBM Res Almaden, Cupertino, CA 95014 USA
[2] Samsung, Hwaseong Si 18448, South Korea
[3] Stanford Univ, Stanford, CA 94305 USA
[4] NVIDIA Corp, Santa Clara, CA 95051 USA
[5] MICAS KU Leuven, B-3001 Heverlee, Belgium
[6] IMEC, B-3001 Heverlee, Belgium
关键词
YY Benchmark testing; Computer architecture; Measurement; Integrated circuit modeling; Best practices; Computational modeling; AI processing; ML accelerator; chip evaluation; benchmarking; deep learning; architecture; circuit; ACCELERATOR;
D O I
10.1109/MDAT.2021.3063366
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
This article provides an overview of benchmarking strategies at a different set of abstraction levels and related best practices in each, while working to also give an overall view of impact. © 2013 IEEE.
引用
收藏
页码:18 / 27
页数:10
相关论文
共 35 条
[1]  
[Anonymous], AITUTU BENCHMARK
[2]  
Banbury C.R., 2020, Benchmarking TinyML systems: Challenges and direction
[3]   An Always-On 3.8 μJ/86% CIFAR-10 Mixed-Signal Binary CNN Processor With All Memory on Chip in 28-nm CMOS [J].
Bankman, Daniel ;
Yang, Lita ;
Moons, Bert ;
Verhelst, Marian ;
Murmann, Boris .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2019, 54 (01) :158-172
[4]  
Bankman D, 2016, IEEE ASIAN SOLID STA, P21, DOI 10.1109/ASSCC.2016.7844125
[5]   Neuromorphic computing using non-volatile memory [J].
Burr, Geoffrey W. ;
Shelby, Robert M. ;
Sebastian, Abu ;
Kim, Sangbum ;
Kim, Seyoung ;
Sidler, Severin ;
Virwani, Kumar ;
Ishii, Masatoshi ;
Narayanan, Pritish ;
Fumarola, Alessandro ;
Sanches, Lucas L. ;
Boybat, Irem ;
Le Gallo, Manuel ;
Moon, Kibong ;
Woo, Jiyoo ;
Hwang, Hyunsang ;
Leblebici, Yusuf .
ADVANCES IN PHYSICS-X, 2017, 2 (01) :89-124
[6]  
Cai H, 2019, INT C LEARN REPR
[7]  
Camus V, 2019, 2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE CIRCUITS AND SYSTEMS (AICAS 2019), P57, DOI [10.1109/AICAS.2019.8771610, 10.1109/aicas.2019.8771610]
[8]   Eyeriss v2: A Flexible Accelerator for Emerging Deep Neural Networks on Mobile Devices [J].
Chen, Yu-Hsin ;
Yange, Tien-Ju ;
Emer, Joel S. ;
Sze, Vivienne .
IEEE JOURNAL ON EMERGING AND SELECTED TOPICS IN CIRCUITS AND SYSTEMS, 2019, 9 (02) :292-308
[9]  
Ding Z, 2020, ARXIV200106679
[10]   Vocell: A 65-nm Speech-Triggered Wake-Up SoC for 10-μW Keyword Spotting and Speaker Verification [J].
Giraldo, Juan Sebastian P. ;
Lauwereins, Steven ;
Badami, Komail ;
Verhelst, Marian .
IEEE JOURNAL OF SOLID-STATE CIRCUITS, 2020, 55 (04) :868-878