THE SPEC BENCHMARKS

被引:32
作者
DIXIT, KM
机构
[1] Sun Microsystems, Inc., Mountain View, CA
关键词
BENCHMARKS; SYSTEM PERFORMANCE; PERFORMANCE METRIC; SPEC; PERFORMANCE RESULTS;
D O I
10.1016/S0167-8191(05)80033-X
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This paper characterizes problems with popular benchmarks used to measure system performance and describes the history, structure, mission, future, and workings of an evolving standard in characterizing systems performance. Systems Performance Evaluation Cooperative (SPEC) represents an effort of major computer companies to create a yardstick to measure the performance of computer systems. This paper compares results of three architectures with traditional performance metrics and metrics developed by SPEC. It discusses strengths and weaknesses of SPEC and warns users about the dangers of single number performance characterization.
引用
收藏
页码:1195 / 1209
页数:15
相关论文
共 23 条
[1]  
BAILEY DH, 1985, NASA86711 TECH MEM
[2]  
BETZ DM, 1988, XLISP 1 6
[3]  
CARR S, 1989, 4TH SIAM C PAR PROC
[4]  
Cmelik R. F., 1991, ANAL MIPS SPARC INST
[5]  
CONTE TM, 1991, IEEE COMPUT JAN
[6]  
CURNOW HJ, 1989, GNU CC COMPILER VERS
[7]  
DIXIT K, 1990, SPEC BENCHMARK RESUL, V2
[8]  
DIXIT KM, 1991, SUNTECH J, V4
[9]  
DODUC N, 1989, FORTRAN EXECUTION TI
[10]  
Dongarra J. J., 1989, PERFORMANCE VARIOUS