A standard for test reliability in group research

被引:15
作者
Ellis, Jules L. [1 ]
机构
[1] Radboud Univ Nijmegen, Sch Psychol & Artificial Intelligence, NL-6500 HE Nijmegen, Netherlands
关键词
Attenuation; Coefficient alpha; Efficient; Reliability; Power; COEFFICIENT ALPHA; SCORE RELIABILITY; MEASUREMENT ERROR; FUTURE; POWER;
D O I
10.3758/s13428-012-0223-z
中图分类号
B841 [心理学研究方法];
学科分类号
040201 ;
摘要
Many authors adhere to the rule that test reliabilities should be at least .70 or .80 in group research. This article introduces a new standard according to which reliabilities can be evaluated. This standard is based on the costs or time of the experiment and of administering the test. For example, if test administration costs are 7 % of the total experimental costs, the efficient value of the reliability is .93. If the actual reliability of a test is equal to this efficient reliability, the test size maximizes the statistical power of the experiment, given the costs. As a standard in experimental research, it is proposed that the reliability of the dependent variable be close to the efficient reliability. Adhering to this standard will enhance the statistical power and reduce the costs of experiments.
引用
收藏
页码:16 / 24
页数:9
相关论文
共 35 条
[1]   Power and money: Designing statistically powerful studies while minimizing financial costs [J].
Allison, DB ;
Allison, RL ;
Faith, MS ;
Paultre, F ;
PiSunyer, FX .
PSYCHOLOGICAL METHODS, 1997, 2 (01) :20-33
[2]  
[Anonymous], 1945, Psychometrika, DOI DOI 10.1007/BF02288892
[3]  
[Anonymous], 1999, STAND ED PSYCH TEST
[4]   Alpha, Dimension-Free, and Model-Based Internal Consistency Reliability [J].
Bentler, Peter M. .
PSYCHOMETRIKA, 2009, 74 (01) :137-143
[5]   A General Approach for Estimating Scale Score Reliability for Panel Survey Data [J].
Biemer, Paul P. ;
Christ, Sharon L. ;
Wiesen, Christopher A. .
PSYCHOLOGICAL METHODS, 2009, 14 (04) :400-412
[6]   True scores, latent variables, and constructs: A comment on Schmidt and Hunter [J].
Borsboom, D ;
Mellenbergh, GJ .
INTELLIGENCE, 2002, 30 (06) :505-514
[7]   An essay on the history and future of reliability from the perspective of replications [J].
Brennan, RL .
JOURNAL OF EDUCATIONAL MEASUREMENT, 2001, 38 (04) :295-317
[8]   The correction for attenuation due to measurement error: Clarifying concepts and creating confidence sets [J].
Charles, EP .
PSYCHOLOGICAL METHODS, 2005, 10 (02) :206-226
[9]  
Cohen J., 1988, Statistical power analysis for the behavioral sciences, VSecond
[10]   WHAT IS COEFFICIENT ALPHA - AN EXAMINATION OF THEORY AND APPLICATIONS [J].
CORTINA, JM .
JOURNAL OF APPLIED PSYCHOLOGY, 1993, 78 (01) :98-104