Speed-Accuracy Trade-Off? Not So Fast: Marginal Changes in Speed Have Inconsistent Relationships With Accuracy in Real-World Settings

被引：15

作者：

Domingue, Benjamin W. ^{[1
]}

Kanopka, Klint ^{[1
]}

Stenhaug, Ben ^{[1
]}

Sulik, Michael J. ^{[1
]}

Beverly, Tanesia ^{[2
,3
]}

Brinkhuis, Matthieu ^{[4
]}

Circi, Ruhan ^{[5
]}

Faul, Jessica ^{[6
]}

Liao, Dandan ^{[7
]}

McCandliss, Bruce ^{[1
]}

Obradovic, Jelena ^{[1
]}

Piech, Chris ^{[8
]}

Porter, Tenelle ^{[9
]}

Soland, James ^{[11
]}

Weeks, Jon ^{[12
]}

Wise, Steven L. ^{[13
]}

Yeatman, Jason ^{[1
,14
]}

机构：

[1] Stanford Grad Sch Educ, Stanford, CA 94305 USA

[2] Univ Connecticut, Storrs, CT USA

[3] Law Sch Admiss Council, Newtown, PA USA

[4] Univ Utrecht, Utrecht, Netherlands

[5] Amer Inst Res, Arlington, VA USA

[6] Univ Michigan, Ann Arbor, MI 48109 USA

[7] Cambium Assessment Inc, Washington, DC USA

[8] Stanford Univ, Stanford, CA 94305 USA

[9] Univ Calif Davis, Davis, CA 95616 USA

[10] Univ Calif San Francisco, San Francisco, CA 94143 USA

[11] Univ Virginia, Charlottesville, VA 22903 USA

[12] Educ Testing Serv, Princeton, NJ 08541 USA

[13] NWEA, Portland, OR USA

[14] Stanford Univ, Sch Med, Stanford, CA 94305 USA

来源：

JOURNAL OF EDUCATIONAL AND BEHAVIORAL STATISTICS | 2022年 / 47卷 / 05期

关键词：

response time; IRT; speed-accuracy trade-off; conditional accuracy function; ITEM RESPONSE THEORY; MODEL; TIMES; PACKAGE; AGE;

D O I：

10.3102/10769986221099906

中图分类号：

G40 [教育学];

学科分类号：

040101 ; 120403 ;

摘要：

The speed-accuracy trade-off (SAT) suggests that time constraints reduce response accuracy. Its relevance in observational settings-where response time (RT) may not be constrained but respondent speed may still vary-is unclear. Using 29 data sets containing data from cognitive tasks, we use a flexible method for identification of the SAT (which we test in extensive simulation studies) to probe whether the SAT holds. We find inconsistent relationships between time and accuracy; marginal increases in time use for an individual do not necessarily predict increases in accuracy. Additionally, the speed-accuracy relationship may depend on the underlying difficulty of the interaction. We also consider the analysis of items and individuals; of particular interest is the observation that respondents who exhibit more within-person variation in response speed are typically of lower ability. We further find that RT is typically a weak predictor of response accuracy. Our findings document a range of empirical phenomena that should inform future modeling of RTs collected in observational settings.

引用

页码：576 / 602

页数：27

共 50 条

[1]

Berge L., 2018, CREA DISCUSS PAP, V13

[2] Modeling Nonlinear Conditional Dependence Between Response Time and Accuracy [J].