Bias in Self-Reports: An Initial Elevation Phenomenon

被引:28
作者
Anvari, Farid [1 ]
Olsen, Jerome [3 ]
Arslan, Ruben C. [4 ,5 ]
Elson, Malte [6 ]
Schneider, Iris K. [1 ]
EfendiE, Emir [2 ]
机构
[1] Univ Cologne, Cologne, Germany
[2] Maastricht Univ, Sch Business & Econ, Maastricht, Netherlands
[3] Max Planck Inst Res Collect Goods, Bonn, Germany
[4] Univ Leipzig, Leipzig, Germany
[5] Max Planck Inst Human Dev, Berlin, Germany
[6] Ruhr Univ Bochum, Psychol Human Technol Interact, Bochum, Germany
关键词
attenuation phenomenon; measurement reactivity; initial elevation bias; self-reports; rating scales; Likert; GENERALIZED ANXIETY DISORDER; INVENTORY; RELIABILITY; ATTENUATION; VALIDATION; REACTIVITY; QUESTIONS; VALIDITY; DIARY; PHQ-9;
D O I
10.1177/19485506221129160
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Researchers have long worried about a phenomenon where study participants give higher ratings on self-report scales the first time they take a survey compared to subsequent times, particularly for negative subjective experiences. Recent experimental evidence, using samples of U.S. college students, suggests that this initial elevation phenomenon is due to an upward bias in people's initial responses. Such bias potentially undermines the validity of many research findings. However, more recent studies have found little evidence in support of the phenomenon. To investigate the robustness of the initial elevation phenomenon, we conducted the largest experiments to date in diverse online samples (N = 5,285 across three studies, from Prolific.co). We observed an initial elevation on self-reports of negative subjective experiences such as mood and mental and physical health symptoms. Our findings show that the threats to validity posed by the phenomenon are real and need to be reckoned with.
引用
收藏
页码:727 / 737
页数:11
相关论文
共 38 条
[1]   Routinely Randomize Potential Sources of Measurement Reactivity to Estimate and Adjust for Biases in Subjective Reports [J].
Arslan, Ruben C. ;
Reitz, Anne K. ;
Driebe, Julie C. ;
Gerlach, Tanja M. ;
Penke, Lars .
PSYCHOLOGICAL METHODS, 2021, 26 (02) :175-185
[2]   Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk [J].
Berinsky, Adam J. ;
Huber, Gregory A. ;
Lenz, Gabriel S. .
POLITICAL ANALYSIS, 2012, 20 (03) :351-368
[3]   Mechanical Turk upends social sciences [J].
Bohannon, John .
SCIENCE, 2016, 352 (6291) :1263-1264
[4]   THE DAILY STRESS INVENTORY - VALIDITY AND EFFECT OF REPEATED ADMINISTRATION [J].
BRANTLEY, PJ ;
COCKE, TB ;
JONES, GN ;
GORECZNY, AJ .
JOURNAL OF PSYCHOPATHOLOGY AND BEHAVIORAL ASSESSMENT, 1988, 10 (01) :75-81
[5]   Little Evidence for Consistent Initial Elevation Bias in Self-Reported Momentary Affect: A Coordinated Analysis of Ecological Momentary Assessment Studies [J].
Cerino, Eric S. ;
Schneider, Stefan ;
Stone, Arthur A. ;
Sliwinski, Martin J. ;
Mogle, Jacqueline ;
Smyth, Joshua M. .
PSYCHOLOGICAL ASSESSMENT, 2022, 34 (05) :467-482
[6]   A procedure for evaluating sensitivity to within-person change: Can mood measures in diary studies detect change reliably? [J].
Cranford, James A. ;
Shrout, Patrick E. ;
Iida, Masumi ;
Rafaeli, Eshkol ;
Yip, Tiffany ;
Bolger, Niall .
PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 2006, 32 (07) :917-929
[7]   THE PERSONALITY STRUCTURE OF AFFECT [J].
DIENER, E ;
SMITH, H ;
FUJITA, F .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 1995, 69 (01) :130-141
[8]   The rise of affectivism [J].
Dukes, Daniel ;
Abrams, Kathryn ;
Adolphs, Ralph ;
Ahmed, Mohammed E. ;
Beatty, Andrew ;
Berridge, Kent C. ;
Broomhall, Susan ;
Brosch, Tobias ;
Campos, Joseph J. ;
Clay, Zanna ;
Clement, Fabrice ;
Cunningham, William A. ;
Damasio, Antonio ;
Damasio, Hanna ;
D'Arms, Justin ;
Davidson, Jane W. ;
De Gelder, Beatrice ;
Deonna, Julien ;
De Sousa, Ronnie ;
Ekman, Paul ;
Ellsworth, Phoebe C. ;
Fehr, Ernst ;
Fischer, Agneta ;
Foolen, Ad ;
Frevert, Ute ;
Grandjean, Didier ;
Gratch, Jonathan ;
Greenberg, Leslie ;
Greenspan, Patricia ;
Gross, James J. ;
Halperin, Eran ;
Kappas, Arvid ;
Keltner, Dacher ;
Knutson, Brian ;
Konstan, David ;
Kret, Mariska E. ;
LeDoux, Joseph E. ;
Lerner, Jennifer S. ;
Levenson, Robert W. ;
Loewenstein, George ;
Manstead, Antony S. R. ;
Maroney, Terry A. ;
Moors, Agnes ;
Niedenthal, Paula ;
Parkinson, Brian ;
Pavlidis, Ioannis ;
Pelachaud, Catherine ;
Pollak, Seth D. ;
Pourtois, Gilles ;
Roettger-Roessler, Birgitt .
NATURE HUMAN BEHAVIOUR, 2021, 5 (07) :816-820
[9]   GPOWER: A general power analysis program [J].
Erdfelder, E ;
Faul, F ;
Buchner, A .
BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 1996, 28 (01) :1-11
[10]   Data quality of platforms and panels for online behavioral research [J].
Eyal, Peer ;
David, Rothschild ;
Andrew, Gordon ;
Zak, Evernden ;
Ekaterina, Damer .
BEHAVIOR RESEARCH METHODS, 2022, 54 (04) :1643-1662