CHEATING ON POLITICAL KNOWLEDGE QUESTIONS IN ONLINE SURVEYS AN ASSESSMENT OF THE PROBLEM AND SOLUTIONS

被引:59
作者
Clifford, Scott [1 ]
Jerit, Jennifer [2 ]
机构
[1] Univ Houston, Dept Polit Sci, 3551 Cullen Blvd Room 447, Houston, TX 77204 USA
[2] SUNY Stony Brook, Dept Polit Sci, Stony Brook, NY 11794 USA
关键词
PARTISAN BIAS; WEB SURVEYS; CONSEQUENCES; TELEPHONE; RESPONSES; INTERNET; WORKERS; IMPACT;
D O I
10.1093/poq/nfw030
中图分类号
G2 [信息与知识传播];
学科分类号
05 ; 0503 ;
摘要
Survey researchers worry about the quality of data produced by online surveys. One concern is that respondents might cheat on performance questions, such as political knowledge, invalidating their responses. Yet, existing evidence is unclear about the prevalence of cheating, and scholars lack a validated method for coping with the problem. In this paper, we demonstrate that such cheating behavior varies considerably by sample and provide some evidence that it is motivated by self-deceptive enhancement. We experimentally test a variety of methods for reducing cheating and find that common methods, such as timers, are not the most effective approach. By contrast, a commitment mechanism, in which respondents affirm their choice not to cheat, is more efficacious. Although cheating in online surveys can distort estimates of knowledge and decrease the validity of the measure, there are methods for coping with this problem.
引用
收藏
页码:858 / 887
页数:30
相关论文
共 53 条
[1]  
[Anonymous], 2002, DEP PAPERS ASC
[2]  
[Anonymous], 2015, WORKING PAPER
[3]   Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison [J].
Ansolabehere, Stephen ;
Schaffner, Brian F. .
POLITICAL ANALYSIS, 2014, 22 (03) :285-303
[4]   The Question(s) of Political Knowledge [J].
Barabas, Jason ;
Jerit, Jennifer ;
Pollock, William ;
Rainey, Carlisle .
AMERICAN POLITICAL SCIENCE REVIEW, 2014, 108 (04) :840-855
[5]   Separating the Shirkers from the Workers? Making Sure Respondents Pay Attention on Self-Administered Surveys [J].
Berinsky, Adam J. ;
Margolis, Michele F. ;
Sances, Michael W. .
AMERICAN JOURNAL OF POLITICAL SCIENCE, 2014, 58 (03) :739-753
[6]   Evaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk [J].
Berinsky, Adam J. ;
Huber, Gregory A. ;
Lenz, Gabriel S. .
POLITICAL ANALYSIS, 2012, 20 (03) :351-368
[7]   MEASURING SOCIAL DESIRABILITY RESPONDING. A SHORT VERSION OF PAULHUS' BIDR 6 [J].
Bobbio, Andrea ;
Manganelli, Anna Maria .
TPM-TESTING PSYCHOMETRICS METHODOLOGY IN APPLIED PSYCHOLOGY, 2011, 18 (02) :117-135
[8]   Social desirability effects on computerized and paper-and-pencil questionnaires [J].
Booth-Kewley, Stephanie ;
Larson, Gerald E. ;
Miyoshi, Dina K. .
COMPUTERS IN HUMAN BEHAVIOR, 2007, 23 (01) :463-477
[9]   Understanding the Better Than Average Effect: Motives (Still) Matter [J].
Brown, Jonathon D. .
PERSONALITY AND SOCIAL PSYCHOLOGY BULLETIN, 2012, 38 (02) :209-219
[10]   Partisan Bias in Factual Beliefs about Politics [J].
Bullock, John G. ;
Gerber, Alan S. ;
Hill, Seth J. ;
Huber, Gregory A. .
QUARTERLY JOURNAL OF POLITICAL SCIENCE, 2015, 10 (04) :519-578