CHEATING ON POLITICAL KNOWLEDGE QUESTIONS IN ONLINE SURVEYS AN ASSESSMENT OF THE PROBLEM AND SOLUTIONS

被引:59
作者
Clifford, Scott [1 ]
Jerit, Jennifer [2 ]
机构
[1] Univ Houston, Dept Polit Sci, 3551 Cullen Blvd Room 447, Houston, TX 77204 USA
[2] SUNY Stony Brook, Dept Polit Sci, Stony Brook, NY 11794 USA
关键词
PARTISAN BIAS; WEB SURVEYS; CONSEQUENCES; TELEPHONE; RESPONSES; INTERNET; WORKERS; IMPACT;
D O I
10.1093/poq/nfw030
中图分类号
G2 [信息与知识传播];
学科分类号
05 ; 0503 ;
摘要
Survey researchers worry about the quality of data produced by online surveys. One concern is that respondents might cheat on performance questions, such as political knowledge, invalidating their responses. Yet, existing evidence is unclear about the prevalence of cheating, and scholars lack a validated method for coping with the problem. In this paper, we demonstrate that such cheating behavior varies considerably by sample and provide some evidence that it is motivated by self-deceptive enhancement. We experimentally test a variety of methods for reducing cheating and find that common methods, such as timers, are not the most effective approach. By contrast, a commitment mechanism, in which respondents affirm their choice not to cheat, is more efficacious. Although cheating in online surveys can distort estimates of knowledge and decrease the validity of the measure, there are methods for coping with this problem.
引用
收藏
页码:858 / 887
页数:30
相关论文
共 53 条
[31]  
Krupnikov Yanna., 2014, Journal of Experimental Political Science, V1, P59, DOI DOI 10.1017/XPS.2014.7
[32]   Advantages and disadvantages of cognitive heuristics in political decision making [J].
Lau, RR ;
Redlawsk, DP .
AMERICAN JOURNAL OF POLITICAL SCIENCE, 2001, 45 (04) :951-971
[33]   "Don't Know" Means "Don't Know": DK Responses and the Public's Level of Political Knowledge [J].
Luskin, Robert C. ;
Bullock, John G. .
JOURNAL OF POLITICS, 2011, 73 (02) :547-557
[34]   Experimenting with a "Third Way" in Political Knowledge Estimation [J].
Miller, Melissa K. ;
Orr, Shannon K. .
PUBLIC OPINION QUARTERLY, 2008, 72 (04) :768-780
[35]   Developing valid knowledge scales [J].
Mondak, JJ .
AMERICAN JOURNAL OF POLITICAL SCIENCE, 2001, 45 (01) :224-238
[36]  
Mullinix K. J., 2015, J. Exp. Polit. Sci, V2, P109, DOI DOI 10.1017/XPS.2015.19
[37]  
Paulhus D. L., 1991, MEASURES PERSONALITY, P17, DOI DOI 10.1016/B978-0-12-590241-0.50006-X
[38]   Egoistic and moralistic biases in self-perception: The interplay of self-deceptive styles with basic traits and motives [J].
Paulhus, DL ;
John, OP .
JOURNAL OF PERSONALITY, 1998, 66 (06) :1025-1060
[39]   The over-claiming technique: Measuring self-enhancement independent of ability [J].
Paulhus, DL ;
Harms, PD ;
Bruce, MN ;
Lysy, DC .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 2003, 84 (04) :890-904
[40]   THE IMPACT OF "FORGIVING" INTRODUCTIONS ON THE REPORTING OF SENSITIVE BEHAVIOR IN SURVEYS THE ROLE OF SOCIAL DESIRABILITY RESPONSE STYLE AND DEVELOPMENTAL STATUS [J].
Peter, Jochen ;
Valkenburg, Patti M. .
PUBLIC OPINION QUARTERLY, 2011, 75 (04) :779-787