The MTurkification of Social and Personality Psychology

被引:91
作者
Anderson, Craig A. [1 ]
Allen, Johnie J. [1 ]
Plante, Courtney [1 ]
Quigley-McBride, Adele [1 ]
Lovett, Alison [1 ]
Rokkum, Jeffrey N. [1 ]
机构
[1] Iowa State Univ, Ames, IA 50011 USA
关键词
MTurk; research methods; assessment; philosophy of science; theory; MECHANICAL TURK; MTURK;
D O I
10.1177/0146167218798821
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The potential role of brief online studies in changing the types of research and theories likely to evolve is examined in the context of earlier changes in theory and methods in social and personality psychology, changes that favored low-difficulty, high-volume studies. An evolutionary metaphor suggests that the current publication environment of social and personality psychology is a highly competitive one, and that academic survival and reproduction processes (getting a job, tenure/promotion, grants, awards, good graduate students) can result in the extinction of important research domains. Tracking the prevalence of brief online studies, exemplified by studies using Amazon Mechanical Turk, in three top journals (Journal of Personality and Social Psychology, Personality and Social Psychology Bulletin, Journal of Experimental Social Psychology) reveals a dramatic increase in their frequency and proportion. Implications, suggestions, and questions concerning this trend for the field and questions for its practitioners are discussed.
引用
收藏
页码:842 / 850
页数:9
相关论文
共 19 条
[1]   Work experiences on MTurk: Job satisfaction, turnover, and information sharing [J].
Brawley, Alice M. ;
Pury, Cynthia L. S. .
COMPUTERS IN HUMAN BEHAVIOR, 2016, 54 :531-546
[2]   Amazon Mechanical Turk in Organizational Psychology: An Evaluation and Practical Recommendations [J].
Cheung, Janelle H. ;
Burns, Deanna K. ;
Sinclair, Robert R. ;
Sliter, Michael .
JOURNAL OF BUSINESS AND PSYCHOLOGY, 2017, 32 (04) :347-361
[3]   On the scientific superiority of conceptual replications for scientific progress [J].
Crandall, Christian S. ;
Sherman, Jeffrey W. .
JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 2016, 66 :93-99
[4]   Replicability and Other Features of a High-Quality Science: Toward a Balanced and Empirical Approach [J].
Finkel, Eli J. ;
Eastwick, Paul W. ;
Reis, Harry T. .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 2017, 113 (02) :244-253
[5]   Best Research Practices in Psychology: Illustrating Epistemological and Pragmatic Considerations With the Case of Relationship Science [J].
Finkel, Eli J. ;
Eastwick, Paul W. ;
Reis, Harry T. .
JOURNAL OF PERSONALITY AND SOCIAL PSYCHOLOGY, 2015, 108 (02) :275-U274
[6]   Inattentive Responding in MTurk and Other Online Samples [J].
Fleischer, Avi ;
Mead, Alan D. ;
Huang, Jialin .
INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY-PERSPECTIVES ON SCIENCE AND PRACTICE, 2015, 8 (02) :196-U94
[7]   Data Collection in a Flat World: The Strengths and Weaknesses of Mechanical Turk Samples [J].
Goodman, Joseph K. ;
Cryder, Cynthia E. ;
Cheema, Amar .
JOURNAL OF BEHAVIORAL DECISION MAKING, 2013, 26 (03) :213-224
[8]   Caution! MTurk Workers Ahead-Fines Doubled [J].
Harms, P. D. ;
DeSimone, Justin A. .
INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY-PERSPECTIVES ON SCIENCE AND PRACTICE, 2015, 8 (02) :183-U226
[9]   Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants [J].
Hauser, David J. ;
Schwarz, Norbert .
BEHAVIOR RESEARCH METHODS, 2016, 48 (01) :400-407
[10]   An Inconvenient Truth: Arbitrary Distinctions Between Organizational, Mechanical Turk, and Other Convenience Samples [J].
Landers, Richard N. ;
Behrend, Tara S. .
INDUSTRIAL AND ORGANIZATIONAL PSYCHOLOGY-PERSPECTIVES ON SCIENCE AND PRACTICE, 2015, 8 (02) :142-164