Participant Carelessness and Fraud: Consequences for Clinical Research and Potential Solutions

被引:80
作者
Chandler, Jesse [1 ,2 ]
Sisso, Itay [3 ]
Shapiro, Danielle [4 ]
机构
[1] Univ Michigan, Inst Social Res, Ann Arbor, MI USA
[2] Mathematica Policy Res, 220 East Huron St,Suite 300, Ann Arbor, MI 48103 USA
[3] Hebrew Univ Jerusalem, Federmann Ctr Study Rat, Jerusalem, Israel
[4] Univ Michigan, Michigan Med, Dept Phys Med & Rehabil, Ann Arbor, MI 48109 USA
关键词
MTurk; data quality; fraud; MECHANICAL TURK; DATA QUALITY; VALIDITY; INVENTORY; RESPONSES; MISREPRESENTATION; RELIABILITY; WORKERS; VERSION; ONLINE;
D O I
10.1037/abn0000479
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
Clinical psychological research studies often require individuals with specific characteristics. The Internet can be used to recruit broadly, enabling the recruitment of rare groups such as people with specific psychological disorders. However, Internet-based research relies on participant self-report to determine eligibility, and thus, data quality depends on participant honesty. For those rare groups. even low levels of participant dishonesty can lead to a substantial proportion of fraudulent survey responses, and all studies will include careless respondents who do not pay attention to questions, do not understand them, or provide intentionally wrong responses. Poor-quality responses should be thought of as categorically different from high-quality responses. Including these responses will lead to the overestimation of the prevalence of rare groups and incorrect estimates of scale reliability. means, and correlations between constructs. We demonstrate that for these reasons, including poor-quality responses-which are usually positively skewed-will lead to several data-quality problems including spurious associations between measures. We provide recommendations about how to ensure that fraudulent participants are detected and excluded from self-report research studies.
引用
收藏
页码:49 / 55
页数:7
相关论文
共 50 条
  • [11] The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008
    Cella, David
    Riley, William
    Stone, Arthur
    Rothrock, Nan
    Reeve, Bryce
    Yount, Susan
    Amtmann, Dagmar
    Bode, Rita
    Buysse, Daniel
    Choi, Seung
    Cook, Karon
    DeVellis, Robert
    DeWalt, Darren
    Fries, James F.
    Gershon, Richard
    Hahn, Elizabeth A.
    Lai, Jin-Shei
    Pilkonis, Paul
    Revicki, Dennis
    Rose, Matthias
    Weinfurt, Kevin
    Hays, Ron
    [J]. JOURNAL OF CLINICAL EPIDEMIOLOGY, 2010, 63 (11) : 1179 - 1194
  • [12] Conducting Clinical Research Using Crowdsourced Convenience Samples
    Chandler, Jesse
    Shapiro, Danielle
    [J]. ANNUAL REVIEW OF CLINICAL PSYCHOLOGY, VOL 12, 2016, 12 : 53 - 81
  • [13] Nonnaivete among Amazon Mechanical Turk workers: Consequences and solutions for behavioral researchers
    Chandler, Jesse
    Mueller, Pam
    Paolacci, Gabriele
    [J]. BEHAVIOR RESEARCH METHODS, 2014, 46 (01) : 112 - 130
  • [14] Lie for a Dime: When Most Prescreening Responses Are Honest but Most Study Participants Are Impostors
    Chandler, Jesse J.
    Paolacci, Gabriele
    [J]. SOCIAL PSYCHOLOGICAL AND PERSONALITY SCIENCE, 2017, 8 (05) : 500 - 508
  • [15] Generalizing from Survey Experiments Conducted on Mechanical Turk: A Replication Approach
    Coppock, Alexander
    [J]. POLITICAL SCIENCE RESEARCH AND METHODS, 2019, 7 (03) : 613 - 628
  • [16] Effects of Validity Screening Items on Adolescent Survey Data
    Cornell, Dewey
    Klein, Jennifer
    Konold, Tim
    Huang, Francis
    [J]. PSYCHOLOGICAL ASSESSMENT, 2012, 24 (01) : 21 - 35
  • [17] Methods for the detection of carelessly invalid responses in survey data
    Curran, Paul G.
    [J]. JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 2016, 66 : 4 - 19
  • [18] The three-factor model of internet addiction:: The development of the Problematic Internet Use Questionnaire
    Demetrovics, Zsolt
    Szeredi, Beatrix
    Rozsa, Sandor
    [J]. BEHAVIOR RESEARCH METHODS, 2008, 40 (02) : 563 - 574
  • [19] Dennis S.A., 2019, Social Science Research Network, DOI [10.2139/ssrn.3233954, DOI 10.2139/SSRN.3233954]
  • [20] An exploratory study about inaccuracy and invalidity in adolescent self-report surveys
    Fan, Xitao
    Miller, Brent C.
    Park, Kyung-Eun
    Winward, Bryan W.
    Christensen, Mathew
    Grotevant, Harold D.
    Tai, Robert H.
    [J]. FIELD METHODS, 2006, 18 (03) : 223 - 244