A REVIEW OF CONCEPTUAL APPROACHES AND EMPIRICAL EVIDENCE ON PROBABILITY AND NONPROBABILITY SAMPLE SURVEY RESEARCH

被引:158
作者
Cornesse, Carina [1 ]
Blom, Annelies G. [2 ,3 ]
Dutwin, David [4 ]
Krosnick, Jon A. [5 ,6 ,7 ]
De Leeuw, Edith D. [8 ]
Legleye, Stephane [9 ,10 ,11 ,12 ,13 ]
Pasek, Josh [14 ,15 ]
Pennay, Darren [16 ,17 ,18 ]
Phillips, Benjamin [19 ,20 ]
Sakshaug, Joseph W. [21 ,22 ,23 ,24 ]
Struminskaya, Bella [25 ]
Wenz, Alexander [1 ,26 ]
机构
[1] Univ Mannheim, Collaborat Res Ctr SFB 884, Polit Econ Reforns, D-68131 Mannheim, Germany
[2] Univ Mannheim, Sch Social Sci, Dept Polit Sci, Data Sci, D-68131 Mannheim, Germany
[3] Univ Mannheim, GIP, Collaborat Res Ctr SFB 884, Polit Econ Reforms, D-68131 Mannheim, Germany
[4] Univ Chicago, NORC, 55 East Monroe St,30th Floor, Chicago, IL 60603 USA
[5] Stanford Univ, Humanities & Social Sci, 432 McClatchy Hall,450 Serra Mall, Stanford, CA 94305 USA
[6] Stanford Univ, Commun, 432 McClatchy Hall,450 Serra Mall, Stanford, CA 94305 USA
[7] Stanford Univ, Polit Sci, 432 McClatchy Hall,450 Serra Mall, Stanford, CA 94305 USA
[8] Univ Utrecht, Dept Methodol & Stat, Survey Methodol, Padualaan 14, NL-3584 CH Utrecht, Netherlands
[9] INSERM, CESP, Team Drug Use Gen Populat, Paris, France
[10] UVSQ, Fac Med, Versailles, France
[11] Univ Paris Saclay, Fac Med, St Aubin, France
[12] Univ Paris Sud, Paris, France
[13] Inst Natl Statist & Etud Econ, Household Living Condit Unit, 88,Ave Verdier,CS 70058, Montrouge 92541, France
[14] Univ Michigan, Inst Social Res, Dept Commun & Media, 105 S State St,5413 North Quad, Ann Arbor, MI 48109 USA
[15] Univ Michigan, Inst Social Res, Ctr Polit Studies, 105 S State St,5413 North Quad, Ann Arbor, MI 48109 USA
[16] Australian Natl Univ Ctr Social Res, Methods & Strategy Social Res Ctr, Level 9,277 William St, Melbourne, Vic 3000, Australia
[17] Australian Natl Univ Ctr Social Res, Level 9,277 William St, Melbourne, Vic 3000, Australia
[18] Univ Queensland, Inst Social Sci Res ISSR, Brisbane, Qld, Australia
[19] Social Res Ctr, Survey Methodol, Level 9,277 William St, Melbourne, Vic 3000, Australia
[20] Australian Natl Univ, Ctr Social Res & Methods, Melbourne, Vic, Australia
[21] Inst Employment Res IAB, Data Collect & Data Integrat Unit, 104 Regensburgerstr, Nurnberg 90478, Germany
[22] Inst Employment Res IAB, Stat Methods Res Dept, 104 Regensburgerstr, Nurnberg 90478, Germany
[23] Ludwig Maximilian Univ Munich, Dept Stat, Stat, Munich 80539, Germany
[24] Univ Mannheim, Sch Social Sci, Mannheim 68131, Germany
[25] Univ Utrecht, Dept Methodol & Stat, Sjoerd Groenmangebouw Padualaan 14, Utrecht 3584 CH, Netherlands
[26] Univ Essex, Inst Social & Econ Res, Colchester, Essex, England
关键词
Accuracy; Nonprobability sampling; Probability sampling; Survey data quality; Survey inference; Weighting adjustments; PROPENSITY SCORE; INTERNET SURVEYS; WEB SURVEY; COMPARING DATA; ONLINE PANEL; SURVEY MODE; TELEPHONE; DESIGN; QUALITY; INFERENCE;
D O I
10.1093/jssam/smz041
中图分类号
O1 [数学]; C [社会科学总论];
学科分类号
03 ; 0303 ; 0701 ; 070101 ;
摘要
There is an ongoing debate in the survey research literature about whether and when probability and nonprobability sample surveys produce accurate estimates of a larger population. Statistical theory provides a justification for confidence in probability sampling as a function of the survey design, whereas inferences based on nonprobability sampling are entirely dependent on models for validity. This article reviews the current debate about probability and nonprobability sample surveys. We describe the conditions under which nonprobability sample surveys may provide accurate results in theory and discuss empirical evidence on which types of samples produce the highest accuracy in practice. From these theoretical and empirical considerations, we derive best-practice recommendations and outline paths for future research.
引用
收藏
页码:4 / 36
页数:33
相关论文
共 113 条
[1]  
American Association for Public Opinion Research, 2015, AAPOR COD ETH
[2]  
[Anonymous], REP AAPOR TASK FORC
[3]  
[Anonymous], 202522012 ISO
[4]  
[Anonymous], IMRO GUID BEST PRACT
[5]  
[Anonymous], 2000, WILEY S PRO STAT SUR
[6]  
[Anonymous], 2012, BBC Online
[7]   Does Survey Mode Still Matter? Findings from a 2010 Multi-Mode Comparison [J].
Ansolabehere, Stephen ;
Schaffner, Brian F. .
POLITICAL ANALYSIS, 2014, 22 (03) :285-303
[8]   Cooperative Survey Research [J].
Ansolabehere, Stephen ;
Rivers, Douglas .
ANNUAL REVIEW OF POLITICAL SCIENCE, VOL 16, 2013, 16 :307-329
[9]   Design Heuristics for Effective Smartphone Questionnaires [J].
Antoun, Christopher ;
Katz, Jonathan ;
Argueta, Josef ;
Wang, Lin .
SOCIAL SCIENCE COMPUTER REVIEW, 2018, 36 (05) :557-574
[10]  
Arbeitskreis Deutscher Markt- und Sozialforschungsinstitute e.V, 2001, STAND QUAL ONL BEFR