Power(ful) myths: misconceptions regarding sample size in quality of life research

被引:4
作者
Anderson, Samantha F. [1 ]
机构
[1] Arizona State Univ, Dept Psychol, 950 S McAllister Ave, Tempe, AZ 85287 USA
关键词
Sample size; Statistical power; Accuracy; Effect size; Research waste; STATISTICAL POWER; CONFIDENCE-INTERVALS; RANDOMIZED-TRIALS; PARAMETER-ESTIMATION; MULTIPLE-REGRESSION; CLINICAL-RESEARCH; RELIABILITY; REQUIREMENTS; DESIGN; ACCURACY;
D O I
10.1007/s11136-021-03020-y
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Purpose Carefully selecting the sample size for a research study is one of the most fundamental ways to utilize resources in an ethical manner, maximize impact and replicability, and minimize research waste when investigating questions relevant to health-related quality of life (HRQOL). Despite an increased focus on sample size in the methodological literature, the topic has received limited attention in the HRQOL field, and there are still misconceptions that can weaken even well-intentioned sample size planning. This article aims to highlight common misconceptions, provide accessible and non-technical corrections to these misconceptions, and show how HRQOL researchers can benefit from a more nuanced understanding of sample size planning. Method Misconceptions were identified broadly through examples within the health, psychology, and HRQOL literatures. In examining these misconceptions, study-level (e.g., missing data, multilevel designs, multiple reported outcomes) and field-level (e.g., publication bias, replicability) issues relevant to HRQOL research were considered. Results Misconceptions include: (a) researchers should use rules of thumb or the largest sample size possible, (b) sample size planning should always focus on power, (c) planned power = actual power, (d) there is only one level of power per study, and (e) power is only relevant for the individual researcher. Throughout the article, major themes linked to these misconceptions are mapped onto recent HRQOL studies to make the connections more tangible. Conclusion By clarifying several challenges and misconceptions regarding sample size planning and statistical power, HRQOL researchers will have the tools needed to augment the research literature in effective and meaningful ways.
引用
收藏
页码:2917 / 2929
页数:13
相关论文
共 113 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[2]   On the surprising longevity of flogged horses: Why there is a case for the significance test [J].
Abelson, RP .
PSYCHOLOGICAL SCIENCE, 1997, 8 (01) :12-15
[3]   Health-related quality of life and its predictors among adults living with HIV/AIDS and receiving antiretroviral therapy in Pakistan [J].
Ahmed, Ali ;
Saqlain, Muhammad ;
Bashir, Naila ;
Dujaili, Juman ;
Hashmi, Furqan ;
Mazhar, Faizan ;
Khan, Amjad ;
Jabeen, Musarat ;
Blebil, Ali ;
Awaisu, Ahmed .
QUALITY OF LIFE RESEARCH, 2021, 30 (06) :1653-1664
[4]   Population validity and cross-validity - Applications of distribution theory for testing hypotheses, setting confidence intervals, and determining sample size [J].
Algina, James ;
Keselman, H. J. .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2008, 68 (02) :233-244
[5]   Differences in mental health and health-related quality of life between the Israeli and Italian population during a COVID-19 quarantine [J].
Amit Aharon, Anat ;
Dubovi, Ilana ;
Ruban, Angela .
QUALITY OF LIFE RESEARCH, 2021, 30 (06) :1675-1684
[6]  
Anderson S.F., 2020, BIAS UNCERTAINTY COR
[7]   Using Prior Information to Plan Appropriately Powered Regression Studies: A Tutorial Using BUCSS [J].
Anderson, Samantha F. .
PSYCHOLOGICAL METHODS, 2021, 26 (05) :513-526
[8]   Misinterpreting p: The Discrepancy Between p Values and the Probability the Null Hypothesis is True, the Influence of Multiple Testing, and Implications for the Replication Crisis [J].
Anderson, Samantha F. .
PSYCHOLOGICAL METHODS, 2020, 25 (05) :596-609
[9]   Best (but oft forgotten) practices: sample size planning for powerful studies [J].
Anderson, Samantha F. .
AMERICAN JOURNAL OF CLINICAL NUTRITION, 2019, 110 (02) :280-295
[10]   Sample-Size Planning for More Accurate Statistical Power: A Method Adjusting Sample Effect Sizes for Publication Bias and Uncertainty [J].
Anderson, Samantha F. ;
Kelley, Ken ;
Maxwell, Scott E. .
PSYCHOLOGICAL SCIENCE, 2017, 28 (11) :1547-1562