Distributions of baseline categorical variables were different from the expected distributions in randomized trials with integrity concerns

被引:8
作者
Bolland, Mark J. [1 ,2 ,4 ]
Gamble, Greg D. [1 ]
Avenell, Alison [3 ]
Cooper, David J. [3 ]
Grey, Andrew [1 ]
机构
[1] Univ Auckland, Dept Med, Private Bag 92 019, Auckland 1142, New Zealand
[2] ADHB, Dept Endocrinol, Private Bag 92 024, Auckland 1142, New Zealand
[3] Univ Aberdeen, Hlth Serv Res Unit, Foresterhill, Aberdeen AB25 2ZD, Scotland
[4] Univ Auckland, Fac Med & Hlth Sci, Dept Med, Bone & Joint Res Grp, Private Bag 92019, Auckland, New Zealand
关键词
Statistical methods; Research integrity; Categorical variables; P; -values; Randomization; Fabricated data; Data integrity;
D O I
10.1016/j.jclinepi.2022.12.018
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background and Objectives: Comparing observed and expected distributions of baseline continuous variables in randomized controlled trials (RCTs) can be used to assess publication integrity. We explored whether baseline categorical variables could also be used.Methods: The observed and expected (binomial) distribution of all baseline categorical variables were compared in four sets of RCTs: two controls, and two with publication integrity concerns. We also compared baseline calculated and reported P-values.Results: The observed and expected distributions of baseline categorical variables were similar in the control datasets, both for fre-quency counts (and percentages) and for between-group differences in frequency counts. However, in both sets of RCTs with publication integrity concerns, about twice as many variables as expected had between-group differences in frequency counts of one or 2, and far fewer variables than expected had between-group differences of >4 (P ! 0.001 for both datasets). Furthermore, about one in six reported P-values for baseline categorial variables differed by > 0.1 from the calculated P-value in trials with publication integrity concerns.Conclusion: Comparing the observed and expected distributions and reported and calculated P-values of baseline categorical variables may help in the assessment of publication integrity of a body of RCTs.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:117 / 124
页数:8
相关论文
共 13 条
[1]   Bariatric surgery, lifestyle interventions and orlistat for severe obesity: the REBALANCE mixed-methods systematic review and economic evaluation [J].
Avenell, Alison ;
Robertson, Clare ;
Skea, Zoe ;
Jacobsen, Elisabet ;
Boyers, Dwayne ;
Cooper, David ;
Aceves-Martins, Magaly ;
Retat, Lise ;
Fraser, Cynthia ;
Aveyard, Paul ;
Stewart, Fiona ;
MacLennan, Graeme ;
Webber, Laura ;
Corbould, Emily ;
Xu, Benshuai ;
Jaccard, Abbygail ;
Boyle, Bonnie ;
Duncan, Eilidh ;
Shimonovich, Michal ;
de Bruin, Marijn .
HEALTH TECHNOLOGY ASSESSMENT, 2018, 22 (68) :1-+
[2]   Empirically generated reference proportions for baseline p values from rounded summary statistics [J].
Bolland, M. J. ;
Gamble, G. D. ;
Grey, A. ;
Avenell, A. .
ANAESTHESIA, 2020, 75 (12) :1685-1687
[3]   Identical summary statistics were uncommon in randomized trials and cohort studies [J].
Bolland, Mark J. ;
Gamble, Greg D. ;
Avenell, Alison ;
Grey, Andrew .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2021, 136 :180-188
[4]   Participant withdrawals were unusually distributed in randomized trials with integrity concerns: a statistical investigation [J].
Bolland, Mark J. ;
Gamble, Greg D. ;
Avenell, Alison ;
Cooper, David J. ;
Grey, Andrew .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2021, 131 :22-29
[5]   Baseline P value distributions in randomized trials were uniform for continuous but not categorical variables [J].
Bolland, Mark J. ;
Gamble, Greg D. ;
Avenell, Alison ;
Grey, Andrew ;
Lumley, Thomas .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2019, 112 :67-76
[6]   Rounding, but not randomization method, non-normality, or correlation, affected baseline P-value distributions in randomized trials [J].
Bolland, Mark J. ;
Gamble, Greg D. ;
Avenell, Alison ;
Grey, Andrew .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2019, 110 :50-62
[7]   Systematic review and statistical analysis of the integrity of 33 randomized controlled trials [J].
Bolland, Mark J. ;
Avenell, Alison ;
Gamble, Greg D. ;
Grey, Andrew .
NEUROLOGY, 2016, 87 (23) :2391-2402
[8]   The analysis of 168 randomised controlled trials to test data integrity [J].
Carlisle, J. B. .
ANAESTHESIA, 2012, 67 (05) :521-537
[9]  
Cole Graham D, 2015, BMJ, V351, ph4708, DOI 10.1136/bmj.h4708
[10]   Check for publication integrity before misconduct [J].
Grey, Andrew ;
Bolland, Mark J. ;
Avenell, Alison ;
Klein, Andrew A. ;
Gunsalus, C. K. .
NATURE, 2020, 577 (7789) :167-169