What is the proper way to apply the multiple comparison test?

被引:689
作者
Lee, Sangseok [1 ]
Lee, Dong Kyu [2 ]
机构
[1] Inje Univ, Sanggye Paik Hosp, Coll Med, Dept Anesthesiol & Pain Med, Seoul, South Korea
[2] Korea Univ, Guro Hosp, Sch Med, Dept Anesthesiol & Pain Med, 148 Gurodong Ro, Seoul 08308, South Korea
关键词
Alpha inflation; Analysis of variance; Bonferroni; Dunnett; Multiple comparison; Scheffe; Statistics; Tukey; Type I error; Type II error;
D O I
10.4097/kja.d.18.00242
中图分类号
R614 [麻醉学];
学科分类号
100217 ;
摘要
Multiple comparisons tests (MCTs) are performed several times on the mean of experimental conditions. When the null hypothesis is rejected in a validation, MCTs are performed when certain experimental conditions have a statistically significant mean difference or there is a specific aspect between the group means. A problem occurs if the error rate increases while multiple hypothesis tests are performed simultaneously. Consequently, in an MCT, it is necessary to control the error rate to an appropriate level. In this paper, we discuss how to test multiple hypotheses simultaneously while limiting type I error rate, which is caused by a inflation. To choose the appropriate test, we must maintain the balance between statistical power and type I error rate. If the test is too conservative, a type I error is not likely to occur. However, concurrently, the test may have insufficient power resulted in increased probability of type II error occurrence. Most researchers may hope to find the best way of adjusting the type I error rate to discriminate the real differences between observed data without wasting too much statistical power. It is expected that this paper will help researchers understand the differences between MCTs and apply them appropriately.
引用
收藏
页码:353 / 360
页数:8
相关论文
共 11 条
[1]   When to use the Bonferroni correction [J].
Armstrong, Richard A. .
OPHTHALMIC AND PHYSIOLOGICAL OPTICS, 2014, 34 (05) :502-508
[2]   CONTROLLING THE FALSE DISCOVERY RATE - A PRACTICAL AND POWERFUL APPROACH TO MULTIPLE TESTING [J].
BENJAMINI, Y ;
HOCHBERG, Y .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 1995, 57 (01) :289-300
[3]   A general introduction to adjustment for multiple comparisons [J].
Chen, Shi-Yi ;
Feng, Zhe ;
Yi, Xiaolian .
JOURNAL OF THORACIC DISEASE, 2017, 9 (06) :1725-1729
[4]   MULTIPLE COMPARISONS AMONG MEANS [J].
DUNN, OJ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1961, 56 (293) :52-&
[6]  
Kim TK, 2017, KOREAN J ANESTHESIOL, V70, P22, DOI 10.4097/kjae.2017.70.1.22
[7]   Alternatives to P value: confidence interval and effect size [J].
Lee, Dong Kyu .
KOREAN JOURNAL OF ANESTHESIOLOGY, 2016, 69 (06) :555-562
[8]   Avoiding negative reviewer comments: common statistical errors in anesthesia journals [J].
Lee, Sangseok .
KOREAN JOURNAL OF ANESTHESIOLOGY, 2016, 69 (03) :219-226
[9]   A METHOD FOR JUDGING ALL CONTRASTS IN THE ANALYSIS OF VARIANCE [J].
SCHEFFE, H .
BIOMETRIKA, 1953, 40 (1-2) :87-104