A Simple, General, and Efficient Method for Sequential Hypothesis Testing: The Independent Segments Procedure

被引:8
作者
Miller, Jeff [1 ]
Ulrich, Rolf [2 ]
机构
[1] Univ Otago, Dept Psychol, POB 56, Dunedin 9054, New Zealand
[2] Univ Tubingen, Dept Psychol, Schleichstr 4, D-72076 Tubingen, Germany
关键词
hypothesis testing; sequential sampling; research efficiency; INCREASING VALUE; CLINICAL-TRIALS; WASTE; DESIGNS; BIAS;
D O I
10.1037/met0000350
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
We propose a new sequential hypothesis testing procedure in which data are collected and analyzed in a series of independent segments. As in fixed-sample hypothesis testing and in previous sequential procedures, the overall alpha level can be set to any desired value. Like other sequential procedures, the independent segments procedure generally requires smaller samples than fixed-sample procedures-often approximately 30% smaller-to achieve the same alpha level and statistical power. Relative to other sequential procedures, the new method has the advantages that it is simpler to use, requires fewer assumptions, and can be used with a wider array of statistical tests. Thus, in some circumstances the independent segments procedure may provide an attractive option for increasing the efficiency of statistical testing. Translational Abstract We propose a new procedure for conducting scientific research in which data are collected and analyzed in a series of independent subexperiments or segments. Compared with the standard methods that are most commonly used, the new procedure can provide the same statistical power with smaller samplesoften approximately 10-30% smaller. Thus, the new procedure can help to increase the efficiency of scientific research.
引用
收藏
页码:486 / 497
页数:12
相关论文
共 45 条
[1]   Estimating the reproducibility of psychological science [J].
Aarts, Alexander A. ;
Anderson, Joanna E. ;
Anderson, Christopher J. ;
Attridge, Peter R. ;
Attwood, Angela ;
Axt, Jordan ;
Babel, Molly ;
Bahnik, Stepan ;
Baranski, Erica ;
Barnett-Cowan, Michael ;
Bartmess, Elizabeth ;
Beer, Jennifer ;
Bell, Raoul ;
Bentley, Heather ;
Beyan, Leah ;
Binion, Grace ;
Borsboom, Denny ;
Bosch, Annick ;
Bosco, Frank A. ;
Bowman, Sara D. ;
Brandt, Mark J. ;
Braswell, Erin ;
Brohmer, Hilmar ;
Brown, Benjamin T. ;
Brown, Kristina ;
Bruening, Jovita ;
Calhoun-Sauls, Ann ;
Callahan, Shannon P. ;
Chagnon, Elizabeth ;
Chandler, Jesse ;
Chartier, Christopher R. ;
Cheung, Felix ;
Christopherson, Cody D. ;
Cillessen, Linda ;
Clay, Russ ;
Cleary, Hayley ;
Cloud, Mark D. ;
Cohn, Michael ;
Cohoon, Johanna ;
Columbus, Simon ;
Cordes, Andreas ;
Costantini, Giulio ;
Alvarez, Leslie D. Cramblet ;
Cremata, Ed ;
Crusius, Jan ;
DeCoster, Jamie ;
DeGaetano, Michelle A. ;
Della Penna, Nicolas ;
den Bezemer, Bobby ;
Deserno, Marie K. .
SCIENCE, 2015, 349 (6251)
[3]   Retire statistical significance [J].
Amrhein, Valentin ;
Greenland, Sander ;
McShane, Blake .
NATURE, 2019, 567 (7748) :305-307
[4]  
[Anonymous], 2004, Sequential Analysis
[5]   REPEATED SIGNIFICANCE TESTS ON ACCUMULATING DATA [J].
ARMITAGE, P ;
MCPHERSO.CK ;
ROWE, BC .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-GENERAL, 1969, 132 :235-&
[6]   Evaluating replicability of laboratory experiments in economics [J].
Camerer, Colin F. ;
Dreber, Anna ;
Forsell, Eskil ;
Ho, Teck-Hua ;
Huber, Juergen ;
Johannesson, Magnus ;
Kirchler, Michael ;
Almenberg, Johan ;
Altmejd, Adam ;
Chan, Taizan ;
Heikensten, Emma ;
Holzmeister, Felix ;
Imai, Taisuke ;
Isaksson, Siri ;
Nave, Gideon ;
Pfeiffer, Thomas ;
Razen, Michael ;
Wu, Hang .
SCIENCE, 2016, 351 (6280) :1433-1436
[7]   How to increase value and reduce waste when research priorities are set [J].
Chalmers, Iain ;
Bracken, Michael B. ;
Djulbegovic, Ben ;
Garattini, Silvio ;
Grant, Jonathan ;
Guelmezoglu, A. Metin ;
Howells, David W. ;
Ioannidis, John P. A. ;
Oliver, Sandy .
LANCET, 2014, 383 (9912) :156-165
[8]   Avoidable waste in the production and reporting of research evidence [J].
Chalmers, Iain ;
Glasziou, Paul .
LANCET, 2009, 374 (9683) :86-89
[9]  
DEMETS DL, 1980, BIOMETRIKA, V67, P651
[10]  
Fan Xiaoyin Frank, 2004, J Biopharm Stat, V14, P505, DOI 10.1081/BIP-120037195