Sample size and power considerations for ordinary least squares interrupted time series analysis: a simulation study

被引:74
作者
Hawley, Samuel [1 ]
Ali, M. Sanni [1 ,2 ]
Berencsi, Klara [1 ]
Judge, Andrew [1 ,3 ,4 ]
Prieto-Alhambra, Daniel [1 ,5 ,6 ,7 ]
机构
[1] Univ Oxford, Nuffield Dept Orthopaed Rheumatol & Musculoskelet, Ctr Stat Med, Oxford, England
[2] London Sch Hyg & Trop Med, Fac Epidemiol & Populat Hlth, London, England
[3] Univ Southampton, Lifecourse Epidemiol Unit, MRC, Southampton, Hants, England
[4] Univ Bristol, Dept Translat Hlth Sci, Bristol, Avon, England
[5] Univ Autonoma Barcelona, GREMPAL Res Grp, Idiap Jordi Gol, Barcelona, Spain
[6] Univ Autonoma Barcelona, CIBERFes, Barcelona, Spain
[7] Inst Salud Carlos III, Barcelona, Spain
关键词
epidemiology; interrupted time series; sample size; power; bias; HEALTH INTERVENTIONS; COMPUTATIONS; REGRESSION; HIP;
D O I
10.2147/CLEP.S176723
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
Interrupted time series (ITS) analysis is being increasingly used in epidemiology. Despite its growing popularity, there is a scarcity of guidance on power and sample size considerations within the ITS framework. Our aim of this study was to assess the statistical power to detect an intervention effect under various real-life ITS scenarios. ITS datasets were created using Monte Carlo simulations to generate cumulative incidence (outcome) values over time. We generated 1,000 datasets per scenario, varying the number of time points, average sample size per time point, average relative reduction post intervention, location of intervention in the time series, and reduction mediated via a 1) slope change and 2) step change. Performance measures included power and percentage bias. We found that sample size per time point had a large impact on power. Even in scenarios with 12 pre-intervention and 12 post-intervention time points with moderate intervention effect sizes, most analyses were underpowered if the sample size per time point was low. We conclude that various factors need to be collectively considered to ensure adequate power for an ITS study. We demonstrate a means of providing insight into underlying sample size requirements in ordinary least squares (OLS) ITS analysis of cumulative incidence measures, based on prespecified parameters and have developed Stata code to estimate this.
引用
收藏
页码:197 / 205
页数:9
相关论文
共 30 条
[1]   Interrupted time series regression for the evaluation of public health interventions: a tutorial [J].
Bernal, James Lopez ;
Cummins, Steven ;
Gasparrini, Antonio .
INTERNATIONAL JOURNAL OF EPIDEMIOLOGY, 2017, 46 (01) :348-355
[2]  
Box G.E.P., 2015, TIME SERIES ANAL FOR
[3]   The design of simulation studies in medical statistics [J].
Burton, Andrea ;
Altman, Douglas G. ;
Royston, Patrick ;
Holder, Roger L. .
STATISTICS IN MEDICINE, 2006, 25 (24) :4279-4292
[4]   Power failure: why small sample size undermines the reliability of neuroscience [J].
Button, Katherine S. ;
Ioannidis, John P. A. ;
Mokrysz, Claire ;
Nosek, Brian A. ;
Flint, Jonathan ;
Robinson, Emma S. J. ;
Munafo, Marcus R. .
NATURE REVIEWS NEUROSCIENCE, 2013, 14 (05) :365-376
[5]  
Chang M., 2010, MONTE CARLO SIMULATI
[6]  
Chatfield C, 2004, The analysis of time series: An introduction, V6th
[7]   Incidence of hip and knee replacement in patients with rheumatoid arthritis following the introduction of biological DMARDs: an interrupted time-series analysis using nationwide Danish healthcare registers [J].
Cordtz, Rene Lindholm ;
Hawley, Samuel ;
Prieto-Alhambra, Daniel ;
Hojgaard, Pil ;
Zobbe, Kristian ;
Overgaard, Soren ;
Odgaard, Anders ;
Kristensen, Lars Erik ;
Dreyer, Lene .
ANNALS OF THE RHEUMATIC DISEASES, 2018, 77 (05) :684-689
[8]   Using natural experiments to evaluate population health interventions: new Medical Research Council guidance [J].
Craig, Peter ;
Cooper, Cyrus ;
Gunnell, David ;
Haw, Sally ;
Lawson, Kenny ;
Macintyre, Sally ;
Ogilvie, David ;
Petticrew, Mark ;
Reeves, Barney ;
Sutton, Matt ;
Thompson, Simon .
JOURNAL OF EPIDEMIOLOGY AND COMMUNITY HEALTH, 2012, 66 (12) :1182-1186
[9]   Methods, applications, interpretations and challenges of interrupted time series (ITS) data: protocol for a scoping review [J].
Ewusie, Joycelyne E. ;
Blondal, Erik ;
Soobiah, Charlene ;
Beyene, Joseph ;
Thabane, Lehana ;
Straus, Sharon E. ;
Hamid, Jemila S. .
BMJ OPEN, 2017, 7 (06)
[10]   Power by simulation [J].
Feiveson, A. H. .
STATA JOURNAL, 2002, 2 (02) :107-124