Promoting Learning from Null or Negative Results in Prevention Science Trials

被引:19
作者
Axford, Nick [1 ]
Berry, Vashti [2 ]
Lloyd, Jenny [3 ]
Hobbs, Tim [4 ]
Wyatt, Katrina [3 ]
机构
[1] Univ Plymouth, NIHR ARC South West Peninsula PenARC, Plymouth, Devon, England
[2] Univ Exeter, NIHR ARC South West Peninsula PenARC, Exeter, Devon, England
[3] Univ Exeter, Exeter, Devon, England
[4] Dartington Serv Design Lab, Dartington, England
关键词
Randomized controlled trial; Null effect; Negative effect; Evaluation; INTERVENTION DEVELOPMENT; ANTISOCIAL-BEHAVIOR; PROGRAM; UNIVERSAL; THERAPY; DESIGN; UK;
D O I
10.1007/s11121-020-01140-4
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
There can be a tendency for investigators to disregard or explain away null or negative results in prevention science trials. Examples include not publicizing findings, conducting spurious subgroup analyses, or attributing the outcome post hoc to real or perceived weaknesses in trial design or intervention implementation. This is unhelpful for several reasons, not least that it skews the evidence base, contributes to research "waste", undermines respect for science, and stifles creativity in intervention development. In this paper, we identify possible policy and practice responses when interventions have null (ineffective) or negative (harmful) results, and argue that these are influenced by: theinterventionitself (e.g., stage of gestation, perceived importance);trial design,conduct,and results(e.g., pattern of null/negative effects, internal and external validity);context(e.g., wider evidence base, state of policy); andindividual perspectives and interests(e.g., stake in the intervention). We advance several strategies to promote more informative null or negative effect trials and enable learning from such results, focusing on changes to culture, process, intervention design, trial design, and environment.
引用
收藏
页码:751 / 763
页数:13
相关论文
共 60 条
[1]   The effectiveness of a therapeutic parenting program for children aged 6-11 years with behavioral or emotional difficulties: Results from a randomized controlled trial [J].
Axford, Nick ;
Bjornstad, Gretchen ;
Matthews, Justin ;
Heilmann, Sarah ;
Raja, Anam ;
Ukoumunne, Obioha C. ;
Berry, Vashti ;
Wilkinson, Tom ;
Timmons, Luke ;
Hobbs, Tim ;
Eames, Tim ;
Kallitsoglou, Angeliki ;
Blower, Sarah ;
Warner, Georgina .
CHILDREN AND YOUTH SERVICES REVIEW, 2020, 117
[2]   The Effectiveness of a Community-Based Mentoring Program for Children Aged 5-11 Years: Results from a Randomized Controlled Trial [J].
Axford, Nick ;
Bjornstad, Gretchen ;
Matthews, Justin ;
Whybra, Laura ;
Berry, Vashti ;
Ukoumunne, Obioha C. ;
Hobbs, Tim ;
Wrigley, Zoe ;
Brook, Lucy ;
Taylor, Rod ;
Eames, Tim ;
Kallitsoglou, Angeliki ;
Blower, Sarah ;
Warner, Georgina .
PREVENTION SCIENCE, 2021, 22 (01) :100-112
[3]   The Effectiveness of the KiVa Bullying Prevention Program in Wales, UK: Results from a Pragmatic Cluster Randomized Controlled Trial [J].
Axford, Nick ;
Bjornstad, Gretchen ;
Clarkson, Suzy ;
Ukoumunne, Obioha C. ;
Wrigley, Zoe ;
Matthews, Justin ;
Berry, Vashti ;
Hutchings, Judy .
PREVENTION SCIENCE, 2020, 21 (05) :615-626
[4]   The Effectiveness and Micro-costing Analysis of a Universal, School-Based, Social-Emotional Learning Programme in the UK: A Cluster-Randomised Controlled Trial [J].
Berry, Vashti ;
Axford, Nick ;
Blower, Sarah ;
Taylor, Rod S. ;
Edwards, Rhiannon Tudor ;
Tobin, Kate ;
Jones, Carys ;
Bywater, Tracey .
SCHOOL MENTAL HEALTH, 2016, 8 (02) :238-256
[5]  
Bonafide C. P., 2018, JAMA PEDIAT, pE1
[6]   'Dark logic': theorising the harmful consequences of public health interventions [J].
Bonell, Chris ;
Jamal, Farah ;
Melendez-Torres, G. J. ;
Cummins, Steven .
JOURNAL OF EPIDEMIOLOGY AND COMMUNITY HEALTH, 2015, 69 (01) :95-98
[7]   Realist randomised controlled trials: A new approach to evaluating complex public health interventions [J].
Bonell, Chris ;
Fletcher, Adam ;
Morton, Matthew ;
Lorenc, Theo ;
Moore, Laurence .
SOCIAL SCIENCE & MEDICINE, 2012, 75 (12) :2299-2306
[8]   Subgroup analyses in randomised controlled trials: cohort study on trial protocols and journal publications [J].
Briel, M. .
BMJ-BRITISH MEDICAL JOURNAL, 2014, 349
[9]   Enhancing Social-Emotional Health and Wellbeing in the Early Years (E-SEE): a study protocol of a community-based randomised controlled trial with process and economic evaluations of the incredible years infant and toddler parenting programmes, delivered in a proportionate universal model [J].
Bywater, Tracey ;
Berry, Vashti ;
Blower, Sarah Louise ;
Cohen, Judith ;
Gridley, Nicole ;
Kiernan, Kathleen ;
Mandefield, Laura ;
Mason-Jones, Amanda ;
McGilloway, Sinead ;
McKendrick, Kirsty ;
Pickett, Kate ;
Richardson, Gerry ;
Teare, M. Dawn ;
Tracey, Louise ;
Walker, Simon ;
Whittaker, Karen ;
Wright, Jessica .
BMJ OPEN, 2018, 8 (12)
[10]   Correcting for Bias in Psychology: A Comparison of Meta-Analytic Methods [J].
Carter, Evan C. ;
Schonbrodt, Felix D. ;
Gervais, Will M. ;
Hilgard, Joseph .
ADVANCES IN METHODS AND PRACTICES IN PSYCHOLOGICAL SCIENCE, 2019, 2 (02) :115-144