The GRADE Working Group clarifies the construct of certainty of evidence

被引:451
作者
Hultcrantz, Monica [1 ,2 ]
Rind, David [3 ,4 ]
Akl, Elie A. [5 ,6 ]
Treweek, Shaun [7 ]
Mustafa, Reem A. [5 ,8 ]
Iorio, Alfonso [5 ,9 ]
Alper, Brian S. [10 ,11 ]
Meerpohl, Joerg J. [12 ,13 ,14 ,15 ]
Murad, M. Hassan [16 ]
Ansari, Mohammed T. [17 ]
Katikireddi, Srinivasa Vittal [18 ]
Ostlund, Pernilla [1 ,19 ]
Tranaeus, Sofia [1 ,19 ,20 ]
Christensen, Robin [21 ]
Gartlehner, Gerald [22 ,23 ]
Brozek, Jan [5 ,9 ]
Izcovich, Ariel [24 ]
Schunemann, Holger [5 ,9 ]
Guyatt, Gordon [5 ,9 ]
机构
[1] Swedish Agcy Hlth Technol Assessment & Assessment, St Eriksgatan 117, SE-10233 Stockholm, Sweden
[2] Karolinska Inst, Dept Learning Informat Management & Eth, Tomteboday 18 A, SE-17177 Stockholm, Sweden
[3] Inst Clin & Econ Review, Two Liberty Sq,9th Floor, Boston, MA 02109 USA
[4] Harvard Med Sch, Beth Israel Deaconess Med Ctr, 330 Brookline Ave, Boston, MA 02215 USA
[5] McMaster Univ, Dept Hlth Res Methods Evidence & Impact, 1280 Main St West, Hamilton, ON L8S 4K1, Canada
[6] Amer Univ, Beirut Med Ctr, Dept Internal Med, POB 11-0236, Beirut 11072020, Lebanon
[7] Univ Aberdeen, Hlth Serv Res Unit, 3rd Floor,Hlth Sci Bldg, Aberdeen AB25 2ZD, Scotland
[8] Univ Kansas, Med Ctr, Div Nephrol & Hypertens, Dept Med, 3901 Rainbow Blvd,MS3002, Kansas City, KS 66160 USA
[9] McMaster Univ, Dept Med, 1280 Main St West, Hamilton, ON L8S 4K1, Canada
[10] EBSCO Publishing, EBSCO Hlth, 10 Estes St, Ipswich, MA 01938 USA
[11] Univ Missouri, Sch Med, Dept Family & Community Med, One Hosp Dr, Columbia, MO 65212 USA
[12] Univ Freiburg, Fac Med, Med Ctr, Cochrane Germany, Breisacher Str 153, D-79110 Freiburg, Germany
[13] Univ Paris 05, Sorbonne Paris Cite, Ctr Rech Epidemiol & Stat, INSERM,U1153, 1 Pl Parvis Notre Damne, F-75181 Paris 04, France
[14] Cochrane France, 1 Pl Parvis Notre Damne, F-75181 Paris 04, France
[15] Hop Hotel Dieu, 1 Pl Parvis Notre Damne, F-75181 Paris 04, France
[16] Mayo Clin, Evidence Based Practice Ctr, 200 1st St SW, Rochester, MN 55905 USA
[17] Univ Ottawa, Fac Med, Sch Epidemiol Publ Hlth & Prevent Med, 600 Peter Morand Crescent, Ottawa, ON K1G 5Z3, Canada
[18] Univ Glasgow, MRC CSO Social & Publ Hlth Sci Unit, 200 Renfield St, Glasgow G2 3QB, Lanark, Scotland
[19] Malmo Univ, Fac Odontol, HTA O, Carl Gustafs Vag 34, SE-21421 Malmo, Sweden
[20] Karolinska Inst, Dept Dent Med, Div Cariol & Endodontol, Alfred Nobels Alle 8, SE-14152 Huddinge, Sweden
[21] Bispebjerg & Frederiksberg Hosp, Parker Inst, Musculoskeletal Stat Unit, Nordre Fasazzvej 57, DK-2000 Copenhagen F, Denmark
[22] Danube Univ, Dept Evidence Based Med & Clin Epidemiol, Dr Karl Dorrekstr 30, A-3500 Krems, Austria
[23] RTI Int, 3040 East Cornwallis Rd, Res Triangle Pk, NC 27709 USA
[24] German Hosp, Internal Med Serv, Pueyrredon 1640,C1118AAT, Buenos Aires, DF, Argentina
基金
英国医学研究理事会;
关键词
GRADE; Certainty of evidence; Thresholds; Guidelines; Systematic reviews; Health technology assessment; GUIDELINES; QUALITY;
D O I
10.1016/j.jclinepi.2017.05.006
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Objective: To clarify the grading of recommendations assessment, development and evaluation (GRADE) definition of certainty of evidence and suggest possible approaches to rating certainty of the evidence for systematic reviews, health technology assessments, and guidelines. Study Design and Setting: This work was carried out by a project group within the GRADE Working Group, through brainstorming and iterative refinement of ideas, using input from workshops, presentations, and discussions at GRADE Working Group meetings to produce this document, which constitutes official GRADE guidance. Results: Certainty of evidence is best considered as the certainty that a true effect lies on one side of a specified threshold or within a chosen range. We define possible approaches for choosing threshold or range. For guidelines, what we call a fully contextualized approach requires simultaneously considering all critical outcomes and their relative value. Less-contextualized approaches, more appropriate for systematic reviews and health technology assessments, include using specified ranges of magnitude of effect, for example, ranges of what we might consider no effect, trivial, small, moderate, or large effects. Conclusion: It is desirable for systematic review authors, guideline panelists, and health technology assessors to specify the threshold or ranges they are using when rating the certainty in evidence. (C) 2017 The Authors. Published by Elsevier Inc.
引用
收藏
页码:4 / 13
页数:10
相关论文
共 14 条
[1]   GRADE guidelines: 15. Going from evidence to recommendation-determinants of a recommendation's direction and strength [J].
Andrews, Jeffrey C. ;
Schuenemann, Holger J. ;
Oxman, Andrew D. ;
Pottie, Kevin ;
Meerpohl, Joerg J. ;
Coello, Pablo Alonso ;
Rind, David ;
Montori, Victor M. ;
Brito, Juan Pablo ;
Norris, Susan ;
Elbarbary, Mahmoud ;
Post, Piet ;
Nasser, Mona ;
Shukla, Vijay ;
Jaeschke, Roman ;
Brozek, Jan ;
Djulbegovic, Ben ;
Guyatt, Gordon .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2013, 66 (07) :726-735
[2]   GRADE guidelines: 3. Rating the quality of evidence [J].
Balshem, Howard ;
Helfand, Mark ;
Schuenemann, Holger J. ;
Oxman, Andrew D. ;
Kunz, Regina ;
Brozek, Jan ;
Vist, Gunn E. ;
Falck-Ytter, Yngve ;
Meerpohl, Joerg ;
Norris, Susan ;
Guyatt, Gordon H. .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2011, 64 (04) :401-406
[3]   Stakeholders' perceptions of rehabilitation services for individuals living with disability: a survey study [J].
Darzi, Andrea J. ;
Officer, Alana ;
Abualghaib, Ola ;
Akl, Elie A. .
HEALTH AND QUALITY OF LIFE OUTCOMES, 2016, 14
[4]  
Guidelines Schunemann W., 2011, CURR ALLERGY ASTHM R, V11, P261
[5]   GRADE guidelines: 11. Making an overall rating of confidence in effect estimates for a single outcome and for all outcomes [J].
Guyatt, Gordon ;
Oxman, Andrew D. ;
Sultan, Shahnaz ;
Brozek, Jan ;
Glasziou, Paul ;
Alonso-Coello, Pablo ;
Atkins, David ;
Kunz, Regina ;
Montori, Victor ;
Jaeschke, Roman ;
Rind, David ;
Dahm, Philipp ;
Akl, Elie A. ;
Meerpohl, Joerg ;
Vist, Gunn ;
Berliner, Elise ;
Norris, Susan ;
Falck-Ytter, Yngve ;
Schuenemann, Holger J. .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2013, 66 (02) :151-157
[6]   GRADE guidelines 6. Rating the quality of evidence-imprecision [J].
Guyatt, Gordon H. ;
Oxman, Andrew D. ;
Kunz, Regina ;
Brozek, Jan ;
Alonso-Coello, Pablo ;
Ring, David ;
Devereaux, P. J. ;
Montori, Victor M. ;
Freyschuss, Bo ;
Vist, Gunn ;
Jaeschke, Roman ;
Williams, John W., Jr. ;
Murad, Mohammad Hassan ;
Sinclair, David ;
Falck-Ytter, Yngve ;
Meerpohl, Joerg ;
Whittington, Craig ;
Thorlund, Kristian ;
Andrews, Jeff ;
Schuenemann, Holger J. .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2011, 64 (12) :1283-1293
[7]   Patient Values and Preferences in Decision Making for Antithrombotic Therapy: A Systematic Review Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: American College of Chest Physicians Evidence- Based Clinical Practice Guidelines [J].
MacLean, Samantha ;
Mulla, Sohail ;
Akl, Elie A. ;
Jankowski, Milosz ;
Vandvik, Per Olav ;
Ebrahim, Shanil ;
McLeod, Shelley ;
Bhatnagar, Neera ;
Guyatt, Gordon H. .
CHEST, 2012, 141 (02) :E1S-E23S
[8]   A framework for organizing and selecting quantitative approaches for benefit-harm assessment [J].
Puhan, Milo A. ;
Singh, Sonal ;
Weiss, Carlos O. ;
Varadhan, Ravi ;
Boyd, Cynthia M. .
BMC MEDICAL RESEARCH METHODOLOGY, 2012, 12
[9]   World Health Organization Guidelines: Use of cryotherapy for cervical intraepithelial neoplasia [J].
Santesso, Nancy ;
Schuenemann, Holger ;
Blumenthal, Paul ;
De Vuyst, Hugo ;
Gage, Julia ;
Garcia, Francisco ;
Jeronimo, Jose ;
Lu, Ricky ;
Luciani, Silvana ;
Quek, Swee C. ;
Awad, Tahany ;
Broutet, Nathalie .
INTERNATIONAL JOURNAL OF GYNECOLOGY & OBSTETRICS, 2012, 118 (02) :97-102
[10]   Transparent development of the WHO rapid advice guidelines [J].
Schunemann, Holger J. ;
Hill, Suzanne R. ;
Kakad, Meetali ;
Vist, Gunn E. ;
Bellamy, Richard ;
Stockman, Lauren ;
Wisloff, Torbjorn Fosen ;
Del Mar, Chris ;
Hayden, Frederick ;
Uyeki, Timothy M. ;
Farrar, Jeremy ;
Yazdanpanah, Yazdan ;
Zucker, Howard ;
Beigel, John ;
Chotpitayasunondh, Tawee ;
Hien, Tran Tinh ;
Ozbay, Bulent ;
Sugaya, Norio ;
Oxman, Andrew D. .
PLOS MEDICINE, 2007, 4 (05) :786-793