Development of the Scientific, Transparent and Applicable Rankings (STAR) tool for clinical practice guidelines

被引:0
作者
Yang Nan [1 ,2 ,3 ,4 ,5 ,6 ]
Liu Hui [7 ,8 ,9 ,10 ]
Zhao Wei [11 ,12 ,13 ,6 ]
Pan Yang [14 ,12 ,13 ,6 ]
Lyu Xiangzheng [15 ,16 ,12 ,13 ,6 ]
Hao Xiuyuan [15 ,17 ,12 ,13 ,6 ]
Liu Xiaoqing [18 ,19 ,20 ,21 ,22 ,23 ,24 ,6 ]
Qi Wenan [25 ,12 ,13 ,6 ]
Chen Tong [26 ,27 ,28 ,29 ,6 ]
Wang Xiaoqin [30 ,28 ,31 ,6 ]
Zhang Boheng [32 ,33 ,34 ,28 ,35 ,36 ,6 ]
Zhang Weishe [37 ,38 ,39 ,40 ,41 ,6 ]
Li Qiu [42 ,43 ,44 ,45 ,46 ,47 ,6 ]
Xu Dong [48 ,49 ,50 ,51 ,52 ,6 ]
Gao Xinghua [53 ,54 ,55 ,56 ,6 ]
Jin Yinghui [57 ,58 ,59 ,60 ,6 ]
Sun Feng [61 ,62 ,63 ,6 ]
Meng Wenbo [64 ,65 ,4 ,5 ,6 ]
Li Guobao [66 ,67 ,68 ,69 ,70 ,71 ,6 ]
Wu Qijun [72 ,73 ,55 ,74 ,6 ]
Chen Ze [1 ,2 ,3 ,4 ,5 ,6 ]
Wang Xu [75 ,43 ,47 ,6 ]
Estill Janne [1 ,2 ,3 ,4 ,5 ,6 ]
Norris Susan L [76 ,77 ,78 ,79 ,80 ,81 ]
Du Liang [82 ,83 ,84 ,85 ,86 ,6 ]
Chen Yaolong [1 ,2 ,3 ,4 ,5 ,6 ]
Wei Junmin [87 ,13 ,6 ]
机构
[1] Evidence-Based Medicine Center
[2] School of Basic Medical Sciences
[3] Lanzhou University
[4] Lanzhou
[5] Gansu
[6] China
[7] Institute of Global Health
[8] University of Geneva
[9] Geneva
[10] Switzerland
[11] Editor-in-Chief Office
[12] Chinese Medical Association Publishing House
[13] Beijing
[14] Marketing Department
[15] Editorial Department
[16] National Medical Journal of China
[17] Chinese Medical Journal
[18] Division of Infectious Diseases
[19] Department of Internal Medicine
[20] State Key Laboratory of Complex Severe and Rare Disease
[21] Peking Union Medical College Hospital
[22] Chinese Academy of Medical Sciences &amp
[23] Peking Union Medical College
[24] Editorial office of Digital Medicine and Health
[25] Department of Hematology
[26] Huashan Hospital
[27] Fudan University
[28] Shanghai
[29] Evidence-based Medicine Center
[30] Department of Hepatic Oncology
[31] Xiamen Clinical Research Center for Cancer Therapy
[32] Zhongshan Hospital (Xiamen)
[33] Xiamen
[34] Fujian
[35] Department of Obstetrics
[36] Xiangya Hospital
[37] Central South University
[38] Changsha
[39] Hunan
[40] Department of Nephrology
[41] Children’s Hospital of Chongqing Medical University
[42] National Clinical Research Center for Child Health and Disorders
[43] Ministry of Education Key Laboratory of Child Development and Disorders
[44] Chongqing Key Laboratory of Pediatrics
[45] Chongqing
[46] SMU Institute for Global Health (SIGHT)
[47] School of Health Management and Dermatology Hospital
[48] Southern Medical University (SMU)
[49] Guangzhou
[50] Guangdong
关键词
Practice guideline; Evidence-based practice; Quality control;
D O I
暂无
中图分类号
R-3 [医学研究方法];
学科分类号
10 ;
摘要
Background: This study aimed to develop a comprehensive instrument for evaluating and ranking clinical practice guidelines, named Scientific, Transparent and Applicable Rankings tool (STAR), and test its reliability, validity, and usability.Methods: This study set up a multidisciplinary working group including guideline methodologists, statisticians, journal editors, clinicians, and other experts. Scoping review, Delphi methods, and hierarchical analysis were used to develop the STAR tool. We evaluated the instrument’s intrinsic and interrater reliability, content and criterion validity, and usability.Results: STAR contained 39 items grouped into 11 domains. The mean intrinsic reliability of the domains, indicated by Cronbach’s α coefficient, was 0.588 (95% confidence interval [CI]: 0.414, 0.762). Interrater reliability as assessed with Cohen’s kappa coefficient was 0.774 (95% CI: 0.740, 0.807) for methodological evaluators and 0.618 (95% CI: 0.587, 0.648) for clinical evaluators. The overall content validity index was 0.905. Pearson’sr correlation for criterion validity was 0.885 (95% CI: 0.804, 0.932). The mean usability score of the items was 4.6 and the median time spent to evaluate each guideline was 20 min.Conclusion: The instrument performed well in terms of reliability, validity, and efficiency, and can be used for comprehensively evaluating and ranking guidelines.
引用
收藏
相关论文
共 18 条
[1]   2019年期刊公开发表的中国临床实践指南文献调查与评价——制订人员及工作组情况 [J].
王子君 ;
史乾灵 ;
刘云兰 ;
任梦娟 ;
赵思雅 ;
马艳芳 ;
刘辉 ;
张静怡 ;
王平 ;
孙雅佳 ;
王健健 ;
刘萧 ;
吕萌 ;
周奇 ;
杨楠 ;
荀杨芹 ;
陈耀龙 .
协和医学杂志, 2021, 12 (04) :552-559
[2]  
Zhou Qi,Wang Zijun,Shi Qianling,Zhao Siya,Xun Yangqin,Liu Hui,Zhang Hairong,Liu Xiao,Wang Xiaoqin,Yao Liang,Wang Qi,Li Qinyuan,Estill Janne,Yang Kehu,Chen Yaolong.Clinical Epidemiology in China series. Paper 4: The reporting and methodological quality of Chinese clinical practice guidelines published between 2014 and 2018: A Systematic Review[J].Journal of clinical epidemiology,2021
[3]  
Zhao Siya,Lu Shuya,Wu Shouyuan,Wang Zijun,Guo Qiangqiang,Shi Qianling,Zhang Hairong,Zhang Juanjuan,Liu Hui,Liu Yunlan,Zhang Xianzhuo,Wang Ling,Ren Mengjuan,Wang Ping,Lan Hui,Zhou Qi,Sun Yajia,Cao Jin,Li Qinyuan,Estill Janne,Mathew Joseph L.,Ahn Hyeong Sik,Lee Myeong Soo,Wang Xiaohui,Zhou Chenyan,Chen Yaolong.Analysis of COVID-19 Guideline Quality and Change of Recommendations: A Systematic Review[J].Health Data Science,2021
[4]  
Chen Yaolong,Guyatt Gordon H,Munn Zachary,Florez Ivan D,Maru?i? Ana,Norris Susan L,Kredo Tamara,Qaseem Amir.Clinical Practice Guidelines Registry: Toward Reducing Duplication, Improving Collaboration, and Increasing Transparency[J].Annals of internal medicine,2021
[5]   Development and Validation of a Tool to Assess the Quality of Clinical Practice Guideline Recommendations [J].
Brouwers, Melissa C. ;
Spithoff, Karen ;
Kerkvliet, Kate ;
Alonso-Coello, Pablo ;
Burgers, Jako ;
Cluzeau, Francoise ;
Fervers, Beatrice ;
Graham, Ian ;
Grimshaw, Jeremy ;
Hanna, Steven ;
Kastner, Monika ;
Kho, Michelle ;
Qaseem, Amir ;
Straus, Sharon ;
Florez, Ivan D. .
JAMA NETWORK OPEN, 2020, 3 (05)
[6]   A Comparison of AGREE and RIGHT: which Clinical Practice Guideline Reporting Checklist Should Be Followed by Guideline Developers? [J].
Yao, Xiaomei ;
Ma, Jinhui ;
Wang, Qi ;
Kanters, David ;
Ali, Muhammad U. ;
Florez, Ivan D. .
JOURNAL OF GENERAL INTERNAL MEDICINE, 2020, 35 (03) :894-898
[7]   Evaluation of the NCCN guidelines using the RIGHT Statement and AGREE-II instrument: a cross-sectional review [J].
Wayant, Cole ;
Cooper, Craig ;
Turner, D'Arcy ;
Vassar, Matt .
BMJ EVIDENCE-BASED MEDICINE, 2019, 24 (06) :219-226
[8]   Developing and Testing the Agency for Healthcare Research and Quality's National Guideline Clearinghouse Extent of Adherence to Trustworthy Standards (NEATS) Instrument [J].
Jue, J. Jane ;
Cunningham, Sarah ;
Lohr, Kathleen ;
Shekelle, Paul ;
Shiffman, Richard ;
Robbins, Craig ;
Nix, Mary ;
Coates, Vivian ;
Schoelles, Karen .
ANNALS OF INTERNAL MEDICINE, 2019, 170 (07) :480-+
[9]  
Ulrich Siering,Michaela Eikermann,Elke Hausner,Wiebke Hoffmann-E?er,Edmund A Neugebauer.Appraisal tools for clinical practice guidelines: a systematic review[J].PLoS ONE,2018(12)
[10]  
Chen Yaolong,Wang Chen,Shang Hongcai,Yang Kehu,Norris Susan L.Clinical practice guidelines in China[J].BMJ (Clinical research ed.),2018(feb0)