AN EMPIRICAL-STUDY OF THE POSSIBLE RELATION OF TREATMENT DIFFERENCES TO QUALITY SCORES IN CONTROLLED RANDOMIZED CLINICAL-TRIALS

被引:206
作者
EMERSON, JD [1 ]
BURDICK, E [1 ]
HOAGLIN, DC [1 ]
MOSTELLER, F [1 ]
CHALMERS, TC [1 ]
机构
[1] HARVARD UNIV,SCH PUBL HLTH,DEPT HLTH POLICY & MANAGEMENT,TECHNOL ASSESSMENT GRP,BOSTON,MA 02115
来源
CONTROLLED CLINICAL TRIALS | 1990年 / 11卷 / 05期
关键词
meta-analysis; quality scores; Randomized clinical trials;
D O I
10.1016/0197-2456(90)90175-2
中图分类号
R-3 [医学研究方法]; R3 [基础医学];
学科分类号
1001 ;
摘要
Meta-analytic investigations sometimes use assessements of research qualityaccording to a formal protocol as a tool for improving research synthesis. We asked whether a particular quality scoring system could have a direct use in adjusting the summary estimates of a treatment difference. In an empirical study of the relation of quality scores to treatment differences in published meta-analyses of 7 groups of controlled randomized clinical trials comprising 107 primary studies, we found no relation between treatment difference and overall quality score. We also found no relation between quality score and variation in treatment difference. The level of quality scores has increased at a rate of 9% per decade for three decades, averaging 0.51 on a scale of 0 to 1 for the 1980s, and leaving much room for improvement. Nevertheless, attention to quality of studies by editors, reviewers, and authors may be raising both the level of research done and quality of the reports. © 1990.
引用
收藏
页码:339 / 352
页数:14
相关论文
共 39 条
[1]   QUALITY ASSESSMENT OF RANDOMIZED CONTROL TRIALS IN DENTAL RESEARCH .1. METHODS [J].
ANTCZAK, AA ;
TANG, J ;
CHALMERS, TC .
JOURNAL OF PERIODONTAL RESEARCH, 1986, 21 (04) :305-314
[2]   RESEARCH QUALITY, METHODOLOGIC RIGOR, CITATION COUNTS, AND IMPACT [J].
BAILAR, JC .
AMERICAN JOURNAL OF PUBLIC HEALTH, 1982, 72 (10) :1103-1104
[3]   A SURVEY OF CLINICAL-TRIALS OF ANTIBIOTIC-PROPHYLAXIS IN COLON SURGERY - EVIDENCE AGAINST FURTHER USE OF NO-TREATMENT CONTROLS [J].
BAUM, ML ;
ANISH, DS ;
CHALMERS, TC ;
SACKS, HS ;
SMITH, H ;
FAGERSTROM, RM .
NEW ENGLAND JOURNAL OF MEDICINE, 1981, 305 (14) :795-799
[4]   A COMPARISON OF STATISTICAL-METHODS FOR COMBINING EVENT RATES FROM CLINICAL-TRIALS [J].
BERLIN, JA ;
LAIRD, NM ;
SACKS, HS ;
CHALMERS, TC .
STATISTICS IN MEDICINE, 1989, 8 (02) :141-151
[5]   METAANALYSIS OF CLINICAL-TRIALS AS A SCIENTIFIC DISCIPLINE .2. REPLICATE VARIABILITY AND COMPARISON OF STUDIES THAT AGREE AND DISAGREE [J].
CHALMERS, TC ;
BERRIER, J ;
SACKS, HS ;
LEVIN, H ;
REITMAN, D ;
NAGALINGAM, R .
STATISTICS IN MEDICINE, 1987, 6 (07) :733-744
[6]   BIAS IN TREATMENT ASSIGNMENT IN CONTROLLED CLINICAL-TRIALS [J].
CHALMERS, TC ;
CELANO, P ;
SACKS, HS ;
SMITH, H .
NEW ENGLAND JOURNAL OF MEDICINE, 1983, 309 (22) :1358-1361
[7]   METAANALYSIS OF CLINICAL-TRIALS AS A SCIENTIFIC DISCIPLINE .1. CONTROL OF BIAS AND COMPARISON WITH LARGE COOPERATIVE TRIALS [J].
CHALMERS, TC ;
LEVIN, H ;
SACKS, HS ;
REITMAN, D ;
BERRIER, J ;
NAGALINGAM, R .
STATISTICS IN MEDICINE, 1987, 6 (03) :315-&
[8]   A METHOD FOR ASSESSING THE QUALITY OF A RANDOMIZED CONTROL TRIAL [J].
CHALMERS, TC ;
SMITH, H ;
BLACKBURN, B ;
SILVERMAN, B ;
SCHROEDER, B ;
REITMAN, D ;
AMBROZ, A .
CONTROLLED CLINICAL TRIALS, 1981, 2 (01) :31-49
[9]   HOW STUDY DESIGN AFFECTS OUTCOMES IN COMPARISONS OF THERAPY .1. MEDICAL [J].
COLDITZ, GA ;
MILLER, JN ;
MOSTELLER, F .
STATISTICS IN MEDICINE, 1989, 8 (04) :441-454
[10]   AN ANALYSIS OF THE QUALITY OF RESEARCH REPORTS IN THE JOURNAL OF GENERAL INTERNAL MEDICINE [J].
COOPER, GS ;
ZANGWILL, L .
JOURNAL OF GENERAL INTERNAL MEDICINE, 1989, 4 (03) :232-236