Evaluating the credibility of anchor based estimates of minimal important differences for patient reported outcomes: instrument development and reliability study

被引:170
作者
Devji, Tahira [1 ]
Carrasco-Labra, Alonso [1 ]
Qasim, Anila [1 ]
Phillips, Mark [1 ]
Johnston, Bradley C. [1 ,2 ]
Devasenapathy, Niveditha [3 ]
Zeraatkar, Dena [1 ]
Bhatt, Meha [1 ]
Jin, Xuejing [4 ]
Brignardello-Petersen, Romina [1 ]
Urquhart, Olivia [5 ]
Foroutan, Farid [1 ]
Schandelmaier, Stefan [1 ]
Pardo-Hernandez, Hector [6 ,7 ]
Vernooij, Robin W. M. [8 ]
Huang, Hsiaomin [9 ]
Rizwan, Yamna [10 ]
Siemieniuk, Reed [1 ]
Lytvyn, Lyubov [1 ]
Patrick, Donald L. [11 ]
Ebrahim, Shanil [1 ]
Furukawa, Toshi [12 ]
Nesrallah, Gihad [13 ,14 ,15 ]
Schunemann, Holger J. [1 ,16 ]
Bhandari, Mohit [1 ,17 ]
Thabane, Lehana [1 ]
Guyatt, Gordon H. [1 ,16 ]
机构
[1] McMaster Univ, Dept Hlth Res Methods Evidence & Impact, 1280 Main St West, Hamilton, ON L8S 4L8, Canada
[2] Dalhousie Univ, Dept Community Hlth & Epidemiol, Halifax, NS, Canada
[3] Indian Inst Publ Hlth, Publ Hlth Fdn India, Gandhinagar, Gujarat, India
[4] Univ Alberta, Sch Publ Hlth, Edmonton, AB, Canada
[5] Amer Dent Assoc, Ctr Evidence Based Dent, Chicago, IL USA
[6] St Pau Biomed Res Inst IIB St Pau, Iberoamer Cochrane Ctr, Barcelona, Spain
[7] CIBER Epidemiol & Salud Publ CIBERESP, Barcelona, Spain
[8] Comprehens Canc Org, Dept Res, Utrecht, Netherlands
[9] Univ Michigan, Dept Orthoped Surg, Ann Arbor, MI 48109 USA
[10] Univ Guelph, Dept Mol & Cellular Biol, Guelph, ON, Canada
[11] Univ Washington, Dept Hlth Serv, Seattle, WA 98195 USA
[12] Kyoto Univ, Sch Publ Hlth, Dept Hlth Promot & Human Behav, Grad Sch Med, Kyoto, Japan
[13] Humber River Reg Hosp, Nephrol Program, Toronto, ON, Canada
[14] Univ Western Ontario, Div Nephrol, London, ON, Canada
[15] St Michaels Hosp, Li Ka Shing Knowledge Inst, Toronto, ON, Canada
[16] McMaster Univ, Dept Med, Hamilton, ON, Canada
[17] McMaster Univ, Dept Surg, Hamilton, ON, Canada
来源
BMJ-BRITISH MEDICAL JOURNAL | 2020年 / 369卷
基金
加拿大健康研究院;
关键词
QUALITY-OF-LIFE; CLINICALLY IMPORTANT DIFFERENCE; OPERATING CHARACTERISTIC ANALYSIS; HEALTH-STATUS MEASURES; SELF-RATED HEALTH; MEANINGFUL CHANGE; RESPONSIVENESS; QUESTIONNAIRE; VALIDITY; TRIALS;
D O I
10.1136/bmj.m1714
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
OBJECTIVE To develop an instrument to evaluate the credibility of anchor based minimal important differences (MIDs) for outcome measures reported by patients, and to assess the reliability of the instrument. DESIGN Instrument development and reliability study. DATA SOURCES Initial criteria were developed for evaluating the credibility of anchor based MIDs based on a literature review (Medline, Embase, CINAHL, and Psyclnfo databases) and the experience of the authors in the methodology for estimation of MIDs. Iterative discussions by the team and pilot testing with experts and potential users facilitated the development of the final instrument. PARTICIPANTS With the newly developed instrument, pairs of masters, doctoral, or postdoctoral students with a background in health research methodology independently evaluated the credibility of a sample of MID estimates. MAIN OUTCOME MEASURES Core credibility criteria applicable to all anchor types, additional criteria for transition rating anchors, and inter-rater reliability coefficients were determined. RESULTS The credibility instrument has five core criteria: the anchor is rated by the patient; the anchor is interpretable and relevant to the patient; the MID estimate is precise; the correlation between the anchor and the outcome measure reported by the patient is satisfactory; and the authors select a threshold on the anchor that reflects a small but important difference. The additional criteria for transition rating anchors are: the time elapsed between baseline and follow-up measurement for estimation of the MID is optimal; and the correlations of the transition rating with the baseline, follow-up, and change score in the patient reported outcome measures are satisfactory. Inter-rater reliability coefficients (K) for the core criteria and for one item from the additional criteria ranged from 0.70 to 0.94. Reporting issues prevented the evaluation of the reliability of the three other additional criteria for the transition rating anchors. CONCLUSIONS Researchers, clinicians, and healthcare policy decision makers can consider using this instrument to evaluate the design, conduct, and analysis of studies estimating anchor based minimal important differences.
引用
收藏
页数:11
相关论文
共 98 条
[1]   Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid [J].
Akl, Elie A. ;
Sun, Xin ;
Busse, Jason W. ;
Johnston, Bradley C. ;
Briel, Matthias ;
Mulla, Sohail ;
You, John J. ;
Bassler, Dirk ;
Lamontagne, Francois ;
Vera, Claudio ;
Alshurafa, Mohamad ;
Katsios, Christina M. ;
Heels-Ansdell, Diane ;
Zhou, Qi ;
Mills, Ed ;
Guyatt, Gordon H. .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2012, 65 (03) :262-267
[2]  
[Anonymous], USERS GUIDES MED LIT
[3]  
[Anonymous], USERS GUIDES MED LIT
[4]   The FDA guidance for industry on PROs: the point of view of a pharmaceutical company [J].
Arpinelli, Fabio ;
Bamfi, Francesco .
HEALTH AND QUALITY OF LIFE OUTCOMES, 2006, 4 (1)
[5]   Sufficiently important difference: Expanding the framework of clinical significance [J].
Barrett, B ;
Brown, D ;
Mundt, M ;
Brown, R .
MEDICAL DECISION MAKING, 2005, 25 (03) :250-261
[6]  
Beaton DE, 2001, J RHEUMATOL, V28, P400
[7]   Applying Concepts of Responsiveness to Patient Management in Neurologic Physical Therapy [J].
Beninato, Marianne ;
Portney, Leslie G. .
JOURNAL OF NEUROLOGIC PHYSICAL THERAPY, 2011, 35 (02) :75-81
[8]   THE SICKNESS IMPACT PROFILE - DEVELOPMENT AND FINAL REVISION OF A HEALTH-STATUS MEASURE [J].
BERGNER, M ;
BOBBITT, RA ;
CARTER, WB ;
GILSON, BS .
MEDICAL CARE, 1981, 19 (08) :787-805
[9]   Qualitative data analysis for health services research: Developing taxonomy, themes, and theory [J].
Bradley, Elizabeth H. ;
Curry, Leslie A. ;
Devers, Kelly J. .
HEALTH SERVICES RESEARCH, 2007, 42 (04) :1758-1772
[10]   DOES FREE CARE IMPROVE ADULTS HEALTH - RESULTS FROM A RANDOMIZED CONTROLLED TRIAL [J].
BROOK, RH ;
WARE, JE ;
ROGERS, WH ;
KEELER, EB ;
DAVIES, AR ;
DONALD, CA ;
GOLDBERG, GA ;
LOHR, KN ;
MASTHAY, PC ;
NEWHOUSE, JP .
NEW ENGLAND JOURNAL OF MEDICINE, 1983, 309 (23) :1426-1434