Methodology over metrics: current scientific standards are a disservice to patients and society

被引:50
作者
Van Calster, Ben [1 ,2 ,3 ]
Wynants, Laure [1 ,3 ,4 ]
Riley, Richard D. [5 ]
van Smeden, Maarten [6 ]
Collins, Gary S. [7 ,8 ,9 ]
机构
[1] Katholieke Univ Leuven, Dept Dev & Regenerat, Leuven, Belgium
[2] Leiden Univ, Dept Biomed Data Sci, Med Ctr, Leiden, Netherlands
[3] Katholieke Univ Leuven, EPI Ctr, Leuven, Belgium
[4] Maastricht Univ, CAPHRI Care & Publ Hlth Res Inst, Dept Epidemiol, Maastricht, Netherlands
[5] Keele Univ, Sch Med, Ctr Prognosis Res, Keele, Staffs, England
[6] Univ Utrecht, Univ Med Ctr Utrecht, Julius Ctr Hlth Sci & Primary Care, Utrecht, Netherlands
[7] Univ Oxford, Musculoskeletal Sci, Nuffield Dept Orthopaed, Ctr Stat Med, Oxford, England
[8] John Radcliffe Hosp, NIHR Oxford Biomed Res Ctr, Oxford, England
[9] Univ Oxford, Nuffield Dept Orthopaed Rheumatol & Musculoskelet, Ctr Stat Med, UK EQUATOR Ctr, Oxford, England
关键词
Research quality; Methodology; Reporting; REDUCING WASTE; QUALITY; DESIGN;
D O I
10.1016/j.jclinepi.2021.05.018
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Covid-19 research made it painfully clear that the scandal of poor medical research, as denounced by Altman in 1994, persists today. The overall quality of medical research remains poor, despite longstanding criticisms. The problems are well known, but the research community fails to properly address them. We suggest that most problems stem from an underlying paradox: although methodology is undeniably the backbone of high-quality and responsible research, science consistently undervalues methodology. The focus remains more on the destination (research claims and metrics) than on the journey. Notwithstanding, research should serve society more than the reputation of those involved. While we notice that many initiatives are being established to improve components of the research cycle, these initiatives are too disjointed. The overall system is monolithic and slow to adapt. We assert that top-down action is needed from journals, universities, funders and governments to break the cycle and put methodology first. These actions should involve the widespread adoption of registered reports, balanced research funding between innovative, incremental and methodological research projects, full recognition and demystification of peer review, improved methodological review of reports, adherence to reporting guidelines, and investment in methodological education and research. Currently, the scientific enterprise is doing a major disservice to patients and society. (C) 2021 The Authors. Published by Elsevier Inc.
引用
收藏
页码:219 / 226
页数:8
相关论文
共 53 条
[1]  
Adams-Huet B, 2009, J INVEST MED, V57, P818, DOI 10.2310/JIM.0b013e3181c2996c
[2]   COVID-19 coronavirus research has overall low methodological quality thus far: case in point for chloroquine/hydroxychloroquine [J].
Alexander, Paul Elias ;
Debono, Victoria Borg ;
Mammen, Manoj J. ;
Iorio, Alfonso ;
Aryal, Komal ;
Deng, Dianna ;
Brocard, Eva ;
Alhazzani, Waleed .
JOURNAL OF CLINICAL EPIDEMIOLOGY, 2020, 123 :120-126
[3]   THE SCANDAL OF POOR MEDICAL-RESEARCH [J].
ALTMAN, DG .
BRITISH MEDICAL JOURNAL, 1994, 308 (6924) :283-284
[4]   How statistical expertise is used in medical research [J].
Altman, DG ;
Goodman, SN ;
Schroter, S .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2002, 287 (21) :2817-2820
[5]   EQUATOR: reporting guidelines for health research [J].
Altman, Douglas G. ;
Simera, Iveta ;
Hoey, John ;
Moher, David ;
Schutz, Ken .
LANCET, 2008, 371 (9619) :1149-1150
[6]   Reproducibility in Science Improving the Standard for Basic and Preclinical Research [J].
Begley, C. Glenn ;
Ioannidis, John P. A. .
CIRCULATION RESEARCH, 2015, 116 (01) :116-126
[7]   The troubles with peer review for allocating research funding Funders need to experiment with versions of peer review and decision-making [J].
Bendiscioli, Sandra .
EMBO REPORTS, 2019, 20 (12)
[8]   Universal Funder Responsibilities That Advance Social Value [J].
Bierer, Barbara E. ;
Strauss, David H. ;
White, Sarah A. ;
Zarin, Deborah A. .
AMERICAN JOURNAL OF BIOETHICS, 2018, 18 (11) :30-32
[9]   Fate of Clinical Research Studies after Ethical Approval - Follow-Up of Study Protocols until Publication [J].
Bluemle, Anette ;
Meerpohl, Joerg J. ;
Schumacher, Martin ;
von Elm, Erik .
PLOS ONE, 2014, 9 (02)
[10]   Spin in Scientific Publications: A Frequent Detrimental Research Practice [J].
Boutron, Isabelle .
ANNALS OF EMERGENCY MEDICINE, 2020, 75 (03) :432-434