Publication and related biases in health services research: a systematic review of empirical evidence

被引:17
作者
Ayorinde, Abimbola A. [1 ]
Williams, Iestyn [2 ]
Mannion, Russell [2 ]
Song, Fujian [3 ]
Skrybant, Magdalena [4 ]
Lilford, Richard J. [4 ]
Chen, Yen-Fu [1 ]
机构
[1] Univ Warwick, Warwick Med Sch, Div Hlth Sci, Warwick Ctr Appl Hlth Res & Delivery, Coventry, W Midlands, England
[2] Univ Birmingham, Sch Social Policy, Hlth Serv Management Ctr, Birmingham, W Midlands, England
[3] Univ East Anglia, Norwich Med Sch, Norwich, Norfolk, England
[4] Univ Birmingham, Inst Appl Hlth Res, Birmingham, W Midlands, England
关键词
Publication bias; Outcome reporting bias; Dissemination bias; Grey literature; Research publication; Research registration; Health services research; Systematic review; Research methodology; Funnel plots; IMPROVEMENT PROJECTS; P-CURVE; QUALITY; INFORMATICS; STRATEGIES; COUNTRIES; COVERAGE; COSTS;
D O I
10.1186/s12874-020-01010-1
中图分类号
R19 [保健组织与事业(卫生事业管理)];
学科分类号
摘要
Background Publication and related biases (including publication bias, time-lag bias, outcome reporting bias and p-hacking) have been well documented in clinical research, but relatively little is known about their presence and extent in health services research (HSR). This paper aims to systematically review evidence concerning publication and related bias in quantitative HSR. Methods Databases including MEDLINE, EMBASE, HMIC, CINAHL, Web of Science, Health Systems Evidence, Cochrane EPOC Review Group and several websites were searched to July 2018. Information was obtained from: (1) Methodological studies that set out to investigate publication and related biases in HSR; (2) Systematic reviews of HSR topics which examined such biases as part of the review process. Relevant information was extracted from included studies by one reviewer and checked by another. Studies were appraised according to commonly accepted scientific principles due to lack of suitable checklists. Data were synthesised narratively. Results After screening 6155 citations, four methodological studies investigating publication bias in HSR and 184 systematic reviews of HSR topics (including three comparing published with unpublished evidence) were examined. Evidence suggestive of publication bias was reported in some of the methodological studies, but evidence presented was very weak, limited in both quality and scope. Reliable data on outcome reporting bias and p-hacking were scant. HSR systematic reviews in which published literature was compared with unpublished evidence found significant differences in the estimated intervention effects or association in some but not all cases. Conclusions Methodological research on publication and related biases in HSR is sparse. Evidence from available literature suggests that such biases may exist in HSR but their scale and impact are difficult to estimate for various reasons discussed in this paper. Systematic review registration PROSPERO 2016 CRD42016052333.
引用
收藏
页数:12
相关论文
共 50 条
[11]   Evaluations of effective coverage of maternal and child health services: A systematic review [J].
Gebremedhin, Aster Ferede ;
Dawson, Angela ;
Hayen, Andrew .
HEALTH POLICY AND PLANNING, 2022, 37 (07) :895-914
[12]   Application of Mixed Methods in Health Services Management Research: A Systematic Review [J].
Lee, Shoou-Yih D. ;
Iott, Bradley ;
Banaszak-Holl, Jane ;
Shih, Shu-Fang ;
Raj, Minakshi ;
Johnson, Kimson E. ;
Kiessling, Karalyn ;
Moore-Petinak, N'dea .
MEDICAL CARE RESEARCH AND REVIEW, 2022, 79 (03) :331-344
[13]   Differentiation Hypotheses of Intelligence: A Systematic Review of the Empirical Evidence and an Agenda for Future Research [J].
Breit, Moritz ;
Brunner, Martin ;
Molenaar, Dylan ;
Preckel, Franzis .
PSYCHOLOGICAL BULLETIN, 2022, 148 (7-8) :518-554
[14]   Evidence-Based Health Services Research - A Short Review and Implications [J].
Graessel, E. ;
Donath, C. ;
Hollederer, A. ;
Drexler, H. ;
Kornhuber, J. ;
Zobel, A. ;
Kolominsky-Rabas, P. .
GESUNDHEITSWESEN, 2015, 77 (03) :193-199
[15]   Interactive Visualization Applications in Population Health and Health Services Research: Systematic Scoping Review [J].
Chishtie, Jawad ;
Bielska, Iwona Anna ;
Barrera, Aldo ;
Marchand, Jean-Sebastien ;
Imran, Muhammad ;
Tirmizi, Syed Farhan Ali ;
Turcotte, Luke A. ;
Munce, Sarah ;
Shepherd, John ;
Senthinathan, Arrani ;
Cepoiu-Martin, Monica ;
Irvine, Michael ;
Babineau, Jessica ;
Abudiab, Sally ;
Bjelica, Marko ;
Collins, Christopher ;
Craven, B. Catharine ;
Guilcher, Sara ;
Jeji, Tara ;
Naraei, Parisa ;
Jaglal, Susan .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2022, 24 (02)
[16]   Dual-factor Models of Mental Health: A Systematic Review of Empirical Evidence [J].
Magalhaes, Eunice .
PSYCHOSOCIAL INTERVENTION, 2024, 33 (02) :89-102
[17]   Accreditation of primary health care services: A systematic review [J].
Rastegarimehr, Babak ;
Teymourlouy, Ahmad Ahmadi ;
Gorji, Hasan Abolghasem .
JOURNAL OF EDUCATION AND HEALTH PROMOTION, 2025, 14 (01)
[18]   Paradigm's Relevance in Empirical Research Biases: Hypnotizability, Resilience, and Self-Control, an Empty Systematic Review [J].
Alarcon, Ana ;
Franch, Marc ;
Mendoza, M. Elena ;
Capafons, Antonio .
PSYCHOLOGY OF CONSCIOUSNESS-THEORY RESEARCH AND PRACTICE, 2025, 12 (03) :371-382
[19]   Health services research related to chiropractic: Review and recommendations for research prioritization by the chiropractic profession [J].
Mootz, RD ;
Coulter, ID ;
Hansen, DT .
JOURNAL OF MANIPULATIVE AND PHYSIOLOGICAL THERAPEUTICS, 1997, 20 (03) :201-217
[20]   Health services research related to chiropractic: Review and recommendations for research prioritization by the chiropractic profession [J].
Mootz, Robert D. ;
Hansen, Daniel T. ;
Breen, Alan ;
Killinger, Lisa Z. ;
Nelson, Craig .
JOURNAL OF MANIPULATIVE AND PHYSIOLOGICAL THERAPEUTICS, 2006, 29 (09) :707-725