High social media attention scores are not reflective of study quality: an altmetrics-based content analysis

被引:0
作者
Kyle Nash Kunze
Joseph Emanuele Manzi
Evan Michael Polce
Amar Vadhera
Mohit Bhandari
Nicolas Santiago Piuzzi
机构
[1] Hospital for Special Surgery,Department of Orthopaedic Surgery
[2] Weill Cornell Medicine,Department of Health Research Methods, Evidence, and Impact
[3] University of Wisonconsin School of Medicine and Public Health,Division of Orthopaedic Surgery, Department of Surgery
[4] McMaster University,Department of Orthopaedic Surgery
[5] McMaster University,undefined
[6] Cleveland Clinic,undefined
来源
Internal and Emergency Medicine | 2022年 / 17卷
关键词
Altmetrics; Bibliometric; Randomized controlled trial; Bias; Methodology; Citation rate;
D O I
暂无
中图分类号
学科分类号
摘要
Recent literature has demonstrated the associations between social media attention, as measured by altmetric attention score (AAS), and higher citation rates across medical disciplines. Despite increasing use of AAS, an understanding of factors associated with higher AAS and social media attention remains lacking. Furthermore, if this increased attention correlates with a higher methodological quality and lower biases has not been determined. Therefore, the purpose of the current study was to determine the relationship between methodological quality, study biases and the AAS in randomized controlled trials (RCTs). All RCTs from 2016 in the New England Journal of Medicine (NEJM), Journal of the American Medical Society (JAMA), and Lancet were extracted and the (1) AAS; (2) Methodological Bias (JADAD Scale); Study Bias (Cochrane Risk-of-Bias tool for RCTs) recorded. A total of 296 RCTs with a median (range) AAS and citation rate per article of 234.0(7–4079) and 165.0(4–3257), respectively, were included. The AAS was positively associated with citation rate (β 0.19, 95% CI 0.10–0.29; P < 0.001). Methodological bias was not associated with the AAS (β − 36.3, 95% CI − 83.5–10.9; P = 0.131), but was negatively associated with higher citation rates (β − 66.4, 95% CI − 106.0 to − 26.9; P = 0.001). The number of study biases was not associated with the AAS (β 43.7, 95% CI − 6.3–93.7;P = 0.086), but was positively associated with a higher citation rate (β 64.5, 95% CI 22.4–106.6; P = 0.003). The online attention of RCTs in medical journals was not necessarily reflective of high methodological quality and minimal study biases, but was associated with higher citation rates. Researchers and clinicians should critically examine each article despite the amount of online attention an article receives as the AAS does not necessarily reflect article quality.
引用
收藏
页码:1363 / 1374
页数:11
相关论文
共 98 条
[1]  
Seglen PO(1997)Why the impact factor of journals should not be used for evaluating research BMJ 314 497-895.e881
[2]  
Wang J(2017)The spectrum of altmetrics in neurosurgery: the top 100 "Trending" articles in neurosurgical journals World Neurosurg 103 883-953
[3]  
Alotaibi NM(2018)Social impact in social media: a new method to evaluate the social impact of research PLoS ONE 13 e0203117-1062
[4]  
Ibrahim GM(2018)Correlation of altmetric attention score with article citations in cardiovascular research J Am Coll Cardiol 72 952-94
[5]  
Kulkarni AV(2019)Comparison of attention for neurological research on social media vs academia: an altmetric score analysis JAMA Neurol 48 1056-2767
[6]  
Lozano AM(2020)The top 100 spine surgery articles on social media: an altmetric study Spine (Phila Pa 1976) 20 88-134S
[7]  
Pulido CM(2020)What Is the Predictive ability and academic impact of the altmetrics score and social media attention? Am J Sports Med 287 2765-e412
[8]  
Redondo-Sama G(2017)Common pitfalls and mistakes in the set-up, analysis and interpretation of results in network meta-analysis: what clinicians should look for in a published article Evid Based Ment Health 10 120S-12
[9]  
Sordé-Martí T(2002)Poor-quality medical research: what can journals do? JAMA 40 e405-175
[10]  
Flecha R(1989)Impact of randomized clinical trials on medical practices Control Clin Trials 17 1-58