The seven sins of L2 research: A review of 30 journals' statistical quality and their CiteScore, SJR, SNIP, JCR Impact Factors

被引:64
作者
Al-Hoorie, Ali H. [1 ]
Vitta, Joseph P. [2 ,3 ]
机构
[1] Jubail Ind Coll, English Language Inst, Jubail Ind City, Saudi Arabia
[2] Queens Univ Belfast, Univ Rd, Belfast BT7 1NN, Antrim, North Ireland
[3] Rikkyo Univ, Coll Intercultural Commun, Tokyo, Japan
关键词
citation analysis metrics; CiteScore; JCR Impact Factor; journal quality; quantitative research; second language; SJR; SNIP; QUANTITATIVE RESEARCH; CONFIDENCE;
D O I
10.1177/1362168818767191
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
This report presents a review of the statistical practices of 30 journals representative of the second language field. A review of 150 articles showed a number of prevalent statistical violations including incomplete reporting of reliability, validity, non-significant results, effect sizes, and assumption checks as well as making inferences from descriptive statistics and failing to correct for multiple comparisons. Scopus citation analysis metrics and whether a journal is SSCI-indexed were predictors of journal statistical quality. No clear evidence was obtained to favor the newly introduced CiteScore over SNIP or SJR. Implications of the results are discussed.
引用
收藏
页码:727 / 744
页数:18
相关论文
共 52 条
[1]  
[Anonymous], 2017, Introduction to Bayesian Statistics
[2]  
[Anonymous], 2010, Multilevel methods: Techniques and analysis
[3]  
[Anonymous], SYSTEM
[4]   Qualitative Research in Language Teaching and Learning Journals, 1997-2006 [J].
Benson, Phil ;
Chik, Alice ;
Gao, Xuesong ;
Huang, Jing ;
Wang, Wenfeng .
MODERN LANGUAGE JOURNAL, 2009, 93 (01) :79-90
[5]   THE USE OF MULTIPLE T-TESTS IN LANGUAGE RESEARCH [J].
BROWN, JD .
TESOL QUARTERLY, 1990, 24 (04) :770-773
[7]   Impact Factor Wars: Episode V-The Empire Strikes Back [J].
Brumback, Roger A. .
JOURNAL OF CHILD NEUROLOGY, 2009, 24 (03) :260-262
[8]  
CHADEGANI A. A., 2013, Asian Soc Sci, V9, P18, DOI [10.5539/ass.v9n5p18, DOI 10.5539/ASS.V9N5P18]
[9]   THE EARTH IS ROUND (P-LESS-THAN.05) [J].
COHEN, J .
AMERICAN PSYCHOLOGIST, 1994, 49 (12) :997-1003
[10]  
Cohen P., 2014, APPL MULTIPLE REGRES, DOI [10.4324/9780203774441, DOI 10.4324/9780203774441]