Assessing the validity of a learning analytics expectation instrument: A multinational study

被引:28
作者
Whitelock-Wainwright, Alexander [1 ]
Gasevic, Dragan [2 ]
Tsai, Yi-Shan [3 ]
Drachsler, Hendrik [4 ]
Scheffel, Maren [4 ]
Munoz-Merino, Pedro J. [5 ]
Tammets, Kairit [6 ]
Delgado Kloos, Carlos [5 ]
机构
[1] Monash Univ, Portfolio DVC & VP Educ, Clayton, Vic, Australia
[2] Monash Univ, Fac Informat Technol, Melbourne, Vic, Australia
[3] Univ Edinburgh, Sch Informat, Edinburgh, Midlothian, Scotland
[4] Open Univ Netherlands, Fac Psychol & Educ Sci, Heerlen, Netherlands
[5] Univ Carlos III Madrid, Dept Telemat Engn, Madrid, Spain
[6] Tallinn Univ, Sch Digital Technol, Tallinn, Estonia
关键词
learning analytics; multinational; questionnaire; Student expectations; COVARIANCE STRUCTURE-ANALYSIS; STRUCTURAL EQUATION MODELS; STUDENT PERCEPTIONS; PRINCIPLES; SUPPORT;
D O I
10.1111/jcal.12401
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
To assist higher education institutions in meeting the challenge of limited student engagement in the implementation of Learning Analytics services, the Questionnaire for Student Expectations of Learning Analytics (SELAQ) was developed. This instrument contains 12 items, which are explained by a purported two-factor structure of "Ethical and Privacy Expectations" and "Service Feature Expectations." As it stands, however, the SELAQ has only been validated with students from UK university, which is problematic on account of the interest in Learning Analytics extending beyond this context. Thus, the aim of the current work was to assess whether the translated SELAQ can be validated in three contexts (an Estonian, a Spanish, and a Dutch University). The findings show that the model provided acceptable fits in both the Spanish and Dutch samples, but was not supported in the Estonian student sample. In addition, an assessment of local fit is undertaken for each sample, which provides important points that need to be considered in future work. Finally, a general comparison of expectations across contexts is undertaken, which are discussed in relation to the General Data Protection Regulation (2018).
引用
收藏
页码:209 / 240
页数:32
相关论文
共 57 条
[1]   Learning Analytics: at the Nexus of Big Data, Digital Innovation, and Social Justice in Education [J].
Aguilar S.J. .
TechTrends, 2018, 62 (1) :37-45
[2]   A qualitative evaluation of evolution of a learning analytics tool [J].
Ali, Liaqat ;
Hatala, Marek ;
Gasevic, Dragan ;
Jovanovic, Jelena .
COMPUTERS & EDUCATION, 2012, 58 (01) :470-489
[3]  
[Anonymous], 2017, Mplus User's guide
[4]  
[Anonymous], 2016, ONLINE LEARNING
[5]  
[Anonymous], 2007, Educause Review
[6]  
[Anonymous], 2017, Sheila Project
[7]   Student Perceptions of Their Privacy in Leaning Analytics Applications [J].
Arnold, Kimberly E. ;
Sclater, Niall .
SEVENTH INTERNATIONAL LEARNING ANALYTICS & KNOWLEDGE CONFERENCE (LAK'17), 2017, :66-69
[8]   Exploratory Structural Equation Modeling [J].
Asparouhov, Tihomir ;
Muthen, Bengt .
STRUCTURAL EQUATION MODELING-A MULTIDISCIPLINARY JOURNAL, 2009, 16 (03) :397-438
[9]  
Bandalos Deborah L., 2018, Measurement Theory and Applications for the Social Sciences. Methodology in the Social Sciences, P1
[10]   Trends and Issues in Student-Facing Learning Analytics Reporting Systems Research [J].
Bodily, Robert ;
Verbert, Katrien .
SEVENTH INTERNATIONAL LEARNING ANALYTICS & KNOWLEDGE CONFERENCE (LAK'17), 2017, :309-318