Using Multimodal Learning Analytics to Validate Digital Traces of Self-Regulated Learning in a Laboratory Study and Predict Performance in Undergraduate Courses

被引:2
作者
Bernacki, Matthew L. [1 ,2 ]
Yu, Linyu [1 ]
Kuhlmann, Shelbi L. [1 ]
Plumley, Robert D. [1 ]
Greene, Jeffrey A. [1 ]
Duke, Rebekah F. [1 ]
Freed, Rebekah [1 ]
Hollander-Blackmon, Christina [1 ]
Hogan, Kelly A. [1 ]
机构
[1] Univ North Carolina Chapel Hill, Sch Educ, 101A Peabody Hall,CB3500, Chapel Hill, NC 27599 USA
[2] Korea Univ, Dept Educ, Seoul, South Korea
基金
美国国家科学基金会;
关键词
self-regulated learning; validity; learning analytics; learning technologies; STUDENTS; SCIENCE; VALIDITY; METAANALYSIS; COEFFICIENT; RELIABILITY; ACQUISITION; HYPERMEDIA; COMPONENTS; KNOWLEDGE;
D O I
10.1037/edu0000890
中图分类号
G44 [教育心理学];
学科分类号
0402 ; 040202 ;
摘要
Undergraduates enrolled in large, active learning courses must self-regulate their learning (self-regulated learning [SRL]) by appraising tasks, making plans, setting goals, and enacting and monitoring strategies. SRL researchers have relied on self-report and learner-mediated methods during academic tasks studied in laboratories and now collect digital event data when learners engage with technology-based tools in classrooms. Inferring SRL processes from digital events and testing their validity is challenging. We aligned digital and verbal SRL event data to validate digital events as traces of SRL and used them to predict achievement in lab and course settings. In Study 1, we sampled a learning task from a biology course into a laboratory setting. Enrolled students (N = 48) completed the lesson using digital resources (e.g., online textbook, course site) while thinking aloud weeks before it was taught in class. Analyses confirmed that 10 digital events reliably co-occurred >= 70% of the time with verbalized task definition and strategy use macroprocesses. Some digital events co-occurred with multiple verbalized SRL macroprocesses. Variance in occurrence of validated digital events was limited in lab sessions, and they explained statistically nonsignificant variance in learners' performance on lesson quizzes. In Study 2, lesson-specific digital event data from learners (N = 307) enrolled in the course (but not in Study 1) predicted performance on lesson-specific exam items, final exams, and course grades. Validated digital events also predicted final exam and course grades in the next semester (N = 432). Digital events can be validated to reflect SRL processes and scaled to explain achievement in naturalistic undergraduate education settings.
引用
收藏
页码:176 / 205
页数:30
相关论文
共 50 条
[21]   Impact of Learning Analytics Guidance on Student Self-Regulated Learning Skills, Performance, and Satisfaction: A Mixed Methods Study [J].
Tzimas, Dimitrios E. ;
Demetriadis, Stavros N. .
EDUCATION SCIENCES, 2024, 14 (01)
[22]   Effects of Learning Analytics on Students' Self-Regulated Learning in Flipped Classroom [J].
Sedraz Silva, Joao Carlos ;
Zambom, Erik ;
Rodrigues, Rodrigo Lins ;
Cavalcanti Ramos, Jorge Luis ;
de Souza, Fernando da Fonseca .
INTERNATIONAL JOURNAL OF INFORMATION AND COMMUNICATION TECHNOLOGY EDUCATION, 2018, 14 (03) :91-107
[23]   Time will tell: The role of mobile learning analytics in self-regulated learning [J].
Tabuenca, Bernardo ;
Kalz, Marco ;
Drachsler, Hendrik ;
Specht, Marcus .
COMPUTERS & EDUCATION, 2015, 89 :53-74
[24]   Transfer of metacognitive skills in self-regulated learning: an experimental training study [J].
Schuster, Corinna ;
Stebner, Ferdinand ;
Leutner, Detlev ;
Wirth, Joachim .
METACOGNITION AND LEARNING, 2020, 15 (03) :455-477
[25]   Self-regulated learning strategies predict learner behavior and goal attainment in Massive Open Online Courses [J].
Kizilcec, Rene F. ;
Perez-Sanagustin, Mar ;
Maldonado, Jorge J. .
COMPUTERS & EDUCATION, 2017, 104 :18-33
[26]   Using a wider digital ecosystem to improve self-regulated learning [J].
Domino, Molly ;
Shaffer, Clifford A. .
FRONTIERS IN EDUCATION, 2025, 10
[27]   Self-Regulated Learning and Learning Analytics in Online Learning Environments: A Review of Empirical Research [J].
Viberg, Olga ;
Khalil, Mohammad ;
Baars, Martine .
LAK20: THE TENTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE, 2020, :524-533
[28]   Promoting higher education students' self-regulated learning through learning analytics: A qualitative study [J].
Kleimola, Riina ;
Hirsto, Laura ;
Ruokamo, Heli .
EDUCATION AND INFORMATION TECHNOLOGIES, 2025, 30 (04) :4959-4986
[29]   Effectiveness of a gamified learning analytics dashboard with coregulation mechanism for self-regulated learning in college ethics courses [J].
Hu, Yung-Hsiang ;
Liao, Bo-Kai ;
Hsieh, Chieh-Lun .
INTERACTIVE LEARNING ENVIRONMENTS, 2024, 32 (10) :6628-6644
[30]   Analytics of scaffold compliance for self-regulated learning [J].
Saint, John ;
Fan, Yizhou ;
Gasevic, Dragan .
FOURTEENTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE, LAK 2024, 2024, :326-337