Measurement of Self-regulated Learning: Strategies for Mapping Trace Data to Learning Processes and Downstream Analysis Implications

被引:2
作者
Osakwe, Ikenna [1 ]
Chen, Guanliang [1 ]
Fan, Yizhou [2 ]
Rakovic, Mladen [1 ]
Singh, Shaveen [1 ]
Molenaar, Inge [3 ]
Gasevic, Dragan [1 ]
机构
[1] Monash Univ, Clayton, Vic, Australia
[2] Peking Univ, Beijing, Peoples R China
[3] Radboud Univ Nijmegen, Nijmegen, Netherlands
来源
FOURTEENTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE, LAK 2024 | 2024年
基金
澳大利亚研究理事会; 英国经济与社会研究理事会;
关键词
MICROLEVEL PROCESSES;
D O I
10.1145/3636555.3636915
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Trace data provides opportunities to study self-regulated learning (SRL) processes as they unfold. However, raw trace data must be translated into meaningful SRL constructs to enable analysis. This typically involves developing a pattern dictionary that maps trace sequences to SRL processes, and a trace parser to implement the mappings. While much attention focuses on the pattern dictionary, trace parsing methodology remains under-investigated. This study explores how trace parsers affect extracted processes and downstream analysis. Four methods were compared: Disconnected, Connected, Lookahead, and Synonym Matching. Statistical analysis of medians and process mining networks showed parsing choices significantly impacted SRL process identification and sequencing. Disconnected parsing isolated metacognitive processes while Connected approaches showed greater connectivity between meta-cognitive and cognitive events. Furthermore, Connected methods provided process maps more aligned with cyclical theoretical models of SRL. The results demonstrate trace parser design critically affects the validity of extracted SRL processes, with implications for SRL measurement in learning analytics.
引用
收藏
页码:563 / 575
页数:13
相关论文
共 41 条
[1]  
[Anonymous], 2003, Handbook of Graph Theory
[2]  
Azevedo R., 2013, International handbook of metacognition and learning technologies, P427
[3]   The benefits and caveats of using clickstream data to understand student self-regulatory behaviors: opening the black box of learning processes [J].
Baker, Rachel ;
Xu, Di ;
Park, Jihyun ;
Yu, Renzhe ;
Li, Qiujie ;
Cung, Bianca ;
Fischer, Christian ;
Rodriguez, Fernando ;
Warschauer, Mark ;
Smyth, Padhraic .
INTERNATIONAL JOURNAL OF EDUCATIONAL TECHNOLOGY IN HIGHER EDUCATION, 2020, 17 (01)
[4]   Process mining techniques for analysing patterns and strategies in students' self-regulated learning [J].
Bannert, Maria ;
Reimann, Peter ;
Sonnenberg, Christoph .
METACOGNITION AND LEARNING, 2014, 9 (02) :161-185
[5]  
BUTLER DL, 1995, REV EDUC RES, V65, P245, DOI 10.3102/00346543065003245
[6]   The Relation Between Self-Regulated Learning and Academic Achievement Across Childhood and Adolescence: A Meta-Analysis [J].
Dent, Amy L. ;
Koenka, Alison C. .
EDUCATIONAL PSYCHOLOGY REVIEW, 2016, 28 (03) :425-474
[7]   Towards investigating the validity of measurement of self-regulated learning based on trace data [J].
Fan, Yizhou ;
van der Graaf, Joep ;
Lim, Lyn ;
Rakovic, Mladen ;
Singh, Shaveen ;
Kilgour, Jonathan ;
Moore, Johanna ;
Molenaar, Inge ;
Bannert, Maria ;
Gasevic, Dragan .
METACOGNITION AND LEARNING, 2022, 17 (03) :949-987
[8]   A learning analytic approach to unveiling self-regulatory processes in learning tactics [J].
Fan, Yizhou ;
Saint, John ;
Singh, Shaveen ;
Jovanovic, Jelena ;
Gasevi, Dragan .
LAK21 CONFERENCE PROCEEDINGS: THE ELEVENTH INTERNATIONAL CONFERENCE ON LEARNING ANALYTICS & KNOWLEDGE, 2021, :184-195
[9]  
Fan Yizhou, 2023, Journal of Computer Assisted Learning
[10]   Measuring self-regulated learning in the workplace [J].
Fontana, Rosa ;
Milligan, Colin ;
Littlejohn, Allison ;
Margaryan, Anoush .
INTERNATIONAL JOURNAL OF TRAINING AND DEVELOPMENT, 2015, 19 (01) :32-52