Learning data teaching strategies via knowledge tracing

被引:7
作者
Abdelrahman, Ghodai [1 ]
Wang, Qing [1 ]
机构
[1] Australian Natl Univ, Sch Comp, Canberra, Australia
关键词
Knowledge tracing; Machine teaching; Reinforcement learning; Key -value memory network; Attention;
D O I
10.1016/j.knosys.2023.110511
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Teaching plays a fundamental role in human learning. Typically, a human teaching strategy involves assessing a student's knowledge progress for tailoring the teaching materials to enhance the learning progress. A human teacher can achieve this by tracing a student's knowledge over essential learning concepts in a task. Albeit, such a teaching strategy is not well exploited yet in machine learning as current machine teaching methods tend to directly assess the progress of individual training samples without paying attention to the underlying learning concepts in a learning task. In this paper, we propose a novel method, called Knowledge Augmented Data Teaching (KADT), which can optimize a data teaching strategy for a student model by tracing its knowledge progress over multiple learning concepts in a learning task. Specifically, the KADT method incorporates a knowledge tracing model to dynamically capture the knowledge progress of a student model in terms of latent learning concepts. We further develop an attention-pooling mechanism to distill knowledge representations of a student model with respect to class labels, which enables to develop a data teaching strategy on critical training samples. We have evaluated the performance of the KADT method on four different machine learning tasks, including knowledge tracing, sentiment analysis, movie recommendation, and image classification. The KADT method consistently outperforms the state-of-the-art methods on all these tasks.(c) 2023 The Author(s). Published by Elsevier B.V. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
引用
收藏
页数:12
相关论文
共 38 条
[1]  
Abdelrahman G., 2022, IEEE Trans. Knowl. Data Eng., P1
[2]   Knowledge Tracing with Sequential Key-Value Memory Networks [J].
Abdelrahman, Ghodai ;
Wang, Qing .
PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, :175-184
[3]  
Alfeld S, 2017, AAAI CONF ARTIF INTE, P1274
[4]  
Bahdanau D, 2016, Arxiv, DOI [arXiv:1409.0473, DOI 10.48550/ARXIV.1409.0473]
[5]   A MARKOVIAN DECISION PROCESS [J].
BELLMAN, R .
JOURNAL OF MATHEMATICS AND MECHANICS, 1957, 6 (05) :679-684
[6]   DYNAMIC PROGRAMMING AND STATISTICAL COMMUNICATION THEORY [J].
BELLMAN, R ;
KALABA, R .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 1957, 43 (08) :749-751
[7]  
Bengio Y., 2009, P 26 ANN INT C MACH, P41, DOI DOI 10.1145/1553374.1553380
[8]  
Brown DS, 2019, AAAI CONF ARTIF INTE, P7749
[9]  
Fan Y., 2018, C TRACK P
[10]  
Graves A., 2014, arXiv