An Automatic Self-explanation Sample Answer Generation with Knowledge Components in a Math Quiz

被引:4
作者
Nakamoto, Ryosuke [1 ]
Flanagan, Brendan [2 ]
Dai, Yiling [2 ]
Takami, Kyosuke [2 ]
Ogata, Hiroaki [2 ]
机构
[1] Kyoto Univ, Grad Sch Informat, Kyoto, Japan
[2] Kyoto Univ, Acad Ctr Comp & Media Studies, Kyoto, Japan
来源
ARTIFICIAL INTELLIGENCE IN EDUCATION: POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS AND DOCTORAL CONSORTIUM, PT II | 2022年 / 13356卷
关键词
Self-explanation; Rubric; Automatic summarization; NLP;
D O I
10.1007/978-3-031-11647-6_46
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Little research has addressed how systems can use the learning process of self-explanation to provide scaffolding or feedback. Here, we propose a model automatically generating sample self-explanations with knowledge components required to solve a math quiz. The proposed model contains three steps: vectorization, clustering, and extraction. In an experiment using 1434 self-explanation answers from 25 quizzes, we found 72% of the quizzes generated sample answers with all necessary knowledge components. The similarity between human-created and machine-generated sentences was 0.719, with a significant correlation of R = 0.48 for the best performing generation model by BERTScore. These results suggest that our model can generate sample answers with the necessary key knowledge components and be further improved by using the BERTScore.
引用
收藏
页码:254 / 258
页数:5
相关论文
共 11 条
[1]   Inducing Self-Explanation: a Meta-Analysis [J].
Bisra, Kiran ;
Liu, Qing ;
Nesbit, John C. ;
Salimi, Farimah ;
Winne, Philip H. .
EDUCATIONAL PSYCHOLOGY REVIEW, 2018, 30 (03) :703-725
[2]  
Erkan G, 2011, Arxiv, DOI arXiv:1109.2128
[3]  
Flanagan B, 2018, KNOWL MANAG E-LEARN, V10, P469
[4]  
FLEISS JL, 1971, PSYCHOL BULL, V76, P378, DOI 10.1037/h0031619
[5]   iSTART: Interactive strategy training for active reading and thinking [J].
McNamara, DS ;
Levinstein, IB ;
Boonthum, C .
BEHAVIOR RESEARCH METHODS INSTRUMENTS & COMPUTERS, 2004, 36 (02) :222-233
[6]  
Nakamoto R., 2021, P 29 INT C COMP ED A, P22
[7]   BLEU: a method for automatic evaluation of machine translation [J].
Papineni, K ;
Roukos, S ;
Ward, T ;
Zhu, WJ .
40TH ANNUAL MEETING OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS, PROCEEDINGS OF THE CONFERENCE, 2002, :311-318
[8]  
Reimers N, 2019, Arxiv, DOI [arXiv:1908.10084, 10.48550/arXiv.1908.10084]
[9]   Promoting transfer: Effects of self-explanation and direct instruction [J].
Rittle-Johnson, B .
CHILD DEVELOPMENT, 2006, 77 (01) :1-15
[10]  
Suzuki M., PRETRAINED JAPANESE