Metacognitive Overload!: Positive and Negative Effects of Metacognitive Prompts in an Intelligent Tutoring System

被引：21

作者：

McCarthy K.S. ^{[1
]}

Likens A.D. ^{[1
]}

Johnson A.M. ^{[1
]}

Guerrero T.A. ^{[1
]}

McNamara D.S. ^{[1
]}

机构：

[1] Arizona State University, Tempe, AZ

来源：

International Journal of Artificial Intelligence in Education | 2018年 / 28卷 / 03期

关键词：

Intelligent tutoring systems; Log data; Metacognition; Reading comprehension;

D O I：

10.1007/s40593-018-0164-5

中图分类号：

学科分类号：

摘要：

Research suggests that promoting metacognitive awareness can increase performance in, and learning from, intelligent tutoring systems (ITSs). The current work examines the effects of two metacognitive prompts within iSTART, a reading comprehension strategy ITS in which students practice writing quality self-explanations. In addition to comparing iSTART practice to a no-training control, those in the iSTART condition (n = 116) were randomly assigned to a 2 (performance threshold: off, on) × 2(self-assessment: off, on) design. The performance threshold notified students when their average self-explanation score was below an experimenter-set threshold and the self-assessment prompted students to estimate their self-explanation score on the current trial. Students who practiced with iSTART had higher posttest self-explanation scores and inference comprehension scores on a transfer test than students in the no training control, replicating previous benefits for iSTART. However, there were no effects of either metacognitive prompt on these learning outcomes. In-system self-explanation scores indicated that the metacognitive prompts were detrimental to performance relative to standard iSTART practice. This study did not find benefits of metacognitive prompts in enhancing performance during practice or after the completion of training. Such findings support the idea that improving reading comprehension strategies comes from deliberate practice with actionable feedback rather than explicit metacognitive supports. © 2018, International Artificial Intelligence in Education Society.

引用

页码：420 / 438

页数：18

共 49 条

[11] Flavell J.H., Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry, American Psychologist, 34, 10, pp. 906-911, (1979)
[12] Gama C., Metacognition in interactive learning environments: The reflection assistant model, Proceedings 7th international conference on intelligent tutoring systems, (2004)
[13] Graesser A.C., McNamara D.S., Self-regulated learning in learning environments with pedagogical agents that interact in natural language, Educational Psychologist, 45, pp. 234-244, (2010)
[14] Hacker D.J., Dunlosky J., Graesser A.C., Metacognition in educational theory and practice, (1998)
[15] Hagaman J.L., Reid R., The effects of the paraphrasing strategy on the reading comprehension of middle school students at risk for failure in reading, Remedial and Special Education, 29, 4, pp. 222-234, (2008)
[16] Haller E.P., Child D.A., Walberg H.J., Can comprehension be taught? A quantitative synthesis of “metacognitive” studies, Educational Researcher, 17, 9, pp. 5-8, (1988)
[17] Healy A.F., Clawson D.M., McNamara D.S., Marmie W.R., Schneider V.I., Rickard T.C., Curtcher R.J., King C., Ericsson K.A., Bourne L.E., The long-term retention of knowledge and skills, Psychology of Learning and Motivation, 30, pp. 135-164, (1993)
[18] Jackson G.T., McNamara D.S., Motivational impacts of a game-based intelligent tutoring system, Proceedings of the 24th international Florida artificial intelligence research society (FLAIRS) conference, pp. 519-524, (2011)
[19] Jacovina M.E., Jackson G.T., Snow E.L., McNamara D.S., Timing game-based practice in a reading comprehension strategy tutor, Proceedings of the 13th international conference on intelligent tutoring systems (ITS 2016), pp. 80-89, (2016)
[20] Kirby J.R., Moore P.J., Metacognitive awareness about reading and its relation to reading ability, Journal of Psychoeducational Assessment, 5, 2, pp. 119-137, (1987)

← 1 2 3 4 5 →