The effect of an artificial agent's vocal expressiveness on immediacy and learning

Background Though pedagogical artificial agents are expected to play a crucial role in the years to come, earlier studies provide inconsistent results regarding their effect on learning. This might be because their potential for exhibiting subtle nonverbal behaviours we know from human teachers has been untapped. What is more, there is little evidence of the processes underlying the effect of nonverbal behaviours of teachers (either human or artificial) on learning, so as to better guide their practical application. Objectives The aims of the current research were threefold: firstly, to examine the effect of an artificial agent's vocal expressiveness on non-verbal immediacy (teachers' ability to increase psychological closeness through nonverbal communication). Secondly, to test whether an artificial agent showing strong vocal expressiveness will enhance affective and cognitive learning (perceived and actual), as compared to an artificial agent that shows weak vocal expressiveness. Thirdly, to examine whether the underlying mechanisms of motivation and attention explain the effect of immediacy (and thereby also of vocal expressiveness) on the two learning outcomes. Methods The study used a between-participants design, with the participants being randomly assigned to one of the two experimental conditions: artificial modelling with strong expressiveness and artificial modelling with weak vocal expressiveness. Results and conclusions Results showed that an artificial agent with strong vocal expressiveness increased affective and perceived cognitive learning. Partial support was found for actual cognitive learning. What is more, our findings revealed that vocal expressiveness is related to affective and perceived cognitive learning because it promotes nonverbal immediacy. Finally, results provided evidence of motivation as a mediator of the path from immediacy to affective learning. Major takeaways The current findings verify the important role of nonverbal immediacy found in traditional educational settings. However, showing that these results also apply to artificial teachers is essential, given that the educational landscape is changing and reshaping by artificial intelligence. Thus, taking into consideration the role of vocal expressiveness in the development of artificial teachers or voice assistants like Alexa, Siri, and Google assistant, as a way to enhance immediacy and affective experience of learners is of imperative value, since they will be found more and more in our societies.