Learning sign language with mixed reality applications - the exploratory case study with deaf students

被引:3
作者
Imashev, Alfarabi [1 ]
Kydyrbekova, Aigerim [2 ]
Oralbayeva, Nurziya [3 ]
Kenzhekhan, Azamat [1 ]
Sandygulova, Anara [1 ]
机构
[1] Nazarbayev Univ, Sch Engn & Digital Sci, Dept Robot, Kabanbay Batyr Ave 53, Astana 01000, Kazakhstan
[2] L N Gumilyov Eurasian Natl Univ, Dept Informat Technol, 2 Satbayeva St, Astana 010000, Kazakhstan
[3] Nazarbayev Univ, Grad Sch Educ, 53 Kabanbay Batyr Ave, Astana 010000, Kazakhstan
关键词
Mixed reality; sign language; human-computer interaction; human-robot interaction; NEGATIVE AFFECT; SHORT-FORM; VALIDATION; CHILDREN;
D O I
10.1007/s10639-024-12525-1
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The current body of scholarly literature highlights the increasing importance of Mixed Reality (MR) in the field of education since it provides an alternative way through visual stimuli inside an immersive environment. In recent years, the possibility for educators to use Mixed Reality as an additional pedagogical instrument has witnessed notable growth. Furthermore, the implementation of MR technology enhances the perceived benefits of employing it as a solution to the challenges encountered in educating and acquiring sign language skills among children who have hearing impairments or are deaf. The development and testing of deaf-friendly techniques for teaching sign language to Deaf or Hard-of-Hearing (DHH) pupils utilizing modern MR technology is the key endeavor of our research. In light of the specific aspects of the pilot study and the suggestions and preferences expressed by the participants, as outlined in previous attempts, we have endeavored to develop a series of instructional modules on the topic of animals. These modules employ various methods of sign demonstration and incorporate visual representations and concise encyclopedic descriptions. To achieve our research objectives, a total of 21 deaf students, ranging in age from 9 to 14 years, were selected for this study. These students study in a mainstream school that have inclusive educational programs. The participants have been offered two options for evaluation: a laptop and the application specifically designed for the HoloLens 2.
引用
收藏
页码:17261 / 17292
页数:32
相关论文
共 52 条
[1]  
Adamo-Villani N., 2017, Lecture Notes of the Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering, LNICST, V180, P54, DOI DOI 10.1007/978-3-319-49625-2_7
[2]  
[Anonymous], 2017, P 2017 CHI C EXTENDE, DOI 10.1145/3027063.3053117
[3]   Research trends in the use of augmented reality in science education: Content and bibliometric mapping analysis [J].
Arici, Faruk ;
Yildirim, Pelin ;
Caliklar, Seyma ;
Yilmaz, Rabia M. .
COMPUTERS & EDUCATION, 2019, 142
[4]  
Bacca J, 2014, EDUC TECHNOL SOC, V17, P133
[5]   Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots [J].
Bartneck, Christoph ;
Kulic, Dana ;
Croft, Elizabeth ;
Zoghbi, Susana .
INTERNATIONAL JOURNAL OF SOCIAL ROBOTICS, 2009, 1 (01) :71-81
[6]  
Biffi E.Z., 2018, OPTOMETRIC ED, V44, P1
[7]  
Bongard-Blanchy Kerstin, 2015, Journal of Design Research, V13, P107
[8]   The Effect of Avatar Technology on SignWriting Vocabularies Acquisition for Deaf Learners [J].
Bouzid, Yosra ;
Khenissi, Mohamed Ali ;
Jemni, Mohamed .
2016 IEEE 16TH INTERNATIONAL CONFERENCE ON ADVANCED LEARNING TECHNOLOGIES (ICALT), 2016, :441-445
[9]   Cybersickness in current-generation virtual reality head-mounted displays: systematic review and outlook [J].
Caserman, Polona ;
Garcia-Agundez, Augusto ;
Zerban, Alvar Gamez ;
Goebel, Stefan .
VIRTUAL REALITY, 2021, 25 (04) :1153-1170
[10]  
Casuso L., 2016, REV INTERAMERICANA P, V50