Implementation of Prototype Environment of Virtual Reality Platform for Virtual Lab (Use case of ESL)

被引:0
作者
Cha, Sangwhan [1 ]
Tian, Yunze [1 ]
Shaalan, Majid [1 ]
Hyun, Jeongwoo [2 ]
Lee, Ki H. [1 ]
机构
[1] Harrisburg Univ Sci & Technol, Comp Informat Sci, Harrisburg, PA 17101 USA
[2] Cornell Univ, Comp Sci, New York, NY 10021 USA
来源
2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA) | 2021年
关键词
Virtual Reality; Virtual Education; Unity; Natural Language Processing; Speech Recognition;
D O I
10.1109/BigData52589.2021.9671565
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Virtual learning platforms have extended the learning experience beyond the constraints of space and time. Learning new language skills in virtual environments is becoming more and more convenient and efficient. In this work, learning English as a second language (ESL) is tested. Initial results showed that it is not only efficient to learn ESL with this tool, but it also helped users to develop good interaction skills with the computer-generated 3D world without any fear or shyness. Current virtual learning platforms suffers from distraction inherited by designing learning activities that requires user interaction, such as pressing the keyboard and clicking the mouse to control the avatar and background. In our research work, we employed a new software implementation stack that include a unity virtual environment, an applied Speech Recognition (SR) capability, and a Natural Language Processing (NLP) component to overcome these distractions and improve the Human-Computer Interaction (HCI) capability without the need for a keyboard and mouse for the dynamic avatar's movement and backgrounds.
引用
收藏
页码:5868 / 5870
页数:3
相关论文
共 14 条
  • [1] Effect of a game-based virtual reality phone application on tracheostomy care education for nursing students: A randomized controlled trial
    Bayram, Sule Biyik
    Caliskan, Nurcan
    [J]. NURSE EDUCATION TODAY, 2019, 79 : 25 - 31
  • [2] BERNS A, 2018, COMPUTER SCI, P776, DOI DOI 10.1145/3284179.3284309
  • [3] Virtual Reality as a Tool for Eliciting Empathetic Behaviour in Carers: An Integrative Review
    Brydon, Megan
    Kimber, Jessica
    Sponagle, Melissa
    MacLaine, Jenna
    Avery, Julie
    Pyke, Lisa
    Gilbert, Robert
    [J]. JOURNAL OF MEDICAL IMAGING AND RADIATION SCIENCES, 2021, 52 (03) : 466 - 477
  • [4] Immersive virtual reality in K-12 and higher education: A 10-year systematic review of empirical research
    Di Natale, Anna Flavia
    Repetto, Claudia
    Riva, Giuseppe
    Villani, Daniela
    [J]. BRITISH JOURNAL OF EDUCATIONAL TECHNOLOGY, 2020, 51 (06) : 2006 - 2033
  • [5] Investigations on speech recognition systems for low-resource dialectal Arabic-English code-switching speech
    Hamed, Injy
    Denisov, Pavel
    Li, Chia-Yu
    Elmahdy, Mohamed
    Abdennadher, Slim
    Ngoc Thang Vu
    [J]. COMPUTER SPEECH AND LANGUAGE, 2022, 72
  • [6] Hwang G.-J., 2022, NURSE ED TODAY
  • [7] Kaplan-Rakowski R., 2018, Future-proof CALL: language learning as exploration and encounters
  • [8] Li KC, 2015, 2015 8TH INTERNATIONAL CONFERENCE ON UBI-MEDIA COMPUTING (UMEDIA) CONFERENCE PROCEEDINGS, P174, DOI 10.1109/UMEDIA.2015.7297450
  • [9] Liang-Yi Chung, 2012, 2012 IEEE Workshops of International Conference on Advanced Information Networking and Applications (WAINA), P250, DOI 10.1109/WAINA.2012.198
  • [10] DARE: Deceiving Audio-Visual speech Recognition model
    Mishra, Saumya
    Gupta, Anup Kumar
    Gupta, Puneet
    [J]. KNOWLEDGE-BASED SYSTEMS, 2021, 232