LingoAI: Language Learning System Integrating Generative AI with 3D Virtual Character

被引：0
|
作者：
Nakamura, Hiroaki [1 ]
Nakazato, Hiroyuki [1 ]
Tobita, Hiroaki [1 ]
机构：
[1] Adv Inst Ind Technol, Tokyo, Japan
来源：
PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024 | 2024年
关键词：
Generative AI; 3D Virtual character; Language Learning;
D O I：
10.1145/3656650.3656725
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
In this study, we developed LingoAI with the aim of solving the limitations that have arisen in chatbot language learning. The proposed method automatically generates natural responses in real time according to the learner's inputs (i.e., voice and text), and a 3D character with facial expression changes and lip-sync is output as voice. This paper presents a functional overview and implementation of the LingoAI system.
引用
收藏
页数：2
相关论文
共 50 条
  • [1] Neural Canvas: Supporting Scenic Design Prototyping by Integrating 3D Sketching and Generative AI
    Shen, Yulin
    Shen, Yifei
    Cheng, Jiawen
    Jiang, Chutian
    Fan, Mingming
    Wang, Zeyu
    PROCEEDINGS OF THE 2024 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYTEMS, CHI 2024, 2024,
  • [2] On the effects of 3D virtual worlds in language learning - a meta-analysis
    Wang, Chien-Pang
    Lan, Yu-Ju
    Tseng, Wen-Ta
    Lin, Yen-Ting R.
    Gupta, Kao Chia-Ling
    COMPUTER ASSISTED LANGUAGE LEARNING, 2020, 33 (08) : 891 - 915
  • [3] VRCopilot: Authoring 3D Layouts with Generative AI Models in VR
    Gettig, Jacob
    Pan, Jin
    Oney, Steve
    Zhang, Lei
    Guo, Anhong
    PROCEEDINGS OF THE 37TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, USIT 2024, 2024,
  • [4] Integrating Virtual Reality in Language Learning Settings
    Torres, Kelly M.
    Statti, Aubrey
    12TH INTERNATIONAL CONFERENCE INNOVATION IN LANGUAGE LEARNING, 2019, : 466 - 468
  • [5] Advanced 3D Food Printing with Simultaneous Cooking and Generative AI Design
    Lee, Connie Kong Wai
    Xu, Yang
    Yuan, Qiaoyaxiao
    Chan, Yee Him
    Poon, Wing Yan
    Zhong, Haosong
    Chen, Siyu
    Li, Mitch Guijun
    ADVANCED MATERIALS, 2025,
  • [6] Generative AI for Learning: Investigating the Potential of Learning Videos with Synthetic Virtual Instructors
    Leiker, Daniel
    Gyllen, Ashley Ricker
    Eldesouky, Ismail
    Cukurova, Mutlu
    ARTIFICIAL INTELLIGENCE IN EDUCATION. POSTERS AND LATE BREAKING RESULTS, WORKSHOPS AND TUTORIALS, INDUSTRY AND INNOVATION TRACKS, PRACTITIONERS, DOCTORAL CONSORTIUM AND BLUE SKY, AIED 2023, 2023, 1831 : 523 - 529
  • [7] Caring in the dynamics of design and languaging: exploring second language learning in 3D virtual spaces
    Zheng, Dongping
    LANGUAGE SCIENCES, 2012, 34 (05) : 543 - 558
  • [8] Leveraging Deep Learning and Generative AI for Predicting Rheological Properties and Material Compositions of 3D Printed Polyacrylamide Hydrogels
    Mohammad, Sakib
    Akand, Rafee
    Cook, Kaden M.
    Nilufar, Sabrina
    Chowdhury, Farhan
    GELS, 2024, 10 (10)
  • [9] Distributed agency in second language learning and teaching through generative AI
    Godwin-Jones, Robert
    LANGUAGE LEARNING & TECHNOLOGY, 2024, 28 (02): : 20 - 31
  • [10] Integrating quantum CI and generative AI for Taiwanese/English co-learning
    Lee, Chang-Shing
    Wang, Mei-Hui
    Chen, Chih-Yu
    Yang, Sheng-Chi
    Reformat, Marek
    Kubota, Naoyuki
    Pourabdollah, Amir
    QUANTUM MACHINE INTELLIGENCE, 2024, 6 (02)
12345