LingoAI: Language Learning System Integrating Generative AI with 3D Virtual Character

被引:0
|
作者
Nakamura, Hiroaki [1 ]
Nakazato, Hiroyuki [1 ]
Tobita, Hiroaki [1 ]
机构
[1] Adv Inst Ind Technol, Tokyo, Japan
来源
PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCED VISUAL INTERFACES, AVI 2024 | 2024年
关键词
Generative AI; 3D Virtual character; Language Learning;
D O I
10.1145/3656650.3656725
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In this study, we developed LingoAI with the aim of solving the limitations that have arisen in chatbot language learning. The proposed method automatically generates natural responses in real time according to the learner's inputs (i.e., voice and text), and a 3D character with facial expression changes and lip-sync is output as voice. This paper presents a functional overview and implementation of the LingoAI system.
引用
收藏
页数:2
相关论文
共 50 条
  • [31] Demonstration of Style2Fab: Functionality-Aware Segmentation for Fabricating Personalized 3D Models with Generative AI
    Faruqi, Faraz
    Katary, Ahmed
    Hasic, Tarik
    Abdel-Rahman, Amira
    Rahman, Nayeemur
    Tejedor, Leandra
    Leake, Mackenzie
    Hofmann, Megan
    Mueller, Stefanie
    ADJUNCT PROCEEDINGS OF THE 36TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE & TECHNOLOGY, UIST 2023 ADJUNCT, 2023,
  • [32] 3D Digital Human Generation from a Single Image Using Generative AI with Real-Time Motion Synchronization
    Kim, Myeongseop
    Kim, Taehyeon
    Lee, Kyung-Taek
    ELECTRONICS, 2025, 14 (04):
  • [33] Language Teaching in 3D Virtual Worlds with Machinima: Reflecting on an Online Machinima Teacher Training Course
    Thomas, Michael
    Schneider, Christel
    INTERNATIONAL JOURNAL OF COMPUTER-ASSISTED LANGUAGE LEARNING AND TEACHING, 2018, 8 (02) : 20 - 38
  • [34] Exploring Inventions in Self-Directed Language Learning with Generative AI: Implementations and Perspectives of YouTube Content Creators
    Li, Belle
    Wang, Chaoran
    Bonk, Curtis J.
    Kou, Xiaojing
    TECHTRENDS, 2024, 68 (04) : 803 - 819
  • [35] Digital Game-Based Language Learning in 3D Immersive Environments: The GUINEVERE Project
    Thomas, Michael
    Benin, Silvia
    Schneider, Christel
    Rainbow, Carol Ann
    Can, Tuncer
    Simsek, Irfan
    Kose Biber, Sezer
    Philp, Heike
    Zwart, Nick
    Turchetta, Barbara
    Benedetti, Fausto
    Garista, Patrizia
    Cinganotto, Letizia
    PROCEEDINGS OF THE 11TH INNOVATION IN LANGUAGE LEARNING INTERNATIONAL CONFERENCE, 2018, : 103 - 106
  • [36] CIGMA: Automated 3D House Layout Generation through Generative Models
    Upadhyay, Abhinav
    Dubey, Alpana
    Bhardwaj, Nitish
    Kuriakose, Suma Mani
    Mohan, Ramakrishnan
    PROCEEDINGS OF 7TH JOINT INTERNATIONAL CONFERENCE ON DATA SCIENCE AND MANAGEMENT OF DATA, CODS-COMAD 2024, 2024, : 542 - 546
  • [37] From Words to Worlds: Exploring Generative 3D Models in Design and Fabrication
    Danry, Valdemar
    Guzelis, Cenk
    Huang, Lingdong
    Gershenfeld, Neil
    Maes, Pattie
    3D PRINTING AND ADDITIVE MANUFACTURING, 2025, 12 (01) : 1 - 10
  • [38] CREATING AND EXPERIENCIN 3D IMMERSION USING GENERATIVE 2D DIFFUSION: AN INTEGRATED FRAMEWORK
    He, Ziming
    Zou, Xiaomin
    Wu, Pengfei
    Fan, Ling
    Li, Xiaomei
    2024 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS, ICMEW 2024, 2024,
  • [39] Exploring the Effect of Generative AI on Social Sustainability Through Integrating AI Attributes, TPB, and T-EESST: A Deep Learning-Based Hybrid SEM-ANN Approach
    Al-Emran, Mostafa
    Abu-Hijleh, Bassam
    Alsewari, AbdulRahman A.
    IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT, 2024, 71 : 14512 - 14524
  • [40] RESEARCHING EDUCATIONAL FUNCTIONALITY OF 3D VIRTUAL ENVIRONMENTS - METHODOLOGY AND PRACTICE
    Topol, P.
    EDULEARN16: 8TH INTERNATIONAL CONFERENCE ON EDUCATION AND NEW LEARNING TECHNOLOGIES, 2016, : 2260 - 2260