Beyond Reality: The Pivotal Role of Generative AI in the Metaverse

被引:23
作者
Chamola V. [1 ]
Bansal G. [2 ]
Das T.K. [3 ]
Hassija V. [3 ]
Sai S. [1 ]
Wang J. [4 ]
Zeadally S. [5 ]
Hussain A. [6 ]
Yu F.R. [7 ]
Guizani M. [8 ]
Niyato D. [4 ]
机构
[1] BITS-Pilani, Pilani Campus
[2] Kalinga Institute of Industrial Technology, KIIT
来源
IEEE Internet of Things Magazine | 2024年 / 7卷 / 04期
基金
英国工程与自然科学研究理事会;
关键词
Generative adversarial networks - Virtual reality;
D O I
10.1109/IOTM.001.2300174
中图分类号
学科分类号
摘要
The Metaverse, an interconnected network of immersive digital realms, is poised to reshape the future by seamlessly merging physical reality with virtual environments. Its potential to revolutionize diverse aspects of human existence, from entertainment to commerce, underscores its significance. At the heart of this transformation lies Generative AI, a branch of artificial intelligence focused on creating novel content. Generative AI serves as a catalyst, propelling the Metaverse's evolution by enhancing it with immersive experiences. The Metaverse is comprised of three pivotal domains, namely, text, visual, and audio. The Metaverse's fabric intertwines with Generative AI models, ushering in innovative interactions. Within Visual, the triad of image, video, and 3D Object generation sets the stage for engaging virtual landscapes. Key to this evolution is five generative models: Transformers, Diffusion, Autoencoders, Autoregressive, and Generative Adversarial Networks (GANs). These models empower the Metaverse, enhancing it with dynamic and diverse content. Notably, technologies like BARD, Point-E, Stable Diffusion, DALL-E, GPT, and AIVA, among others, wield these models to enrich the Metaverse across domains. By discussing the technical issues and real-world applications, this study reveals the intricate tapestry of AI's role in the Metaverse. Anchoring these insights is a case study illuminating Stable Diffusion's role in metamorphosing the virtual realm. Collectively, this exploration illuminates the symbiotic relationship between Generative AI and the Metaverse, foreshadowing a future where immersive, interactive, and personalized experiences blackefine human engagement with digital landscapes. © 2018 IEEE.
引用
收藏
页码:126 / 135
页数:9
相关论文
共 15 条
[1]  
Hashash O., Et al., The Seven Worlds and Experiences of the Wireless Metaverse: Challenges and Opportunities, (2023)
[2]  
Hamidouche W., Bariah L., Debbah M., Immersive Media and Massive Twinning: Advancing Towards the Metaverse, (2023)
[3]  
Hassan S.Z., Et al., Towards an Ai-Driven Talking Avatar in Virtual Reality for Investigative Interviews of Children, Proc. 2nd Wksp. Games Systems, pp. 9-15, (2022)
[4]  
Lv Z., Generative Artificial Intelligence in the Metaverse Era, Cognitive Robotics, (2023)
[5]  
Qin H.X., Hui P., Empowering the Metaverse with Generative AI: Survey and Future Directions, IEEE Int'l. Conf. Distributed Computing Systems, pp. 1-14, (2023)
[6]  
Weisz J.D., Et al., Toward General Design Principles for Generative AI Applications, (2023)
[7]  
Goyal R., Kumar P., Singh V., A Systematic Survey on Automated Text Generation Tools and Techniques: Application, Evaluation, and Challenges, Multimedia Tools and Applications, pp. 1-56, (2023)
[8]  
Cetinic E., She J., Understanding and Creating Art with AI: Review and Outlook, ACM Trans. Multimedia Computing, Communications, and Applications (TOMM), 18, 2, pp. 1-22, (2022)
[9]  
Huynh-The T., Et al., Artificial Intelligence for the Metaverse: A Survey, Engineering Applications of Artificial Intelligence, 117, (2023)
[10]  
Cao Z., Et al., Realtime Multi-Person 2d Pose Estimation Using Part Affinity Fields, Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 7291-7299, (2017)