Alive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

被引:5
|
作者
Lyu, Zhuoyue [1 ]
Li, Jiannan [1 ]
Wang, Bryan [1 ]
机构
[1] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
来源
2021 4TH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2021) | 2021年
关键词
artificial intelligence; virtual reality; human-computer interaction; sonification; visualization;
D O I
10.1109/AIVR52153.2021.00057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present Alive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". Alive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, Alive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.
引用
收藏
页码:251 / 255
页数:5
相关论文
共 50 条
  • [21] Virtual reality for cultural landscape visualization
    Sébastien Griffon
    Amélie Nespoulous
    Jean-Paul Cheylan
    Pascal Marty
    Daniel Auclair
    Virtual Reality, 2011, 15 : 279 - 294
  • [22] A walk in the black-box: 3D visualization of large neural networks in virtual reality
    Christoph Linse
    Hammam Alshazly
    Thomas Martinetz
    Neural Computing and Applications, 2022, 34 : 21237 - 21252
  • [23] Virtual Reality for Interactive Medical Analysis
    Koger, Casey R.
    Hassan, Sohail S.
    Yuan, Jie
    Ding, Yichen
    FRONTIERS IN VIRTUAL REALITY, 2022, 3
  • [24] A walk in the black-box: 3D visualization of large neural networks in virtual reality
    Linse, Christoph
    Alshazly, Hammam
    Martinetz, Thomas
    NEURAL COMPUTING & APPLICATIONS, 2022, 34 (23) : 21237 - 21252
  • [25] Interactive Data Fusion of Neural Radiance Fields for Industrial Facility Inspection in Virtual Reality
    Li, Ke
    Schmidt, Susanne
    Rolff, Tim
    Bacher, Reinhard
    Leemans, Wim
    Steinicke, Frank
    2024 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES ABSTRACTS AND WORKSHOPS, VRW 2024, 2024, : 817 - 818
  • [26] A Proposed Framework for Interactive Virtual Reality In Situ Visualization of Parallel Numerical Simulations
    Gupta, Aryaman
    Guenther, Ulrik
    Incardona, Pietro
    Aydin, Ata Deniz
    Dachselt, Raimund
    Gumhold, Stefan
    Sbalzarini, Ivo F.
    2019 IEEE 9TH SYMPOSIUM ON LARGE DATA ANALYSIS AND VISUALIZATION (LDAV), 2019, : 95 - 96
  • [27] Virtual reality for intelligent and interactive operating-, training- and visualization systems
    Freund, E
    Rossmann, J
    Schluse, M
    SENSOR FUSION AND DECENTRALIZED CONTROL IN ROBOTIC SYSTEMS III, 2000, 4196 : 267 - 278
  • [28] GeoVReality: A computational interactive virtual reality visualization framework and workflow for geophysical research
    Wang, Xianying
    Guo, Cong
    Yuen, David A.
    Luo, Gang
    PHYSICS OF THE EARTH AND PLANETARY INTERIORS, 2020, 298 (298)
  • [29] Participatory Design of Sonification Development for Learning about Molecular Structures in Virtual Reality
    Garcia-Ruiz, Miguel
    Cesar Santana-Mancilla, Pedro
    Sanely Gaytan-Lugo, Laura
    Iniguez-Carrillo, Adriana
    MULTIMODAL TECHNOLOGIES AND INTERACTION, 2022, 6 (10)
  • [30] CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization
    Wang, Zijie J.
    Turko, Robert
    Shaikh, Omar
    Park, Haekyu
    Das, Nilaksh
    Hohman, Fred
    Kahng, Minsuk
    Chau, Duen Horng
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2021, 27 (02) : 1396 - 1406