Alive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

被引：5
|
作者：
Lyu, Zhuoyue [1 ]
Li, Jiannan [1 ]
Wang, Bryan [1 ]
机构：
[1] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
来源：
2021 4TH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2021) | 2021年
关键词：
artificial intelligence; virtual reality; human-computer interaction; sonification; visualization;
D O I：
10.1109/AIVR52153.2021.00057
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present Alive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". Alive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, Alive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.
引用
收藏
页码：251 / 255
页数：5
相关论文
共 50 条
  • [1] Using Visualization of Convolutional Neural Networks in Virtual Reality for Machine Learning Newcomers
    Meissler, Nadine
    Wohlan, Annika
    Hochgeschwender, Nico
    Schreiber, Andreas
    2019 IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR), 2019, : 152 - 158
  • [2] Visualization of Neural Networks in Virtual Reality using UNREAL ENGINE
    Bock, Marcel
    Schreiber, Andreas
    24TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2018), 2018,
  • [3] Interactive visualization through applied virtual reality in construction
    Jones, B
    Webb, I
    1997 IEEE CONFERENCE ON INFORMATION VISUALIZATION, PROCEEDINGS: AN INTERNATIONAL CONFERENCE ON COMPUTER VISUALIZATION & GRAPHICS, 1997, : 166 - 172
  • [4] Visualizing Convolutional Neural Networks with Virtual Reality
    Meissler, Nadine
    Wohlan, Annika
    Hochgeschwender, Nico
    25TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2019), 2019,
  • [5] Virtual Reality Simulator for Sonification Studies
    Torres-Gil, M. A.
    Casanova-Gonzalez, O.
    Gonzalez-Mora, J. L.
    PROCEEDINGS OF THE 8TH WSEAS INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE, MAN-MACHINE SYSTEMS AND CYBERNETICS (CIMMACS '09), 2009, : 112 - +
  • [6] The impact of data sonification in virtual reality robot teleoperation
    Bremner, Paul
    Mitchell, Thomas J.
    McIntosh, Verity
    FRONTIERS IN VIRTUAL REALITY, 2022, 3
  • [7] A Demonstrator for Interactive Image Clustering and Fine-Tuning Neural Networks in Virtual Reality
    Prange, Alexander
    Sonntag, Daniel
    ADVANCES IN ARTIFICIAL INTELLIGENCE, KI 2021, 2021, 12873 : 194 - 203
  • [8] NVIS: an interactive visualization tool for neural networks
    Streeter, M
    Ward, M
    Alvarez, SA
    VISUAL DATA EXPLORATION AND ANALYSIS VIII, 2001, 4302 : 234 - 241
  • [9] Interactive Narrative in Virtual Reality
    Ostrin, Gilad
    Frey, Jeremy
    Cauchard, Jessica R.
    17TH INTERNATIONAL CONFERENCE ON MOBILE AND UBIQUITOUS MULTIMEDIA (MUM 2018), 2018, : 463 - 467
  • [10] Virtual reality hardware for use in interactive 3D data fusion and visualization
    Gourley, CS
    Abidi, MA
    SENSOR FUSION AND DECENTRALIZED CONTROL IN AUTONOMOUS ROBOTIC SYSTEMS, 1997, 3209 : 281 - 291
12345