Alive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

被引:5
|
作者
Lyu, Zhuoyue [1 ]
Li, Jiannan [1 ]
Wang, Bryan [1 ]
机构
[1] Univ Toronto, Dept Comp Sci, Toronto, ON, Canada
来源
2021 4TH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2021) | 2021年
关键词
artificial intelligence; virtual reality; human-computer interaction; sonification; visualization;
D O I
10.1109/AIVR52153.2021.00057
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Artificial Intelligence (AI), especially Neural Networks (NNs), has become increasingly popular. However, people usually treat AI as a tool, focusing on improving outcome, accuracy, and performance while paying less attention to the representation of AI itself. We present Alive, an interactive visualization of AI in Virtual Reality (VR) that brings AI "alive". Alive enables users to manipulate the parameters of NNs with virtual hands and provides auditory feedback for the real-time values of loss, accuracy, and hyperparameters. Thus, Alive contributes an artistic and intuitive way to represent AI by integrating visualization, sonification, and direct manipulation in VR, potentially targeting a wide range of audiences.
引用
收藏
页码:251 / 255
页数:5
相关论文
共 50 条
  • [31] Evaluating geometrical properties of virtual shapes using interactive sonification
    Alonso, Miguel
    Shelley, Simon
    Hermes, Dik
    Kohlrausch, Armin
    2008 IEEE INTERNATIONAL WORKSHOP ON HAPTIC AUDIO VISUAL ENVIRONMENTS AND THEIR APPLICATIONS, 2008, : 154 - +
  • [32] Dynamic Virtual Proteins: Visualization, Interaction and Collaboration in Virtual Reality
    Gauthier, Jean-Marc
    Patel, Jagdish Suresh
    McGrath, Ian
    25TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY (VRST 2019), 2019,
  • [33] Virtual reality visualization of geophysical flows: A framework
    Alene, Gebray H.
    Irshad, Shafaq
    Moraru, Adina
    Depina, Ivan
    Bruland, Oddbjrn
    Perkis, Andrew
    Thakur, Vikas
    ENVIRONMENTAL MODELLING & SOFTWARE, 2024, 177
  • [34] Visualization of sorting algorithms in the virtual reality environment
    Mukasheva, Manargul
    Kalkabayeva, Zukhra
    Pussyrmanov, Nurbek
    FRONTIERS IN EDUCATION, 2023, 8
  • [35] VSEPR Theory, An Interactive and Immersive Virtual Reality
    Fujiwara, Danica
    Kellar, Kevin
    Humer, Irene
    Pietroszek, Krzysztof
    Eckhardt, Christian
    PROCEEDINGS OF 2020 6TH INTERNATIONAL CONFERENCE OF THE IMMERSIVE LEARNING RESEARCH NETWORK (ILRN 2020), 2020, : 140 - 146
  • [36] Affective Visualization in Virtual Reality: An Integrative Review
    Pinilla, Andres
    Garcia, Jaime
    Raffe, William
    Voigt-Antons, Jan-Niklas
    Spang, Robert P.
    Moeller, Sebastian
    FRONTIERS IN VIRTUAL REALITY, 2021, 2
  • [37] Virtual Reality: Beyond Visualization
    El Beheiry, Mohamed
    Doutreligne, Sebastien
    Caporal, Clement
    Ostertag, Cecilia
    Dahan, Maxime
    Masson, Jean-Baptiste
    JOURNAL OF MOLECULAR BIOLOGY, 2019, 431 (07) : 1315 - 1321
  • [38] Artificial Neural Networks to Assess Virtual Reality Anterior Cervical Discectomy Performance
    Mirchi, Nykan
    Bissonnette, Vincent
    Ledwos, Nicole
    Winkler-Schwartz, Alexander
    Yilmaz, Recai
    Karlik, Bekir
    Del Maestro, Rolando F.
    OPERATIVE NEUROSURGERY, 2020, 19 (01) : 65 - 75
  • [39] Virtual reality for 3D histology: multi-scale visualization of organs with interactive feature exploration
    Kaisa Liimatainen
    Leena Latonen
    Masi Valkonen
    Kimmo Kartasalo
    Pekka Ruusuvuori
    BMC Cancer, 21
  • [40] Virtual reality for 3D histology: multi-scale visualization of organs with interactive feature exploration
    Liimatainen, Kaisa
    Latonen, Leena
    Valkonen, Masi
    Kartasalo, Kimmo
    Ruusuvuori, Pekka
    BMC CANCER, 2021, 21 (01)