An embodied music cognition approach to multilevel interactive sonification

被引:0
作者
Nuno Diniz
Pieter Coussement
Alexander Deweppe
Michiel Demey
Marc Leman
机构
[1] Ghent University,Institute of Psychoacoustics and Electronic Music
来源
Journal on Multimodal User Interfaces | 2012年 / 5卷
关键词
Interaction; Sonification; Embodiment; Electroacoustic; Framework;
D O I
暂无
中图分类号
学科分类号
摘要
In this paper, a new conceptual framework and related implementation for interactive sonification is introduced. The conceptual framework consists of a combination of three components, namely, gestalt-based electroacoustic composition techniques (sound), user and body-centered spatial exploration (body), and corporeal mediation technology (tools), which are brought together within an existing paradigm of embodied music cognition. The implementation of the conceptual framework is based on an iterative process that involves the development of several use cases. Through this methodology, it is possible to investigate new approaches for structuring and to interactively explore multivariable data through sound.
引用
收藏
页码:211 / 219
页数:8
相关论文
共 50 条
  • [31] Data-to-music sonification and user engagement
    Middleton, Jonathan
    Hakulinen, Jaakko
    Tiitinen, Katariina
    Hella, Juho
    Keskinen, Tuuli
    Huuskonen, Pertti
    Culver, Jeffrey
    Linna, Juhani
    Turunen, Markku
    Ziat, Mounia
    Raisamo, Roope
    FRONTIERS IN BIG DATA, 2023, 6
  • [32] Interactive sonification of expressive hand gestures on a handheld device
    Fabiani, Marco
    Bresin, Roberto
    Dubus, Gael
    JOURNAL ON MULTIMODAL USER INTERFACES, 2012, 6 (1-2) : 49 - 57
  • [33] Interactive Web-based Image Sonification for the Blind
    Woertwein, Torsten
    Schauerte, Boris
    Mueller, Karin E.
    Stiefelhagen, Rainer
    ICMI'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2015, : 375 - 376
  • [34] Learning in embodied activity framework: a sociocultural framework for embodied cognition
    Danish, Joshua A.
    Enyedy, Noel
    Saleh, Asmalina
    Humburg, Megan
    INTERNATIONAL JOURNAL OF COMPUTER-SUPPORTED COLLABORATIVE LEARNING, 2020, 15 (01) : 49 - 87
  • [35] Learning in embodied activity framework: a sociocultural framework for embodied cognition
    Joshua A. Danish
    Noel Enyedy
    Asmalina Saleh
    Megan Humburg
    International Journal of Computer-Supported Collaborative Learning, 2020, 15 : 49 - 87
  • [36] Exploration and evaluation of a system for interactive sonification of elite rowing
    Dubus G.
    Bresin R.
    Sports Engineering, 2015, 18 (1) : 29 - 41
  • [37] Curve Shape and Curvature Perception Through Interactive Sonification
    Alonso-Arevalo, Miguel A.
    Shelley, Simon
    Hermes, Dik
    Hollowood, Jacqueline
    Pettitt, Michael
    Sharples, Sarah
    Kohlrausch, Armin
    ACM TRANSACTIONS ON APPLIED PERCEPTION, 2012, 9 (04)
  • [38] Interactive sonification of expressive hand gestures on a handheld device
    Marco Fabiani
    Roberto Bresin
    Gaël Dubus
    Journal on Multimodal User Interfaces, 2012, 6 : 49 - 57
  • [39] Optimizing Performative Skills in Social Interaction: Insights From Embodied Cognition, Music Education, and Sport Psychology
    Schiavio, Andrea
    Gesbert, Vincent
    Reybrouck, Mark
    Hauw, Denis
    Parncutt, Richard
    FRONTIERS IN PSYCHOLOGY, 2019, 10
  • [40] Conveying climate data through immersive sonification and interactive plant art in Unnatural Nature
    Zelada E.
    Çamcı A.
    Personal and Ubiquitous Computing, 2024, 28 (05) : 745 - 761