Immersive audio programming in a virtual reality sandbox

被引:0
作者
Andersson, Nikolaj [1 ]
Erkut, Cumhur [1 ]
Serafin, Stefania [1 ]
机构
[1] Aalborg Univ, Dept Architecture Design & Media Technol, Multisensory Experience Lab, Copenhagen, Denmark
来源
2019 AES INTERNATIONAL CONFERENCE ON IMMERSIVE AND INTERACTIVE AUDIO | 2019年
关键词
OF-THE-ART;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Immersive sandboxes for audio-visual content creation in Virtual Reality (VR) are becoming widely available, thanks to the VR distribution platforms, such as the Steam VR. Some of these sandboxes are specially build to host Virtual Reality Musical Instruments (VRMIs), but they usually contain only basic components, such as oscillators, sample-based instruments, or simplistic step-sequencers. In this paper, after describing MuX (a VRMI-hosting sandbox) and its basic components, we present new elements developed for the environment. We focus on the lumped and distributed physically-inspired models for sound synthesis. A simple interface was developed to control the physical models with gestures, expanding the interaction possibilities within the sandbox. A preliminary evaluation shows that, as the number and complexity of the components increase, it becomes important to provide to the users ready-made machines instead of allowing them to build everything from scratch.
引用
收藏
页数:9
相关论文
共 33 条
[21]   Illusion-enhanced Virtual Reality Exercise for Neck Pain A Replicated Single Case Series [J].
Harvie, Daniel S. ;
Smith, Ross T. ;
Moseley, G. Lorimer ;
Meulders, Ann ;
Michiels, Bart ;
Sterling, Michele .
CLINICAL JOURNAL OF PAIN, 2020, 36 (02) :101-109
[22]   Exploring Discussions About Virtual Reality on Twitter to Inform Brain Injury Rehabilitation: Content and Network Analysis [J].
Brassel, Sophie ;
Brunner, Melissa ;
Campbell, Andrew ;
Power, Emma ;
Togher, Leanne .
JOURNAL OF MEDICAL INTERNET RESEARCH, 2024, 26
[23]   Multisensor Information Fusion-Assisted Intelligent Art Design under Wireless Virtual Reality Environment [J].
Dong Wenhao .
JOURNAL OF SENSORS, 2021, 2021
[24]   Using Augmented and Virtual Reality (AR/VR) to Support Safe Navigation on Inland and Coastal Water Zones [J].
Templin, Tomasz ;
Popielarczyk, Dariusz ;
Gryszko, Marcin .
REMOTE SENSING, 2022, 14 (06)
[25]   Virtual reality as a tool for evaluating user acceptance of view clarity through ETFE double-skin facades [J].
Flor, Jan-F ;
Aburas, Marina ;
Abd-AlHamid, Fedaa ;
Wu, Yupeng .
ENERGY AND BUILDINGS, 2021, 231
[26]   Head-Mounted Display-Based Virtual Reality and Physiological Computing for Stroke Rehabilitation: A Systematic Review [J].
Gougeh, Reza Amini ;
Falk, Tiago H. .
FRONTIERS IN VIRTUAL REALITY, 2022, 3
[27]   Comparison of Conventional and Virtual Reality Box and Blocks Tests in Upper Limb Amputees: A Case-Control Study [J].
Hashim, Nur Afiqah ;
Abd Razak, Nasrul Anuar ;
Abu Osman, Noor Azuan .
IEEE ACCESS, 2021, 9 :76983-76990
[28]   Vox-Cells: Voxel-based visualization of volume data for enhanced understanding and exploration in Virtual Reality (VR) [J].
Hughes, Rowan T. ;
Strong, Campbell ;
McGhee, John .
SIGGRAPH '19 - ACM SIGGRAPH 2019 POSTERS, 2019,
[29]   2D, 2.5D, or 3D? An Exploratory Study on Multilayer Network Visualisations in Virtual Reality [J].
Feyer, Stefan P. ;
Pinaud, Bruno ;
Kobourov, Stephen ;
Brich, Nicolas ;
Krone, Michael ;
Kerren, Andreas ;
Behrisch, Michael ;
Schreiber, Falk ;
Klein, Karsten .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (01) :469-479
[30]   Keep the VRhythm going A musician-centred study investigating how Virtual Reality can support creative musical practice [J].
Ppali, Sophia ;
Lalioti, Vali ;
Branch, Boyd ;
Ang, Chee Siang ;
Thomas, Andrew J. ;
Wohl, Bea S. ;
Covaci, Alexandra .
PROCEEDINGS OF THE 2022 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI' 22), 2022,