Data-to-music sonification and user engagement

被引：0

作者：

Middleton, Jonathan ^{[1
,2
]}

Hakulinen, Jaakko ^{[2
]}

Tiitinen, Katariina ^{[2
]}

Hella, Juho ^{[2
]}

Keskinen, Tuuli ^{[2
]}

Huuskonen, Pertti ^{[2
]}

Culver, Jeffrey ^{[3
]}

Linna, Juhani ^{[2
]}

Turunen, Markku ^{[2
]}

Ziat, Mounia ^{[4
]}

Raisamo, Roope ^{[2
]}

机构：

[1] Eastern Washington Univ, Dept Fine & Performing Arts, Cheney, WA 99004 USA

[2] Tampere Univ, Tampere Unit Comp Human Interact TAUCHI, Tampere, Finland

[3] Eastern Washington Univ, Sch Business, Spokane, WA USA

[4] Bentley Univ, Dept Informat Design & Corp Commun, Waltham, MA USA

来源：

FRONTIERS IN BIG DATA | 2023年 / 6卷

关键词：

data-to-music; sonification; user engagement; auditory display; algorithms;

D O I：

10.3389/fdata.2023.1206081

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

The process of transforming data into sounds for auditory display provides unique user experiences and new perspectives for analyzing and interpreting data. A research study for data transformation to sounds based on musical elements, called data-to-music sonification, reveals how musical characteristics can serve analytical purposes with enhanced user engagement. An existing user engagement scale has been applied to measure engagement levels in three conditions within melodic, rhythmic, and chordal contexts. This article reports findings from a user engagement study with musical traits and states the benefits and challenges of using musical characteristics in sonifications. The results can guide the design of future sonifications of multivariable data.

引用

页数：13

共 29 条

[1] Aldwell Edward., 2003, Harmony and Voice Leading, Vthird
[2] [Anonymous], 2005, ACM Trans. Appl. Percept. (TAP), DOI DOI 10.1145/1101530.1101534
[3] Bearman N., 2012, P 18 INT C AUD DISPL
[4] What makes a rhythm complex? The influence of musical training and accent type on beat perception
Bouwer, Fleur L.
Burgoyne, J. Ashley
Odijk, Daan
Honing, Henkjan
Grahn, Jessica A.
[J]. PLOS ONE, 2018, 13 (01):
[5] Brewster S, 2009, HUM FACTORS ERGON, P223
[6] Brown L. M., 2003, P 9 INT C AUDITORY D
[7] Melody discrimination and protein fold classification
Bywater, Robert P.
Middleton, Jonathan N.
[J]. HELIYON, 2016, 2 (10):
[8] The formation of rhythmic categories and metric priming
Desain, P
Honing, H
[J]. PERCEPTION, 2003, 32 (03) : 341 - 365
[9] Dillon A, 2006, ADV MANAG INFORM SYS, V5, P21
[10] Hermann T., 2011, SONIFICATION HDB

← 1 2 3 →