Smartphone Drum: Gesture-based Digital Musical Instruments Application for Deaf and Hard of Hearing People

被引:1
作者
Iijima, Ryo [1 ]
Shitara, Akihisa [1 ]
Sarcar, Sayan [1 ,2 ]
Ochiai, Yoichi [1 ]
机构
[1] Univ Tsukuba, Tsukuba, Japan
[2] Birmingham City Univ, Birmingham, W Midlands, England
来源
PROCEEDINGS OF THE 2021 ACM SYMPOSIUM ON SPATIAL USER INTERACTION, SUI 2021 | 2021年
关键词
Music; Game; User study; Deaf; Hard of hearing;
D O I
10.1145/3485279.3488285
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Smartphone applications that allow users to enjoy playing musical instruments have emerged, opening up numerous related opportunities. However, it is difficult for deaf and hard of hearing (DHH) people to use these apps because of limited access to auditory information. When using real instruments, DHH people typically feel the music from the vibrations transmitted by the instruments or the movements of the body, which is not possible when playing with these apps. We introduce "smartphone drum," a smartphone application that presents a drum-like vibrotactile sensation when the user makes a drumming motion in the air with their smartphone like a drumstick. We implemented an early prototype and received feedback from six DHH participants. We discuss the technical implementation and the future of new instruments of vibration.
引用
收藏
页数:2
相关论文
共 3 条
[1]  
Cappelen B, 2012, LECT NOTES COMPUT SC, V7382, P254, DOI 10.1007/978-3-642-31522-0_38
[2]  
Hiraga Rumi, 2006, P 8 INT ACM SIGACCES, P141, DOI [10.1145/1168987.1169012, DOI 10.1145/1168987.1169012]
[3]   Inclusive improvisation through sound and movement mapping: from DMI to ADMI [J].
Ilsar, Alon ;
Kenning, Gail .
22ND INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY (ASSETS '20), 2020,