Interactive Tangible User Interface for Music Learning

被引：0

作者：

Waranusast, Rattapoom ^{[1
]}

Bang-ngoen, Arin ^{[1
]}

Thipakorn, Jeerapa ^{[1
]}

机构：

[1] Naresuan Univ, Fac Engn, Dept Elect & Comp Engn, Mueang 65000, Phitsanulok, Thailand

来源：

PROCEEDINGS OF 2013 28TH INTERNATIONAL CONFERENCE ON IMAGE AND VISION COMPUTING NEW ZEALAND (IVCNZ 2013) | 2013年

关键词：

augmented reality; human computer interaction; machine vision; musical instrument digital interfaces; object recognition;

D O I：

暂无

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

This paper introduced muSurface, an interactive surface with ability to interact with tangible musical symbols. Children can explore musical symbols by placing the symbols on the virtual musical staffs displayed on the playing surface, and then the system plays the resulting melody. The system senses musical symbols on the surface using the rear diffused illumination technique, and displays the processed output back via a projector and speakers. The main underlying techniques are image classification based on K-nearest neighbor classifier using 9 features derived from musical symbols. The distance transform also used to find locations of musical notes in order to determine the pitches of the notes.

引用

页码：400 / 405

页数：6

共 12 条

[1]

Alber N., 2010, HERIT MUS, V4, P36

[2]

[Anonymous], 2000, Opencv. Dr. Dobb's journal of software tools

[3]

Bang-ngoen A., P 2013 2 ICT INT STU, P141

[4]

Bischof M., 2008, P 2 INT C TANG EMB I, P121

[5] DISTANCE TRANSFORMATIONS IN DIGITAL IMAGES [J].

BORGEFORS, G .

COMPUTER VISION GRAPHICS AND IMAGE PROCESSING, 1986, 34 (03) :344-371

[6]

Costanza E., 2003, P 6 INT C DIG AUD EF

[7]

Costanza E., 2003, P C HUMANCOMPUTER IN

[8]

Han J.Y., 2005, Proceedings of the ACM Symposium on User Interface Software and Technology, P115, DOI DOI 10.1145/1095034.1095054

[9]

Jain A., 1986, FUNDAMENTALS DIGITAL

[10]

Jorda Sergi., 2010, CHI 2010: Media Showcase Session 1, P2989, DOI DOI 10.1145/1753846.1753903

← 1 2 →