Music similarity-based approach to generating dance motion sequence

被引：55

作者：

Lee, Minho ^{[1
]}

Lee, Kyogu ^{[1
]}

Park, Jaeheung ^{[1
]}

机构：

[1] Seoul Natl Univ, Adv Inst Convergence Technol, Grad Sch Convergence Sci & Technol, Seoul, South Korea

来源：

MULTIMEDIA TOOLS AND APPLICATIONS | 2013年 / 62卷 / 03期

关键词：

Choreography; Dance motion generation; Music similarity; Music-motion database; Motion capture; Motion synthesis;

D O I：

10.1007/s11042-012-1288-5

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

In this paper, we propose a novel approach to generating a sequence of dance motions using music similarity as a criterion to find the appropriate motions given a new musical input. Based on the observation that dance motions used in similar musical pieces can be a good reference in choreographing a new dance, we first construct a music-motion database that comprises a number of segment-wise music-motion pairs. When a new musical input is given, it is divided into short segments and for each segment our system suggests the dance motion candidates by finding from the database the music cluster that is most similar to the input. After a user selects the best motion segment, we perform music-dance synchronization by means of cross-correlation between the two music segments using the novelty functions as an input. We evaluate our system's performance using a user study, and the results show that the dance motion sequence generated by our system achieves significantly higher ratings than the one generated randomly.

引用

页码：895 / 912

页数：18

共 19 条

[1] Automated motion synthesis for dancing characters [J].

Alankus, G ;

Bayazit, AA ;

Bayazit, OB .

COMPUTER ANIMATION AND VIRTUAL WORLDS, 2005, 16 (3-4) :259-271

[2]

[Anonymous], 2006, NeurIPS

[3] To catch a chorus: Using chroma-based representations for audio thumbnailing [J].

Bartsch, MA ;

Wakefield, GH .

PROCEEDINGS OF THE 2001 IEEE WORKSHOP ON THE APPLICATIONS OF SIGNAL PROCESSING TO AUDIO AND ACOUSTICS, 2001, :15-18

[4]

Foote J, 2000, 2000 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, PROCEEDINGS VOLS I-III, P452, DOI 10.1109/ICME.2000.869637

[5] Visualizing music and audio using self-similarity [J].

Foote, J .

ACM MULTIMEDIA 99, PROCEEDINGS, 1999, :77-80

[6]

Gray JM, 1975, THESIS STANFORD U ST

[7]

Grunberg D., 2009, Proceedings of the 2009 International Conference on Hybrid Information Technology, P221

[8]

K-C Loi, 2009, P APSIPA ANN SUMM C, P216

[9]

Kang KK, 2007, LECT NOTES COMPUT SC, V4569, P216

[10] An efficient k-means clustering algorithm:: Analysis and implementation [J].

Kanungo, T ;

Mount, DM ;

Netanyahu, NS ;

Piatko, CD ;

Silverman, R ;

Wu, AY .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (07) :881-892

← 1 2 →