Dance to the beat: Synchronizing motion to audio

被引：10

作者：

Bellini R. ^{[1
]}

Kleiman Y. ^{[1
]}

Cohen-Or D. ^{[1
]}

机构：

[1] Tel Aviv University, Tel Aviv

来源：

Computational Visual Media | 2018年 / 4卷 / 3期

基金：

加拿大自然科学与工程研究理事会;

关键词：

motion segmentation; synchronization; video analysis; video processing;

D O I：

10.1007/s41095-018-0115-y

中图分类号：

学科分类号：

摘要：

In this paper we introduce a video post-processing method that enhances the rhythm of a dancing performance, in the sense that the dancing movements are more in time to the beat of the music. The dancing performance as observed in a video is analyzed and segmented into motion intervals delimited by motion beats. We present an image-space method to extract the motion beats of a video by detecting frames at which there is a significant change in direction or motion stops. The motion beats are then synchronized with the music beats such that as many beats as possible are matched with as little as possible time-warping distortion to the video. We show two applications for this cross-media synchronization: one where a given dance performance is enhanced to be better synchronized with its original music, and one where a given dance video is automatically adapted to be synchronized with different music. © 2018, The Author(s).

引用

页码：197 / 208

页数：11

共 25 条

[1]

Repp B.H., Musical synchronization, Music, Motor Control and the Brain, pp. 55-76, (2006)

[2]

Kim T.-H., Park S.I., Shin S.Y., Rhythmicmotion synthesis based on motion-beat analysis, ACM Transactions on Graphics, 22, 3, pp. 392-401, (2003)

[3]

Shiratori T., Nakazawa A., Ikeuchi K., Dancing-tomusic character animation, Computer Graphics Forum, 25, 3, pp. 449-458, (2006)

[4]

Chu W.-T., Tsai S.-Y., Rhythm of motion extraction and rhythm-based cross-media alignment for dance videos, IEEE Transactions on Multimedia, 14, 1, pp. 129-141, (2012)

[5]

Flash T., Hogan N., The coordination of arm movements: An experimentally confirmed mathematical model, Journal of Neuroscience, 5, 7, pp. 1688-1703, (1985)

[6]

Jones M.R., Boltz M., Dynamic attending and responses to time, Psychological Review, 96, 3, pp. 459-491, (1989)

[7]

Leyvand T., Cohen-Or D., Dror G., Lischinski D., Digital face beautification, Proceedings of the ACM SIGGRAPH 2006 Sketches, Article, (2006)

[8]

ACM Transactions on Graphics, 29, 4, (2010)

[9]

Zhou F., Torre F., Canonical time warping for alignment of human behavior, Proceedings of the Advances in Neural Information Processing Systems, pp. 2286-2294, (2009)

[10]

Zhou F., De la Torre F., Generalized time warping for multi-modal alignment of human motion, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1282-1289, (2012)

← 1 2 3 →