Extraction of key postures from 3D human motion data for choreography summarization

被引:0
作者
Rallis, Ioannis [1 ]
Georgoulas, Ioannis [1 ]
Doulamis, Nikolaos [1 ]
Voulodimos, Athanasios [1 ]
Terzopoulos, Panagiotis [2 ]
机构
[1] Natl Tech Univ Athens, Athens, Greece
[2] Metis Balt, Vilnius, Lithuania
来源
2017 9TH INTERNATIONAL CONFERENCE ON VIRTUAL WORLDS AND GAMES FOR SERIOUS APPLICATIONS (VS-GAMES) | 2017年
关键词
motion capturing; choreogrpahy summarization; clustering; k-means; key posture extraction; CAPTURE;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modelling and digitizing performing arts through motion capturing interfaces is an important aspect for the analysis, processing and documentation of intangible cultural heritage assets. However, existing modelling approaches may involve huge amounts of information which are difficult to process, store and analyze. To address these limitations, usually a skeleton describing the dancer motion is extracted. However, often the complexity still remains due to the high spatio-temporal dependencies of the detected skeleton joints. In this paper, an alternative approach is presented: choreography summarization. This means that a very small number of image frames are extracted to represent a choreography, thus significantly reducing the processing and storage complexity. In our approach the problem of choreography summarization is treated as an unsupervised clustering approach. Evaluation indices are introduced for monitoring the summarization performance. Experimental results on real-life dancing performances verifies the capability of the proposed method to capture the main patterns of a choreography with a very small number of trajectory points.
引用
收藏
页码:94 / 101
页数:8
相关论文
共 50 条
[11]   3D Human motion tracking by exemplar-based conditional particle filter [J].
Liu, Jigang ;
Liu, Dongquan ;
Dauwels, Justin ;
Seah, Hock Soon .
SIGNAL PROCESSING, 2015, 110 :164-177
[12]   Generative tracking of 3D human motion in latent space by sequential clonal selection algorithm [J].
Li, Yi ;
Sun, Zhengxing .
MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 69 (01) :79-109
[13]   Action-specific motion prior for efficient Bayesian 3D human body tracking [J].
Rius, Ignasi ;
Gonzalez, Jordi ;
Varona, Javier ;
Xavier Roca, F. .
PATTERN RECOGNITION, 2009, 42 (11) :2907-2921
[14]   Monocular 3D Human Motion Analysis Using Quantum-Behaved Clonal Algorithm [J].
Yu, Jialin ;
Sun, Jifeng ;
Liu, Shengqing ;
Luo, Shasha ;
Ou, Hongshi .
2017 IEEE 9TH INTERNATIONAL CONFERENCE ON COMMUNICATION SOFTWARE AND NETWORKS (ICCSN), 2017, :1261-1265
[15]   Parsing 3D motion trajectory for gesture recognition [J].
Yang, Jianyu ;
Yuan, Junsong ;
Li, Youfu .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2016, 38 :627-640
[16]   3D reconstruction of genomic regions from sparse interaction data [J].
Mendieta-Esteban, Julen ;
Di Stefano, Marco ;
Castillo, David ;
Farabella, Irene ;
Marti-Renom, Marc A. .
NAR GENOMICS AND BIOINFORMATICS, 2021, 3 (01)
[17]   Online Full Body Human Motion Tracking Based on Dense Volumetric 3D Reconstructions from Multi Camera Setups [J].
Feldmann, Tobias ;
Mihailidis, Ioannis ;
Schulz, Sebastian ;
Paulus, Dietrich ;
Woerner, Annika .
KI 2010: ADVANCES IN ARTIFICIAL INTELLIGENCE, 2010, 6359 :74-81
[18]   A Perceptual-Based Noise-Agnostic 3D Skeleton Motion Data Refinement Network [J].
Li, Shu-Jie ;
Zhu, Hai-Sheng ;
Zheng, Li-Ping ;
Li, Lin .
IEEE ACCESS, 2020, 8 :52927-52940
[19]   3D human gesture capturing and recognition by the IMMU-based data glove [J].
Fang, Bin ;
Sun, Fuchun ;
Liu, Huaping ;
Liu, Chunfang .
NEUROCOMPUTING, 2018, 277 :198-207
[20]   3D Human Motion Capturing Based Only on Acceleration and Angular Rate Measurement for Low Extremities [J].
Schiefer, Christoph ;
Kraus, Thomas ;
Ochsmann, Elke ;
Hermanns, Ingo ;
Ellegast, Rolf .
DIGITAL HUMAN MODELING, 2011, 6777 :195-203