Choreographic Pose Identification using Convolutional Neural Networks

被引:6
作者
Bakalos, Nikolaos [1 ]
Rallis, Ioannis [1 ]
Doulamis, Nikolaos [1 ]
Doulamis, Anastasios [1 ]
Protopapadakis, Eftychios [1 ]
Voulodimos, Athanasios [2 ]
机构
[1] Natl Tech Univ Athens, Athens, Greece
[2] Univ West Attica, Athens, Greece
来源
2019 11TH INTERNATIONAL CONFERENCE ON VIRTUAL WORLDS AND GAMES FOR SERIOUS APPLICATIONS (VS-GAMES) | 2019年
关键词
Convolutional Neural Networks; Posture Identification; Intangible Cultural Heritage; AI for Serious Games;
D O I
10.1109/vs-games.2019.8864522
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this paper we present a deep learning scheme for classification of dance postures using Kinect II RGB data and Convolutional Neural Networks (CNN). This is achieved through the analysis of a data-set that includes three traditional Greek dances, where each dance was performed by 3 different dancers. The obtained data were processed and analyzed using a deep convolutional neural network, in order to identify the primitive postures that comprise the choreography. To enhance the classification performance, a background subtraction framework was utilized, while the CNN architecture was adapted to simulate a moving average behavior. The overall system can be used as an AI module for assessing the performance of users in a serious game for learning traditional dance choreographies
引用
收藏
页码:95 / 101
页数:7
相关论文
共 26 条
[1]   A deep convolutional neural network for video sequence background subtraction [J].
Babaee, Mohammadreza ;
Duc Tung Dinh ;
Rigoll, Gerhard .
PATTERN RECOGNITION, 2018, 76 :635-649
[2]   Human activity recognition using multidimensional indexing [J].
Ben-Arie, J ;
Wang, ZQ ;
Pandit, P ;
Rajaram, S .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (08) :1091-1104
[3]  
Blake J, 2018, SANTANDER ART CULTUR, V2017, P41
[4]   P-CNN: Pose-based CNN Features for Action Recognition [J].
Cheron, Guilhem ;
Laptev, Ivan ;
Schmid, Cordelia .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :3218-3226
[5]   Video-Based Emotion Recognition using CNN-RNN and C3D Hybrid Networks [J].
Fan, Yin ;
Lu, Xiangju ;
Li, Dian ;
Liu, Yuanliu .
ICMI'16: PROCEEDINGS OF THE 18TH ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2016, :445-450
[6]  
Gan C, 2015, PROC CVPR IEEE, P2568, DOI 10.1109/CVPR.2015.7298872
[7]   Hollywood 3D: Recognizing Actions in 3D Natural Scenes [J].
Hadfield, Simon ;
Bowden, Richard .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3398-3405
[8]  
He F, 2019, 2018 6 INT ED EC SOC
[9]  
Heng Wang, 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P3169, DOI 10.1109/CVPR.2011.5995407
[10]  
Jin H., 2018, CoRR