A Super-Bagging Method for Volleyball Action Recognition Using Wearable Sensors

被引:16
作者
Haider, Fasih [1 ]
Salim, Fahim A. [2 ]
Postma, Dees B. W. [3 ]
van Delden, Robby [3 ]
Reidsma, Dennis [3 ]
van Beijnum, Bert-Jan [2 ]
Luz, Saturnino [1 ]
机构
[1] Univ Edinburgh, Edinburgh Med Sch, Usher Inst, Edinburgh EH16 4UX, Midlothian, Scotland
[2] Univ Twente, Biomed Signals & Syst, NL-7500 AE Enschede, Netherlands
[3] Univ Twente, Human Media Interact, NL-7500 AE Enschede, Netherlands
基金
欧盟地平线“2020”;
关键词
sensor fusion; behavior analysis; social signal processing; machine learning; bagging; boosting; action recognition; wearable technologies; multimodal systems; SYSTEM;
D O I
10.3390/mti4020033
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Access to performance data during matches and training sessions is important for coaches and players. Although there are many video tagging systems available which can provide such access, these systems require manual effort. Data from Inertial Measurement Units (IMU) could be used for automatically tagging video recordings in terms of players' actions. However, the data gathered during volleyball sessions are generally very imbalanced, since for an individual player most time intervals can be classified as "non-actions" rather than "actions". This makes automatic annotation of video recordings of volleyball matches a challenging machine-learning problem. To address this problem, we evaluated balanced and imbalanced learning methods with our newly proposed `super-bagging' method for volleyball action modelling. All methods are evaluated using six classifiers and four sensors (i.e., accelerometer, magnetometer, gyroscope and barometer). We demonstrate that imbalanced learning provides better unweighted average recall, (UAR = 83.99%) for the non-dominant hand using a naive Bayes classifier than balanced learning, while balanced learning provides better performance (UAR = 84.18%) for the dominant hand using a tree bagger classifier than imbalanced learning. Our super-bagging method provides the best UAR (84.19%). It is also noted that the super-bagging method provides better averaged UAR than balanced and imbalanced methods in 8 out of 10 cases, hence demonstrating the potential of the super-bagging method for IMU's sensor data. One of the potential applications of these novel models is fatigue and stamina estimation e.g., by keeping track of how many actions a player is performing and when these are being performed.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 42 条
  • [1] [Anonymous], 2015, P KDD WORKSH LARG SC
  • [2] Social Scene Understanding: End-to-End Multi-Person Action Localization and Collective Activity Recognition
    Bagautdinov, Timur
    Alahi, Alexandre
    Fleuret, Francois
    Fua, Pascal
    Savarese, Silvio
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3425 - 3434
  • [3] Bellusci G., 2018, Xsens Technol, V1, P1, DOI [10.13140/RG.2.2.23576.49929, DOI 10.13140/RG.2.2.23576.49929]
  • [4] Bagging predictors
    Breiman, L
    [J]. MACHINE LEARNING, 1996, 24 (02) : 123 - 140
  • [5] Wearability Assessment of a Wearable System for Parkinson's Disease Remote Monitoring Based on a Body Area Network of Sensors
    Cancela, Jorge
    Pastorino, Matteo
    Tzallas, Alexandros T.
    Tsipouras, Markos G.
    Rigas, Giorgios
    Arredondo, Maria T.
    Fotiadis, Dimitrios I.
    [J]. SENSORS, 2014, 14 (09): : 17235 - 17255
  • [6] SMOTE: Synthetic minority over-sampling technique
    Chawla, Nitesh V.
    Bowyer, Kevin W.
    Hall, Lawrence O.
    Kegelmeyer, W. Philip
    [J]. 2002, American Association for Artificial Intelligence (16)
  • [7] Beach Volleyball serve type recognition
    Cuspinera, L. Ponce
    Uetsuji, Sakura
    Morales, F. J. Ordonez
    Roggen, Daniel
    [J]. ISWC'16 - PROCEEDINGS OF THE 2016 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2016, : 44 - 45
  • [8] Freund Y., 1996, Machine Learning. Proceedings of the Thirteenth International Conference (ICML '96), P148
  • [9] Surrounding neighborhood-based SMOTE for learning from imbalanced data sets
    García, V.
    Sánchez, J.S.
    Martín-Félez, R.
    Mollineda, R.A.
    [J]. Progress in Artificial Intelligence, 2012, 1 (04) : 347 - 362
  • [10] Evaluation of Dominant and Non-Dominant Hand Movements For Volleyball Action Modelling
    Haider, Fasih
    Salim, Fahim A.
    Tasdemir, Sena Busra Yengec
    Naghashi, Vahid
    Tengiz, Izem
    Cengiz, Kubra
    Postma, Dees B. W.
    van Delden, Robby
    Reidsma, Dennis
    van Beijnum, Bert-Jan
    Luz, Saturnino
    [J]. ICMI'19: ADJUNCT OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019,