Human Pose Estimation and Object Interaction for Sports Behaviour

被引:5
作者
Arif, Ayesha [1 ]
Ghadi, Yazeed Yasin [2 ]
Alarfaj, Mohammed [3 ]
Jalal, Ahmad [1 ]
Kamal, Shaharyar [1 ]
Kim, Dong-Seong [4 ]
机构
[1] Air Univ, Dept Comp Sci, Islamabad 44000, Pakistan
[2] Al Ain Univ, Dept Comp Sci & Software Engn, Al Ain 15551, U Arab Emirates
[3] King Faisal Univ, Coll Engn, Dept Elect Engn, Al Hasa, Saudi Arabia
[4] Kumoh Natl Inst Technol, Dept IT Convergence Engn, Gumi, South Korea
来源
CMC-COMPUTERS MATERIALS & CONTINUA | 2022年 / 72卷 / 01期
关键词
Human object interaction; human pose estimation; object detection; sports estimation; sports prediction; FEATURES; MODEL;
D O I
10.32604/cmc.2022.023553
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the new era of technology, daily human activities are becoming more challenging in terms of monitoring complex scenes and backgrounds. To understand the scenes and activities from human life logs, human-object interaction (HOI) is important in terms of visual relationship detection and human pose estimation. Activities understanding and interaction recognition between human and object along with the pose estimation and interaction modeling have been explained. Some existing algorithms and feature extraction procedures are complicated including accurate detection of rare human postures, occluded regions, and unsatisfactory detection of objects, especially small-sized objects. The existing HOI detection techniques are instance centric (object-based) where interaction is predicted between all the pairs. Such estimation depends on appearance features and spatial information. Therefore, we propose a novel approach to demonstrate that the appearance features alone are not sufficient to predict the HOI. Furthermore, we detect the human body parts by using the Gaussian Matric Model (GMM) followed by object detection using YOLO. We predict the interaction points which directly classify the interaction and pair them with densely predicted HOI vectors by using the interaction algorithm. The interactions are linked with the human and object to predict the actions. The experiments have been performed on two benchmark HOI datasets demonstrating the proposed approach.
引用
收藏
页码:1 / 18
页数:18
相关论文
共 24 条
  • [1] Pose Estimation and Detection for Event Recognition using Sense-Aware Features and Adaboost Classifier
    Akhter, Israr
    Jalal, Ahmad
    Kim, Kibum
    [J]. PROCEEDINGS OF 2021 INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGIES (IBCAST), 2021, : 500 - 505
  • [2] [Anonymous], 2015, 2015 International Conference on Informatics, Electronics Vision (ICIEV), Pages
  • [3] Automated Body Parts Estimation and Detection using Salient Maps and Gaussian Matrix Model
    Arif, Ayesha
    Jalal, Ahmad
    [J]. PROCEEDINGS OF 2021 INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGIES (IBCAST), 2021, : 667 - 672
  • [4] An adaptable system for RGB-D based human body detection and pose. estimation
    Buys, Koen
    Cagniart, Cedric
    Baksheev, Anatoly
    De Laet, Tinne
    De Schutter, Joris
    Pantofaru, Caroline
    [J]. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2014, 25 (01) : 39 - 52
  • [5] Stochastic Remote Sensing Event Classification over Adaptive Posture Estimation via Multifused Data and Deep Belief Network
    Gochoo, Munkhjargal
    Akhter, Israr
    Jalal, Ahmad
    Kim, Kibum
    [J]. REMOTE SENSING, 2021, 13 (05) : 1 - 29
  • [6] Indoor Scene Understanding with RGB-D Images: Bottom-up Segmentation, Object Detection and Semantic Segmentation
    Gupta, Saurabh
    Arbelaez, Pablo
    Girshick, Ross
    Malik, Jitendra
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 112 (02) : 133 - 149
  • [7] Depth edge detection by image-based smoothing and morphological operations
    Hasan, Syed Mohammad Abid
    Ko, Kwanghee
    [J]. JOURNAL OF COMPUTATIONAL DESIGN AND ENGINEERING, 2016, 3 (03) : 191 - 197
  • [8] Recognising Human-Object Interaction via Exemplar based Modelling
    Hu, Jian-Fang
    Zheng, Wei-Shi
    Lai, Jianhuang
    Gong, Shaogang
    Xiang, Tao
    [J]. 2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 3144 - 3151
  • [9] A Wrist Worn Acceleration Based Human Motion Analysis and Classification for Ambient Smart Home System
    Jala, Ahmad
    Quaid, Majid Ali Khan
    Kim, Kibum
    [J]. JOURNAL OF ELECTRICAL ENGINEERING & TECHNOLOGY, 2019, 14 (04) : 1733 - 1739
  • [10] Markerless Sensors for Physical Health Monitoring System Using ECG and GMM Feature Extraction
    Jalal, Ahmad
    Batool, Mouazma
    Tahir, Sheikh Badar Ud Din
    [J]. PROCEEDINGS OF 2021 INTERNATIONAL BHURBAN CONFERENCE ON APPLIED SCIENCES AND TECHNOLOGIES (IBCAST), 2021, : 340 - 345