Semantic human activity recognition: A literature review

被引:155
作者
Ziaeefard, Maryarn [1 ]
Bergevin, Robert [1 ]
机构
[1] Univ Laval, Dept Elect & Comp Engn, Comp Vis & Syst Lab, Quebec City, PQ G1V 0A6, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Human activity recognition; Pose; Poselet; Attribute; Human-object interaction; Scene; Survey; EVENT RECOGNITION; HUMAN MOVEMENT; OBJECT; BODY; REPRESENTATION; SELECTIVITY; TRACKING; MODEL;
D O I
10.1016/j.patcog.2015.03.006
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents an overview of state-of-the-art methods in activity recognition using semantic features. Unlike low-level features, semantic features describe inherent characteristics of activities. Therefore, semantics make the recognition task more reliable especially when the same actions look visually different due to the variety of action executions. We define a semantic space including the most popular semantic features of an action namely the human body (pose and poselet), attributes, related objects, and scene context. We present methods exploiting these semantic features to recognize activities from still images and video data as well as four groups of activities: atomic actions, people interactions, human-object interactions, and group activities. Furthermore, we provide potential applications of semantic approaches along with directions for future research. (C) 2015 Elsevier Ltd. All rights reserved.
引用
收藏
页码:2329 / 2345
页数:17
相关论文
共 50 条
  • [21] Semantic Representation and Recognition of Continued and Recursive Human Activities
    Ryoo, M. S.
    Aggarwal, J. K.
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 2009, 82 (01) : 1 - 24
  • [22] A fuzzy ontology for semantic modelling and recognition of human behaviour
    Diaz-Rodriguez, Natalia
    Cuellar, Manuel P.
    Lilius, Johan
    Calvo-Flores, Miguel Delgado
    [J]. KNOWLEDGE-BASED SYSTEMS, 2014, 66 : 46 - 60
  • [23] SemNet: Learning semantic attributes for human activity recognition with deep belief networks
    Venkatachalam, Shanmuga
    Nair, Harideep
    Zeng, Ming
    Tan, Cathy Shunwen
    Mengshoel, Ole J.
    Shen, John Paul
    [J]. FRONTIERS IN BIG DATA, 2022, 5
  • [24] LARa: Creating a Dataset for Human Activity Recognition in Logistics Using Semantic Attributes
    Niemann, Friedrich
    Reining, Christopher
    Rueda, Fernando Moya
    Nair, Nilah Ravi
    Steffens, Janine Anika
    Fink, Gernot A.
    ten Hompel, Michael
    [J]. SENSORS, 2020, 20 (15) : 1 - 42
  • [25] A Review on Video-Based Human Activity Recognition
    Ke, Shian-Ru
    Hoang Le Uyen Thuc
    Lee, Yong-Jin
    Hwang, Jenq-Neng
    Yoo, Jang-Hee
    Choi, Kyoung-Ho
    [J]. COMPUTERS, 2013, 2 (02) : 88 - 131
  • [26] Pose-based Human Activity Recognition: a review
    Boualia, Sameh Neili
    Ben Amara, Najoua Essoukri
    [J]. 2019 15TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2019, : 1468 - 1475
  • [27] Robot Semantic Mapping through Wearable Sensor-based Human Activity Recognition
    Li, Gang
    Zhu, Chun
    Du, Jianhao
    Cheng, Qi
    Sheng, Weihua
    Chen, Heping
    [J]. 2012 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2012, : 5228 - 5233
  • [28] Robot semantic mapping through human activity recognition: A wearable sensing and computing approach
    Sheng, Weihua
    Du, Jianhao
    Cheng, Qi
    Li, Gang
    Zhu, Chun
    Liu, Meiqin
    Xu, Guoqing
    [J]. ROBOTICS AND AUTONOMOUS SYSTEMS, 2015, 68 : 47 - 58
  • [29] Feature Analysis to Human Activity Recognition
    Suto, J.
    Oniga, S.
    Sitar, P. Pop
    [J]. INTERNATIONAL JOURNAL OF COMPUTERS COMMUNICATIONS & CONTROL, 2017, 12 (01) : 116 - 130
  • [30] Open Datasets in Human Activity Recognition ResearchuIssues and Challenges: A Review
    Alam, Gulzar
    McChesney, Ian
    Nicholl, Peter
    Rafferty, Joseph
    [J]. IEEE SENSORS JOURNAL, 2023, 23 (22) : 26952 - 26980