View-invariant representation and learning of human action

被引:6
|
作者
Rao, C [1 ]
Shah, M [1 ]
机构
[1] Univ Cent Florida, Sch Elect Engn & Comp Sci, Comp Vis Lab, Orlando, FL 32816 USA
来源
IEEE WORKSHOP ON DETECTION AND RECOGNITION OF EVENTS IN VIDEO, PROCEEDINGS | 2001年
关键词
video understanding; action recognition; view-invariant representation; spatiotemporal curvature; events; activities;
D O I
10.1109/EVENT.2001.938867
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Automatically understanding human actions from video sequences is a very challenging problem. This involves the extraction of relevant visual information front a video sequence, representation of that information in a suitable form, and interpretation of visual information for the purpose of recognition and learning. In this paper, we first present a view-invariant representation of action consisting of dynamic instants and intervals, which is computed using spatiotemporal curvature of a trajectory. This representation is then used by, our system to learn human actions without any, training. The system automatically segments video into individual actions, and computes view invariant representation for each action. The system is able to incrementally learn different actions starting with no model. It is able to discover different instances of the same action Performed by different people, and in different viewpoints. In order to validate our approach, we present results on video clips in which roughly, 50 actions were performed by five different people in different viewpoints. Our system performed impressively by correctly, interpreting most actions.
引用
收藏
页码:55 / 63
页数:9
相关论文
共 50 条
  • [1] View-Invariant Skeleton Action Representation Learning via Motion Retargeting
    Yang, Di
    Wang, Yaohui
    Dantcheva, Antitza
    Garattoni, Lorenzo
    Francesca, Gianpiero
    Bremond, Francois
    INTERNATIONAL JOURNAL OF COMPUTER VISION, 2024, 132 (07) : 2351 - 2366
  • [2] Development of a view-invariant representation of the human head
    Gliga, Teodora
    Dehaene-Lambertz, Ghislaine
    COGNITION, 2007, 102 (02) : 261 - 288
  • [3] Unsupervised Learning of View-invariant Action Representations
    Li, Junnan
    Wong, Yongkang
    Zhao, Qi
    Kankanhalli, Mohan S.
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018), 2018, 31
  • [4] DISCRIMINANT ACTION REPRESENTATION FOR VIEW-INVARIANT PERSON IDENTIFICATION
    Iosifidis, Alexandros
    Tefas, Anastasios
    Pitas, Ioannis
    2012 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2012), 2012, : 1177 - 1180
  • [5] Learning Human Identity Using View-Invariant Multi-view Movement Representation
    Iosifidis, Alexandros
    Tefas, Anastasios
    Nikolaidis, Nikolaos
    Pitas, Ioannis
    BIOMETRICS AND ID MANAGEMENT, 2011, 6583 : 217 - 226
  • [6] Latent Multitask Learning for View-Invariant Action Recognition
    Mahasseni, Behrooz
    Todorovic, Sinisa
    2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2013, : 3128 - 3135
  • [7] View-Invariant Robot Adaptation to Human Action Timing
    Noceti, Nicoletta
    Odone, Francesca
    Rea, Francesco
    Sciutti, Alessandra
    Sandini, Giulio
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2019, 868 : 804 - 821
  • [8] Towards Fast, View-Invariant Human Action Recognition
    Cherla, Srikanth
    Kulkarni, Kaustubh
    Kale, Amit
    Ramasubramanian, V.
    2008 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, VOLS 1-3, 2008, : 1650 - 1657
  • [9] View-Invariant Representation and Recognition of Actions
    Cen Rao
    Alper Yilmaz
    Mubarak Shah
    International Journal of Computer Vision, 2002, 50 : 203 - 226
  • [10] A survey about view-invariant human action recognition
    Nghia Pham Trong
    Anh Truong Minh
    Nguyen, Hung
    Kazunori, Kotani
    Bac Le Hoai
    2017 56TH ANNUAL CONFERENCE OF THE SOCIETY OF INSTRUMENT AND CONTROL ENGINEERS OF JAPAN (SICE), 2017, : 699 - 704