Real-Time Activity Recognition for Surveillance Applications on Edge Devices

被引:3
作者
Tsinikos, Vasileios [1 ]
Pastaltzidis, Ioannis [1 ]
Karakostas, Iason [1 ]
Dimitriou, Nikolaos [1 ]
Valakou, Katerina [2 ]
Margetis, George [2 ]
Stephanidis, Constantine [2 ,3 ]
Tzovaras, Dimitrios [1 ]
机构
[1] Ctr Res & Technol Hellas CERTH, Informat Technol Inst, Thessaloniki, Greece
[2] Fdn Res & Technol Hellas FORTH, Inst Comp Sci, Iraklion, Crete, Greece
[3] Univ Crete, Comp Sci Dept, Iraklion, Crete, Greece
来源
PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON PERVASIVE TECHNOLOGIES RELATED TO ASSISTIVE ENVIRONMENTS, PETRA 2023 | 2023年
关键词
activity recognition; posture recognition; edge computing; augmented reality;
D O I
10.1145/3594806.3594823
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Human Activity Recognition is a crucial task for surveillance systems that has seen great advancements with the emergence of Artificial Intelligence. At the same time, hardware advances have allowed for development of systems that operate in real-time. However real-time performance is still a far from solved problem for wearable devices when it comes to computer vision tasks such as activity recognition. In this paper a hybrid solution for Human Activity Recognition is proposed that exploits a lightweight method for on-device posture recognition and a more heavyweight activity recognition method executed on the cloud. The experimental evaluation for the activity recognition module indicates superior performance compared to existing methods and the lightweight posture method can predict satisfactorily the desired classes. The developed system offers a user-friendly Augmented Reality application that provides scene annotations to the user including the activity of the detected persons.
引用
收藏
页码:293 / 299
页数:7
相关论文
共 35 条
  • [1] Ali Heba Hamdy, 2018, Future Computing and Informatics Journal, V3, P51, DOI 10.1016/j.fcij.2017.11.002
  • [2] Apostolakis Konstantinos C, 2021, Open Res Eur, V1, P87, DOI 10.12688/openreseurope.13715.2
  • [3] Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
    Carreira, Joao
    Zisserman, Andrew
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4724 - 4733
  • [4] Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognition
    Chen, Yuxin
    Zhang, Ziqi
    Yuan, Chunfeng
    Li, Bing
    Deng, Ying
    Hu, Weiming
    [J]. 2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, : 13339 - 13348
  • [5] PoTion: Pose MoTion Representation for Action Recognition
    Choutas, Vasileios
    Weinzaepfel, Philippe
    Revaud, Jerome
    Schmid, Cordelia
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 7024 - 7033
  • [6] Cohen I, 2003, IEEE INTERNATIONAL WORKSHOP ON ANALYSIS AND MODELING OF FACE AND GESTURES, P74
  • [7] An Integrated Framework for the Timely Detection of Petty Crimes
    Dimitriou, Nikolaos
    Kioumourtzis, George
    Sideris, Anargyros
    Stavropoulos, Georgios
    Taka, Evdoxia
    Zotos, Nikolaos
    Leventakis, George
    Tzovaras, Dimitrios
    [J]. 2017 EUROPEAN INTELLIGENCE AND SECURITY INFORMATICS CONFERENCE (EISIC), 2017, : 24 - 31
  • [8] Learning Spatiotemporal Features with 3D Convolutional Networks
    Du Tran
    Bourdev, Lubomir
    Fergus, Rob
    Torresani, Lorenzo
    Paluri, Manohar
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 4489 - 4497
  • [9] Revisiting Skeleton-based Action Recognition
    Duan, Haodong
    Zhao, Yue
    Chen, Kai
    Lin, Dahua
    Dai, Bo
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 2959 - 2968
  • [10] 3D CNNs with Adaptive Temporal Feature Resolutions
    Fayyaz, Mohsen
    Bahrami, Emad
    Diba, Ali
    Noroozi, Mehdi
    Adeli, Ehsan
    Van Gool, Luc
    Gall, Juergen
    [J]. 2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 4729 - 4738