Study on the edge computing method for skeleton-based human action feature recognition

被引:0
作者
You W. [1 ]
Wang X. [1 ]
机构
[1] State Key Laboratory of Precision Measurement Technology and Instruments, Department of Precision Instrument, Tsinghua University, Beijing
来源
Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument | 2020年 / 41卷 / 10期
关键词
Action recognition; Edge computing; Feature extraction; Multi-time scale; Skeleton feature;
D O I
10.19650/j.cnki.cjsi.J2006750
中图分类号
学科分类号
摘要
Human action recognition is an important task in intelligent security monitoring field. Traditional action recognition method uploads the original image signal to the cloud server in a centralized manner, which brings problems such as network congestion, server computing pressure and computing delay. This paper proposes an edge computing-based multi-time scale skeleton feature fusion method for action recognition. Firstly, the spatial positions of human key points are extracted from the original images of human action and the skeleton features of human action are constructed. Then, the skeleton feature extraction and recognition task are deployed to multiple edge nodes. In the edge nodes the skeleton features on different time scales are extracted and recognized respectively. The results in all the edge nodes are uploaded to the cloud server and fused to make a decision. The proposed method not only achieves the dynamic scheduling of computing resources through adjusting the number of edge nodes according to the accuracy requirements, which relieves network congestion and lightens server computing pressure, but also significantly improves the recognition accuracy, which has important practical application value for the human action recognition in intelligent security field. © 2020, Science Press. All right reserved.
引用
收藏
页码:156 / 164
页数:8
相关论文
共 22 条
  • [1] AGGARWAL J K, XIA L., Human activity recognition from 3D data: A review, Pattern Recognition Letters, 48, pp. 70-80, (2014)
  • [2] DAI P, WANG X, TAN Y Q, Et al., Self-adaptive calibration of hybrid visual sensor networks for pedestrian detection, Chinese Journal of Scientific Instrument, 37, pp. 683-689, (2016)
  • [3] TAN Y Q, WANG X, LIN K CH., Visual compressive sensing-based pedestrian identification in sensor networks, Chinese Journal of Scientific Instrument, 35, 11, pp. 2433-2439, (2014)
  • [4] VEMULAPALLI R, ARRATE F, CHELLAPPA R., Human action recognition by representing 3D skeletons as points in a lie group, IEEE Conference on Computer Vision and Pattern Recognition, pp. 588-595, (2014)
  • [5] XIA L, CHEN C C, AGGARWAL J K., View invariant human action recognition using histograms of 3D joints, IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 20-27, (2012)
  • [6] WANG P, LI Z, HOU Y, Et al., Action recognition based on joint trajectory maps using convolutional neural networks, Proceedings of the 24th ACM international conference on Multimedia, pp. 102-106, (2016)
  • [7] KE Q, BENNAMOUN M, AN S, Et al., A new representation of skeleton sequences for 3D action recognition, IEEE Conference on Computer Vision and Pattern Recognition, pp. 3288-3297, (2017)
  • [8] LIU J, SHAHROUDY A, WANG G, Et al., Skeleton-based online action prediction using scale selection network, IEEE Transactions on Pattern Analysis and Machine Intelligence, 42, 6, pp. 1453-1467, (2019)
  • [9] LIU M, YUAN J., Recognizing human actions as the evolution of pose estimation maps, IEEE Conference on Computer Vision and Pattern Recognition, pp. 1159-1168, (2018)
  • [10] LIU M, LIU H, CHEN C., Enhanced skeleton visualization for view invariant human action recognition, Pattern Recognition, 68, pp. 346-362, (2017)