Human Movement Recognition Based on 3D Point Cloud Spatiotemporal Information from Millimeter-Wave Radar

被引:3
|
作者
Dang, Xiaochao [1 ]
Jin, Peng [1 ]
Hao, Zhanjun [1 ]
Ke, Wenze [1 ]
Deng, Han [1 ]
Wang, Li [1 ]
机构
[1] Northwest Normal Univ, Coll Comp Sci & Engn, Lanzhou 730070, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point cloud; millimeter-wave radar; human movement; neural network;
D O I
10.3390/s23239430
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human movement recognition is the use of perceptual technology to collect some of the limb or body movements presented. This practice involves the use of wireless signals, processing, and classification to identify some of the regular movements of the human body. It has a wide range of application prospects, including in intelligent pensions, remote health monitoring, and child supervision. Among the traditional human movement recognition methods, the widely used ones are video image-based recognition technology and Wi-Fi-based recognition technology. However, in some dim and imperfect weather environments, it is not easy to maintain a high performance and recognition rate for human movement recognition using video images. There is the problem of a low recognition degree for Wi-Fi recognition of human movement in the case of a complex environment. Most of the previous research on human movement recognition is based on LiDAR perception technology. LiDAR scanning using a three-dimensional static point cloud can only present the point cloud characteristics of static objects; it struggles to reflect all the characteristics of moving objects. In addition, due to its consideration of privacy and security issues, the dynamic millimeter-wave radar point cloud used in the previous study on the existing problems of human body movement recognition performance is better, with the recognition of human movement characteristics in non-line-of-sight situations as well as better protection of people's privacy. In this paper, we propose a human motion feature recognition system (PNHM) based on spatiotemporal information of the 3D point cloud of millimeter-wave radar, design a neural network based on the network PointNet++ in order to effectively recognize human motion features, and study four human motions based on the threshold method. The data set of the four movements of the human body at two angles in two experimental environments was constructed. This paper compares four standard mainstream 3D point cloud human action recognition models for the system. The experimental results show that the recognition accuracy of the human body's when walking upright can reach 94%, the recognition accuracy when moving from squatting to standing can reach 84%, that when moving from standing to sitting can reach 87%, and the recognition accuracy of falling can reach 93%.
引用
收藏
页数:23
相关论文
共 50 条
  • [31] Automatic Identification of Clear-Air Echoes Based on Millimeter-wave Cloud Radar Measurements
    Yang, Ling
    Wang, Yun
    Wang, Zhongke
    Yang, Qian
    Fan, Xingang
    Tao, Fa
    Zhen, Xiaoqiong
    Yang, Zhipeng
    ADVANCES IN ATMOSPHERIC SCIENCES, 2020, 37 (08) : 912 - 924
  • [32] Experimental Study on 3D imaging Using Millimeter-Wave Non-Uniform 2D-MIMO Radar
    Kato, Tateki
    Yamada, Hiroyoshi
    Mori, Hiroki
    2022 INTERNATIONAL SYMPOSIUM ON ANTENNAS AND PROPAGATION (ISAP), 2022, : 231 - 232
  • [33] Experimental Study on 3D Imaging Using Millimeter-wave Non-uniform 2D-MIMO Radar
    Kato, Tateki
    Yamada, Hiroyoshi
    Mori, Hiroki
    IEICE COMMUNICATIONS EXPRESS, 2022, 11 (12): : 760 - 765
  • [34] Dynamic Gesture Recognition Model Based on Millimeter-Wave Radar With ResNet-18 and LSTM
    Zhang, Yongqiang
    Peng, Lixin
    Ma, Guilei
    Man, Menghua
    Liu, Shanghe
    FRONTIERS IN NEUROROBOTICS, 2022, 16
  • [35] Sample Intercorrelation-Based Multidomain Fusion Network for Aquatic Human Activity Recognition Using Millimeter-Wave Radar
    Yu, Xuliang
    Cao, Zhihui
    Wu, Zhijing
    Song, Chunyi
    Xu, Zhiwei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [36] 3D Imaging Millimeter Wave Circular Synthetic Aperture Radar
    Zhang, Renyuan
    Cao, Siyang
    SENSORS, 2017, 17 (06)
  • [37] Sea Fog Recognition near Coastline Using Millimeter-Wave Radar Based on Machine Learning
    Li, Tao
    Qiu, Jianhua
    Xue, Jianjun
    ATMOSPHERE, 2024, 15 (09)
  • [38] Fall Detection System Using Millimeter-Wave Radar Based on Neural Network and Information Fusion
    Yao, Yicheng
    Liu, Changyu
    Zhang, Hao
    Yan, Baiju
    Jian, Pu
    Wang, Peng
    Du, Lidong
    Chen, Xianxiang
    Han, Baoshi
    Fang, Zhen
    IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (21) : 21038 - 21050
  • [39] Millimeter-Wave Radar Monitoring for Elder's Fall Based on Multi-View Parameter Fusion Estimation and Recognition
    Feng, Xiang
    Shan, Zhengliang
    Zhao, Zhanfeng
    Xu, Zirui
    Zhang, Tianpeng
    Zhou, Zihe
    Deng, Bo
    Guan, Zirui
    REMOTE SENSING, 2023, 15 (08)
  • [40] Handwriting Number Recognition Based on Millimeter-wave Radar with Dual-view Feature Fusion Network
    Feng, Xiang
    Liu, Tao
    Cui, Wenqing
    Wu, Mufu
    Li, Fengcong
    Zhao, Yinan
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2023, 45 (06) : 2134 - 2143