Human Movement Recognition Based on 3D Point Cloud Spatiotemporal Information from Millimeter-Wave Radar

被引:3
|
作者
Dang, Xiaochao [1 ]
Jin, Peng [1 ]
Hao, Zhanjun [1 ]
Ke, Wenze [1 ]
Deng, Han [1 ]
Wang, Li [1 ]
机构
[1] Northwest Normal Univ, Coll Comp Sci & Engn, Lanzhou 730070, Peoples R China
基金
中国国家自然科学基金;
关键词
3D point cloud; millimeter-wave radar; human movement; neural network;
D O I
10.3390/s23239430
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human movement recognition is the use of perceptual technology to collect some of the limb or body movements presented. This practice involves the use of wireless signals, processing, and classification to identify some of the regular movements of the human body. It has a wide range of application prospects, including in intelligent pensions, remote health monitoring, and child supervision. Among the traditional human movement recognition methods, the widely used ones are video image-based recognition technology and Wi-Fi-based recognition technology. However, in some dim and imperfect weather environments, it is not easy to maintain a high performance and recognition rate for human movement recognition using video images. There is the problem of a low recognition degree for Wi-Fi recognition of human movement in the case of a complex environment. Most of the previous research on human movement recognition is based on LiDAR perception technology. LiDAR scanning using a three-dimensional static point cloud can only present the point cloud characteristics of static objects; it struggles to reflect all the characteristics of moving objects. In addition, due to its consideration of privacy and security issues, the dynamic millimeter-wave radar point cloud used in the previous study on the existing problems of human body movement recognition performance is better, with the recognition of human movement characteristics in non-line-of-sight situations as well as better protection of people's privacy. In this paper, we propose a human motion feature recognition system (PNHM) based on spatiotemporal information of the 3D point cloud of millimeter-wave radar, design a neural network based on the network PointNet++ in order to effectively recognize human motion features, and study four human motions based on the threshold method. The data set of the four movements of the human body at two angles in two experimental environments was constructed. This paper compares four standard mainstream 3D point cloud human action recognition models for the system. The experimental results show that the recognition accuracy of the human body's when walking upright can reach 94%, the recognition accuracy when moving from squatting to standing can reach 84%, that when moving from standing to sitting can reach 87%, and the recognition accuracy of falling can reach 93%.
引用
收藏
页数:23
相关论文
共 50 条
  • [41] Human Activity Recognition Based on Feature Fusion of Millimeter Wave Radar and Inertial Navigation
    Shi, Jiajia
    Zhu, Yihan
    He, Jiaqing
    Xu, Zhihuo
    Chu, Liu
    Braun, Robin
    Shi, Quan
    IEEE JOURNAL OF MICROWAVES, 2025, 5 (02): : 409 - 424
  • [42] Chinese sign language recognition based on multi-view deep neural network for millimeter-wave radar
    Wang, Xing
    Cui, Chang
    Li, Cong
    Dong, Xichao
    ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING IN DEFENSE APPLICATIONS IV, 2022, 12276
  • [43] Driver Head-Hand Cooperative Action Recognition Based on FMCW Millimeter-Wave Radar and Deep Learning
    Zhang, Lianlong
    Chen, Xiaodong
    Chen, Zexin
    Zheng, Jiawen
    Diao, Yinliang
    SENSORS, 2025, 25 (08)
  • [44] Dynamic Gesture Recognition Method Based on Millimeter-wave Radar by One-Dimensional Series Neural Network
    Jin Biao
    Peng Yu
    Kuang Xiaofei
    Zhang Zhenkai
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2021, 43 (09) : 2743 - 2750
  • [45] Application of multi-angle millimeter-wave radar detection in human motion behavior and micro-action recognition
    Zhang, Zhaolin
    Meng, Wugang
    Song, Mingqi
    Liu, Yuhan
    Zhao, Yinan
    Feng, Xiang
    Li, Fengcong
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2022, 33 (10)
  • [46] Human and Object Detection in Smoke-Filled Space Using Millimeter-Wave Radar Based Measurement
    Aoki, Yoshimitsu
    Sakai, Masaki
    JOURNAL OF ROBOTICS AND MECHATRONICS, 2006, 18 (06) : 760 - 764
  • [47] Multitarget-Tracking Method Based on the Fusion of Millimeter-Wave Radar and LiDAR Sensor Information for Autonomous Vehicles
    Shi, Junren
    Tang, Yingjie
    Gao, Jun
    Piao, Changhao
    Wang, Zhongquan
    SENSORS, 2023, 23 (15)
  • [48] mmBody Benchmark: 3D Body Reconstruction Dataset and Analysis for Millimeter Wave Radar
    Chen, Anjun
    Wang, Xiangyu
    Zhu, Shaohao
    Li, Yanxu
    Chen, Jiming
    Ye, Qi
    PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, : 3501 - 3510
  • [49] MMPoint-GNN: Graph Neural Network with Dynamic Edges for Human Activity Recognition through a Millimeter-wave Radar
    Gong, Peixian
    Wang, Chunyu
    Zhang, Lihua
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [50] Acceleration of FPGA Based Convolutional Neural Network for Human Activity Classification Using Millimeter-Wave Radar
    Lei, Peng
    Liang, Jiawei
    Guan, Zhenyu
    Wang, Jun
    Zheng, Tong
    IEEE ACCESS, 2019, 7 : 88917 - 88926