Cross-Modal Supervised Human Body Pose Recognition Techniques for Through-Wall Radar

被引:0
作者
Xu, Dongpo [1 ,2 ]
Liu, Yunqing [1 ,2 ]
Wang, Qian [1 ]
Wang, Liang [3 ]
Shen, Qiuping [1 ]
机构
[1] Changchun Univ Sci & Technol, Sch Elect & Informat Engn, Changchun 130022, Peoples R China
[2] Jilin Prov Sci & Technol Innovat Ctr Intelligent P, Changchun 130022, Peoples R China
[3] Intelligent Percept & Proc Technol Lab, Beijing 100124, Peoples R China
基金
中国国家自然科学基金;
关键词
through-wall radar; target pose recognition; deep learning; cross-modal supervision; machine learning;
D O I
10.3390/s24072207
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Through-wall radar human body pose recognition technology has broad applications in both military and civilian sectors. Identifying the current pose of targets behind walls and predicting subsequent pose changes are significant challenges. Conventional methods typically utilize radar information along with machine learning algorithms such as SVM and random forests to aid in recognition. However, these approaches have limitations, particularly in complex scenarios. In response to this challenge, this paper proposes a cross-modal supervised through-wall radar human body pose recognition method. By integrating information from both cameras and radar, a cross-modal dataset was constructed, and a corresponding deep learning network architecture was designed. During training, the network effectively learned the pose features of targets obscured by walls, enabling accurate pose recognition (e.g., standing, crouching) in scenarios with unknown wall obstructions. The experimental results demonstrated the superiority of the proposed method over traditional approaches, offering an effective and innovative solution for practical through-wall radar applications. The contribution of this study lies in the integration of deep learning with cross-modal supervision, providing new perspectives for enhancing the robustness and accuracy of target pose recognition.
引用
收藏
页数:30
相关论文
共 29 条
  • [1] Capturing the Human Figure Through a Wall
    Adib, Fadel
    Hsu, Chen-Yu
    Mao, Hongzi
    Katabi, Dina
    Durand, Fredo
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2015, 34 (06):
  • [2] Bishop Gary., 1992, SIGGRAPH COMPUTER GR, V26, P153, DOI [DOI 10.1145/142413.142416, 10.1145/142413.142416]
  • [3] Incoherence Correction and Decision Making Based on Generalized Credal Sets
    Bronevich, Andrey G.
    Rozenberg, Igor N.
    [J]. SYMBOLIC AND QUANTITATIVE APPROACHES TO REASONING WITH UNCERTAINTY, ECSQARU 2017, 2017, 10369 : 271 - 281
  • [4] Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
    Cao, Zhe
    Simon, Tomas
    Wei, Shih-En
    Sheikh, Yaser
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1302 - 1310
  • [5] Cardillo E, 2021, 2021 IEEE INTERNATIONAL WORKSHOP ON METROLOGY FOR INDUSTRY 4.0 & IOT (IEEE METROIND4.0 & IOT), P412, DOI [10.1109/MetroInd4.0IoT51437.2021.9488464, 10.1109/METROIND4.0IOT51437.2021.9488464]
  • [6] Towards Accurate Human Pose Estimation in Videos of Crowded Scenes
    Chang, Shuning
    Yuan, Li
    Nie, Xuecheng
    Huang, Ziyuan
    Zhou, Yichen
    Chen, Yupeng
    Feng, Jiashi
    Yan, Shuicheng
    [J]. MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 4630 - 4634
  • [7] Denisov P., 2020, arXiv
  • [8] Optical Filter-Less Photonic FMCW Radar for Multi-Target Detection
    Dhawan, Rajveer
    Moyal, Kartik
    Choudhary, Amol
    [J]. IEEE PHOTONICS TECHNOLOGY LETTERS, 2023, 35 (02) : 81 - 84
  • [9] RMPE: Regional Multi-Person Pose Estimation
    Fang, Hao-Shu
    Xie, Shuqin
    Tai, Yu-Wing
    Lu, Cewu
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 2353 - 2362
  • [10] Feng W., 2018, P IET INT RADAR C, P1