Human 3D sitting pose estimation based on contact interaction perception

被引：0
|
作者：
Zhou J. [1 ]
Cai J. [1 ]
Zhang L. [1 ]
Li L. [1 ]
Li X. [1 ]
机构：
[1] College of Metrology & Measurement Engineering, China Jiliang University, Hangzhou
来源：
Yi Qi Yi Biao Xue Bao/Chinese Journal of Scientific Instrument | 2022年 / 43卷 / 11期
关键词：
Array pressure sensor; Convolutional neural network; OpenPose; Sitting posture;
D O I：
10.19650/j.cnki.cjsi.J2210027
中图分类号：
学科分类号：
摘要：
Aiming at the interference of the visual pose estimation method, such as cover and occlusion, a method of estimating human three-dimensional sitting posture based on the seat surface pressure image is proposed. The cross-domain relationship between seat surface pressure distribution and human three-dimensional posture is established. A posture training system based on pressure and vision is designed. The array pressure sensor is embedded in the seat surface to perceive the posture, and the time stamp is used to realize the synchronization of the visual image matching with the binocular camera. Bilateral filtering is used to eliminate the peak noise of pressure images. Nineteen 3D keypoints are extracted from binocular vision images by OpenPose estimation and triangulation. To improve the accuracy of attitude estimation, a stochastic gradient descent method to minimize the loss function is proposed to optimize the coordinates of 3D keypoints. The 3D confidence graph of keypoints is further generated by 3D Gaussian filter. A multi-layer convolutional neural network pressure-vision cross-domain deep learning model is formulated. Continuous multi-frame pressure images are used as input of the model, and 3D pose estimation results of 3D key point coordinates and their confidence graphs are used as supervision. Based on the pressure distribution of the array sensor on the chair surface, the algorithm can accurately estimate the 3D sitting posture including 19 human key points. The average error of 19 key points is 9.7 cm on the verification set. © 2022, Science Press. All right reserved.
引用
收藏
页码：132 / 141
页数：9
相关论文
共 19 条
  • [1] ZHENG Z M., Sitting posture sensing and healthy behavior persuation, (2013)
  • [2] NEWELL A, YANG K, DENG J., Stacked hourglass networks for human pose estimation, CoRR, (2016)
  • [3] MENG L, GAO H SH, ZHANG H G, Et al., Three-dimensional human pose estimation based on the fully connected neural network, Chinese Journal of Scientific Instrument, 41, 10, pp. 165-177, (2020)
  • [4] PAPANDREOU G, ZHU T, CHEN L, Et al., PersonLab: Person pose estimation and instance segmentation with a bottom-up, part-based, geometric embedding model, Computer Vision-ECCV, (2018)
  • [5] CAO Z, SIMON T, WEI S, Et al., Realtime multi-person 2D pose estimation using part affinity fields[C], 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), pp. 1302-1310, (2017)
  • [6] ACHILLES F, ICHIM A E, COSKUN H, Et al., Patient MoCap: Human pose estimation under blanket occlusion for hospital monitoring applications, International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 491-499, (2016)
  • [7] LIU S, YIN Y, OSTADABBAS S., In-bed pose estimation: Deep learning with shallow dataset[J], IEEE Journal of Translational Engineering in Health and Medicine, 7, (2019)
  • [8] ZHAO M, LI T, ABU ALSHEIKH M, Et al., Through-wall human pose estimation using radio signals[C], 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 7356-7365, (2018)
  • [9] CLEVER H M, ERICKSON Z, KAPUSTA A, Et al., Bodies at rest: 3D human pose and shape estimation from a pressure image using synthetic data[J], 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 6214-6223, (2020)
  • [10] CLEVER H M, KAPUSTA A, PARK D, Et al., 3D human pose estimation on a configurable bed from a pressure image, Computer Science, (2018)
12