BodyPressure-Inferring Body Pose and Contact Pressure From a Depth Image

被引:11
作者
Clever, Henry M. M. [1 ]
Grady, Patrick L. L. [1 ]
Turk, Greg [2 ]
Kemp, Charles C. C. [1 ]
机构
[1] Georgia Inst Technol, Dept Biomed Engn, Atlanta, GA 30332 USA
[2] Georgia Inst Technol, Sch Interact Comp, Atlanta, GA 30332 USA
基金
美国国家科学基金会;
关键词
Human pose estimation; bodies at rest; physics simulation; parametric human modeling; depth sensing; contact pressure; pressure injury; NORMAL RANGE; MOTION; PREVALENCE; JOINTS; MODEL;
D O I
10.1109/TPAMI.2022.3158902
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Contact pressure between the human body and its surroundings has important implications. For example, it plays a role in comfort, safety, posture, and health. We present a method that infers contact pressure between a human body and a mattress from a depth image. Specifically, we focus on using a depth image from a downward facing camera to infer pressure on a body at rest in bed occluded by bedding, which is directly applicable to the prevention of pressure injuries in healthcare. Our approach involves augmenting a real dataset with synthetic data generated via a soft-body physics simulation of a human body, a mattress, a pressure sensing mat, and a blanket. We introduce a novel deep network that we trained on an augmented dataset and evaluated with real data. The network contains an embedded human body mesh model and uses a white-box model of depth and pressure image generation. Our network successfully infers body pose, outperforming prior work. It also infers contact pressure across a 3D mesh model of the human body, which is a novel capability, and does so in the presence of occlusion from blankets.
引用
收藏
页码:137 / 153
页数:17
相关论文
共 82 条
  • [1] Achilles Felix, 2016, Medical Image Computing and Computer-Assisted Intervention - MICCAI 2016. 19th International Conference. Proceedings: LNCS 9900, P491, DOI 10.1007/978-3-319-46720-7_57
  • [2] Structured Prediction Helps 3D Human Motion Modelling
    Aksan, Emre
    Kaufmann, Manuel
    Hilliges, Otmar
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7143 - 7152
  • [3] Ballan L, 2012, LECT NOTES COMPUT SC, V7577, P640, DOI 10.1007/978-3-642-33783-3_46
  • [4] Berlowitzet D., PREVENTING PRESSURE
  • [5] Black M., 2021, PERSONAL COMMUNICATI
  • [6] Keep It SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Image
    Bogo, Federica
    Kanazawa, Angjoo
    Lassner, Christoph
    Gehler, Peter
    Romero, Javier
    Black, Michael J.
    [J]. COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 : 561 - 578
  • [7] NORMAL RANGE OF MOTION OF JOINTS IN MALE-SUBJECTS
    BOONE, DC
    AZEN, SP
    [J]. JOURNAL OF BONE AND JOINT SURGERY-AMERICAN VOLUME, 1979, 61 (05) : 756 - 759
  • [8] Human Pose Estimation via Convolutional Part Heatmap Regression
    Bulat, Adrian
    Tzimiropoulos, Georgios
    [J]. COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 : 717 - 732
  • [9] Human Pose Estimation with Iterative Error Feedback
    Carreira, Joao
    Agrawal, Pulkit
    Fragkiadaki, Katerina
    Malik, Jitendra
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4733 - 4742
  • [10] Patient 3D body pose estimation from pressure imaging
    Casas, Leslie
    Navab, Nassir
    Demirci, Stefanie
    [J]. INTERNATIONAL JOURNAL OF COMPUTER ASSISTED RADIOLOGY AND SURGERY, 2019, 14 (03) : 517 - 524