Human pose regression by combining indirect part detection and contextual information

被引:114
作者
Luvizon, Diogo C. [1 ,2 ]
Labia, Hedi [1 ,3 ]
Picard, David [1 ,4 ]
机构
[1] Paris Seine Univ, CNRS, ENSEA, ETIS UMR 8051, F-95000 Cergy, France
[2] Samsung Res Inst, Adv Technol, Campinas, SP, Brazil
[3] Univ Paris Saclay, IBISC, Univ Ewy Val Essonne, Paris, France
[4] UPE, Ecole Ponts, UMR 8049, LIGM, Champs Sur Marne, France
来源
COMPUTERS & GRAPHICS-UK | 2019年 / 85卷
关键词
Human pose estimation; Neural nets; vision; PICTORIAL STRUCTURES;
D O I
10.1016/j.cag.2019.09.002
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
In this paper, we tackle the problem of human pose estimation from still images, which is a very active topic, specially due to its several applications, from image annotation to human-machine interface. We use the soft-argmax function to convert feature maps directly to body joint coordinates, resulting in a fully differentiable framework. Our method is able to learn heat maps representations indirectly, without additional steps of artificial ground truth generation. Consequently, contextual information can be included to the pose predictions in a seamless way. We evaluated our method on two challenging datasets, the Leeds Sports Poses (LSP) and the MPII Human Pose datasets, reaching the best performance among all the existing regression methods. (C) 2019 Elsevier Ltd. All rights reserved.
引用
收藏
页码:15 / 22
页数:8
相关论文
共 40 条
  • [1] 2D Human Pose Estimation: New Benchmark and State of the Art Analysis
    Andriluka, Mykhaylo
    Pishchulin, Leonid
    Gehler, Peter
    Schiele, Bernt
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 3686 - 3693
  • [2] Andriluka M, 2009, PROC CVPR IEEE, P1014, DOI 10.1109/CVPRW.2009.5206754
  • [3] [Anonymous], 2015, Arxiv.Org, DOI DOI 10.3389/FPSYG.2013.00124
  • [4] Robust Optimization for Deep Regression
    Belagiannis, Vasileios
    Rupprecht, Christian
    Carneiro, Gustavo
    Navab, Nassir
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2830 - 2838
  • [5] Human Pose Estimation via Convolutional Part Heatmap Regression
    Bulat, Adrian
    Tzimiropoulos, Georgios
    [J]. COMPUTER VISION - ECCV 2016, PT VII, 2016, 9911 : 717 - 732
  • [6] Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields
    Cao, Zhe
    Simon, Tomas
    Wei, Shih-En
    Sheikh, Yaser
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1302 - 1310
  • [7] Human Pose Estimation with Iterative Error Feedback
    Carreira, Joao
    Agrawal, Pulkit
    Fragkiadaki, Katerina
    Malik, Jitendra
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 4733 - 4742
  • [8] Chen YH, 2017, AIP CONF PROC, V1812, DOI [10.1063/1.4975898, 10.1109/ICCV.2017.137]
  • [9] Chou C, 2017, ABS170702439 CORR
  • [10] Multi-Context Attention for Human Pose Estimation
    Chu, Xiao
    Yang, Wei
    Ouyang, Wanli
    Ma, Cheng
    Yuille, Alan L.
    Wang, Xiaogang
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5669 - 5678