Symmetry-driven accumulation of local features for human characterization and re-identification

被引:232
作者
Bazzani, Loris [2 ]
Cristani, Marco [1 ,2 ]
Murino, Vittorio [1 ,2 ]
机构
[1] Univ Verona, Dept Comp Sci, I-37134 Verona, Italy
[2] Ist Italiano Tecnol, I-16163 Genoa, Italy
关键词
Human characterization; Appearance modeling; Re-identification; Multi-target tracking; PICTORIAL STRUCTURES; OBJECT TRACKING; RECOGNITION;
D O I
10.1016/j.cviu.2012.10.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This work proposes a method to characterize the appearance of individuals exploiting body visual cues. The method is based on a symmetry-driven appearance-based descriptor and a matching policy that allows to recognize an individual. The descriptor encodes three complementary visual characteristics of the human appearance: the overall chromatic content, the spatial arrangement of colors into stable regions, and the presence of recurrent local motifs with high entropy. The characteristics are extracted by following symmetry and asymmetry perceptual principles, that allow to segregate meaningful body parts and to focus on the human body only, pruning out the background clutter. The descriptor exploits the case where we have a single image of the individual, as so as the eventuality that multiple pictures of the same identity are available, as in a tracking scenario. The descriptor is dubbed Symmetry-Driven Accumulation of Local Features (SDALFs). Our approach is applied to two different scenarios: re-identification and multi-target tracking. In the former, we show the capabilities of SDALF in encoding peculiar aspects of an individual, focusing on its robustness properties across dramatic low resolution images, in presence of occlusions and pose changes, and variations of viewpoints and scene illumination. SDALF has been tested on various benchmark datasets, obtaining in general convincing performances, and setting the state of the art in some cases. The latter scenario shows the benefits of using SDALF as observation model for different trackers, boosting their performances under different respects on the CAVIAR dataset. (c) 2012 Elsevier Inc. All rights reserved.
引用
收藏
页码:130 / 144
页数:15
相关论文
共 70 条
  • [1] Monocular 3D Pose Estimation and Tracking by Detection
    Andriluka, Mykhaylo
    Roth, Stefan
    Schiele, Bernt
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 623 - 630
  • [2] Andriluka M, 2009, PROC CVPR IEEE, P1014, DOI 10.1109/CVPRW.2009.5206754
  • [3] [Anonymous], INT C IM PROC
  • [4] [Anonymous], 2006, P BRIT MACHINE VISIO
  • [5] [Anonymous], 2009, BRIT MACH VIS C
  • [6] [Anonymous], BRIT MACH VIS C
  • [7] [Anonymous], SIBGRAPI
  • [8] [Anonymous], 2001, Sequential Monte Carlo methods in practice
  • [9] [Anonymous], INT C COMP VIS
  • [10] [Anonymous], INT C COMP VIS