Person re-identification with features-based clustering and deep features

被引:17
作者
Fayyaz, Muhammad [1 ]
Yasmin, Mussarat [1 ]
Sharif, Muhammad [1 ]
Shah, Jamal Hussain [1 ]
Raza, Mudassar [1 ]
Iqbal, Tassawar [1 ]
机构
[1] COMSATS Univ Islamabad, Dept Comp Sci, Wah Campus, Wah Cantt, Pakistan
关键词
Person ReID; Entropy controlled features; Features-based clustering; Deep learning; COLOR; CLASSIFICATION; TEXTURE; REPRESENTATION; HISTOGRAMS; FRAMEWORK; PATTERN; LEVEL; MODEL;
D O I
10.1007/s00521-019-04590-2
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Person re-identification (ReID) is an imperative area of pedestrian analysis and has practical applications in visual surveillance. In the person ReID, the robust feature representation is a key issue because of inconsistent visual appearances of a person. Also, an exhaustive gallery search is required to find the target image against each probe image. To answer such issues, this manuscript presents a framework named features-based clustering and deep features in person ReID. The proposed framework initially extracts three types of handcrafted features on the input images including shape, color, and texture for feature representation. To acquire optimal features, a feature fusion and selection technique is applied to these handcrafted features. Afterward, to optimize the gallery search, features-based clustering is performed for splitting the whole gallery into k consensus clusters. For relationship learning of gallery features and related labels of the chosen clusters, radial basis kernel is employed. Later on, cluster-wise, images are selected and provided to the deep convolution neural network model to obtain deep features. Then, a cluster-wise feature vector is obtained by fusing the deep and handcrafted features. It follows the feature matching process where multi-class support vector machine is applied to choose the related cluster. Finally, to find accurate matching pair from the classified cluster(s) instead of the whole gallery search, a cross-bin histogram-based distance similarity measure is used. The recognition rate at rank 1 is attained as 46.82%, 48.12%, and 40.67% on selected datasets VIPeR, CUHK01, and iLIDS-VID, respectively. It confirms the proposed framework outperforms the existing ReID approaches.
引用
收藏
页码:10519 / 10540
页数:22
相关论文
共 100 条
  • [1] Multi-Level Common Space Learning for Person Re-Identification
    An, Le
    Qin, Zhen
    Chen, Xiaojing
    Yang, Songfan
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (08) : 1777 - 1787
  • [2] Person Re-identification by Multi-hypergraph Fusion
    An, Le
    Chen, Xiaojing
    Yang, Songfan
    Li, Xuelong
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (11) : 2763 - 2774
  • [3] Multi-graph feature level fusion for person re-identification
    An, Le
    Chen, Xiaojing
    Yang, Songfan
    [J]. NEUROCOMPUTING, 2017, 259 : 39 - 45
  • [4] Integrating appearance features and soft biometrics for person re-identification
    An, Le
    Chen, Xiaojing
    Liu, Shuang
    Lei, Yinjie
    Yang, Songfan
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2017, 76 (09) : 12117 - 12131
  • [5] Sparse representation matching for person re-identification
    An, Le
    Chen, Xiaojing
    Yang, Songfan
    Bhanu, Bir
    [J]. INFORMATION SCIENCES, 2016, 355 : 74 - 89
  • [6] Person Reidentification With Reference Descriptor
    An, Le
    Kafai, Mehran
    Yang, Songfan
    Bhanu, Bir
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2016, 26 (04) : 776 - 787
  • [7] Person re-identification via hypergraph-based matching
    An, Le
    Chen, Xiaojing
    Yang, Songfan
    [J]. NEUROCOMPUTING, 2016, 182 : 247 - 254
  • [8] Person Re-Identification by Robust Canonical Correlation Analysis
    An, Le
    Yang, Songfan
    Bhanu, Bir
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2015, 22 (08) : 1103 - 1107
  • [9] [Anonymous], 2015, PROC CVPR IEEE, DOI 10.1109/CVPR.2015.7299016
  • [10] Bak S., 2016, Philosophical Psychology, P1