Supervised Deep Feature Embedding With Handcrafted Feature

被引:55
作者
Kan, Shichao [1 ,2 ]
Cen, Yigang [1 ,2 ]
He, Zhihai [3 ]
Zhang, Zhi [3 ]
Zhang, Linna [4 ]
Wang, Yanhong [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
[2] Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China
[3] Univ Missouri, Dept Elect Engn & Comp Sci, Columbia, MO 65211 USA
[4] Guizhou Univ, Coll Mech Engn, Guiyang 550025, Guizhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep feature embedding; handcrafted feature; image representation; deep metric learning; image retrieval; person re-identification; vehicle re-identification; FEATURE FUSION; IMAGE;
D O I
10.1109/TIP.2019.2901407
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image representation methods based on deep convolutional neural networks (CNNs) have achieved the state-of-theart performance in various computer vision tasks, such as image retrieval and person re-identification. We recognize that more discriminative feature embeddings can be learned with supervised deep metric learning and handcrafted features for image retrieval and similar applications. In this paper, we propose a new supervised deep feature embedding with a handcrafted feature model. To fuse handcrafted feature information into CNNs and realize feature embeddings, a general fusion unit is proposed (called Fusion-Net). We also define a network lass function with image label information to realize supervised deep metric learning. Our extensive experimental results on the Stanford online products' data set and the in-shop clothes retrieval data set demonstrate that our proposed methods outperform the existing state-of-the-art methods of image retrieval by a large margin. Moreover, we also explore the applications of the proposed methods in person re-identification and vehicle re-identification; the experimental results demonstrate both the effectiveness and efficiency of the proposed methods.
引用
收藏
页码:5809 / 5823
页数:15
相关论文
共 63 条
  • [61] Scalable Person Re-identification: A Benchmark
    Zheng, Liang
    Shen, Liyue
    Tian, Lu
    Wang, Shengjin
    Wang, Jingdong
    Tian, Qi
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 1116 - 1124
  • [62] Zheng L, 2015, PROC CVPR IEEE, P1741, DOI 10.1109/CVPR.2015.7298783
  • [63] Re-ranking Person Re-identification with k-reciprocal Encoding
    Zhong, Zhun
    Zheng, Liang
    Cao, Donglin
    Li, Shaozi
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3652 - 3661