Supervised Deep Feature Embedding With Handcrafted Feature

被引:55
作者
Kan, Shichao [1 ,2 ]
Cen, Yigang [1 ,2 ]
He, Zhihai [3 ]
Zhang, Zhi [3 ]
Zhang, Linna [4 ]
Wang, Yanhong [1 ,2 ]
机构
[1] Beijing Jiaotong Univ, Sch Comp & Informat Technol, Beijing 100044, Peoples R China
[2] Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China
[3] Univ Missouri, Dept Elect Engn & Comp Sci, Columbia, MO 65211 USA
[4] Guizhou Univ, Coll Mech Engn, Guiyang 550025, Guizhou, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep feature embedding; handcrafted feature; image representation; deep metric learning; image retrieval; person re-identification; vehicle re-identification; FEATURE FUSION; IMAGE;
D O I
10.1109/TIP.2019.2901407
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image representation methods based on deep convolutional neural networks (CNNs) have achieved the state-of-theart performance in various computer vision tasks, such as image retrieval and person re-identification. We recognize that more discriminative feature embeddings can be learned with supervised deep metric learning and handcrafted features for image retrieval and similar applications. In this paper, we propose a new supervised deep feature embedding with a handcrafted feature model. To fuse handcrafted feature information into CNNs and realize feature embeddings, a general fusion unit is proposed (called Fusion-Net). We also define a network lass function with image label information to realize supervised deep metric learning. Our extensive experimental results on the Stanford online products' data set and the in-shop clothes retrieval data set demonstrate that our proposed methods outperform the existing state-of-the-art methods of image retrieval by a large margin. Moreover, we also explore the applications of the proposed methods in person re-identification and vehicle re-identification; the experimental results demonstrate both the effectiveness and efficiency of the proposed methods.
引用
收藏
页码:5809 / 5823
页数:15
相关论文
共 63 条
  • [1] Akilan T, 2017, IEEE GLOB CONF SIG, P1195, DOI 10.1109/GlobalSIP.2017.8309150
  • [2] [Anonymous], IEEE T PATTERN ANAL
  • [3] [Anonymous], 2018, IEEE CVPRW
  • [4] [Anonymous], 2014, ICCV WORKSH
  • [5] [Anonymous], P IEEE COMP SOC C CO
  • [6] [Anonymous], P BRIT MACH VIS C BM
  • [7] [Anonymous], 2008, Introduction to information retrieval
  • [8] [Anonymous], PROC CVPR IEEE
  • [9] [Anonymous], P IEEE INT C COMP VI
  • [10] Bai Y, 2017, IEEE INT CON MULTI, P1452, DOI 10.1109/ICME.2017.8019371