Fine-grained Feature Alignment with Part Perspective Transformation for Vehicle ReID

被引:35
作者
Meng, Dechao [1 ,2 ]
Li, Liang [1 ]
Wang, Shuhui [1 ]
Gao, Xingyu [3 ]
Zha, Zheng-Jun [4 ]
Huang, Qingming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Microelect, Beijing, Peoples R China
[4] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei, Peoples R China
来源
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA | 2020年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
vehicle ReID; computer vision; feature alignment; perspective transformation; REIDENTIFICATION;
D O I
10.1145/3394171.3413573
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given a query image, vehicle Re-Identification is to search the same vehicle in multi-camera scenarios, which are attracting much attention in recent years. However, vehicle ReID severely suffers from the perspective variation problem. For different vehicles with similar color and type which are taken from different perspectives, all visual patterns are misaligned and warped, which is hard for the model to find out the exact discriminative regions. In this paper, we propose part perspective transformation module (PPT) to map the different parts of vehicle into a unified perspective respectively. The PPT disentangles the vehicle features of different perspectives and then aligns them in a fine-grained level. Further, we propose a dynamically batch hard triplet loss to select the common visible regions of the compared vehicles. Our approach helps the model to generate the perspective invariant features and find out the exact distinguishable regions for vehicle ReID. Extensive experiments on three standard vehicle ReID datasets show the effectiveness of our method.
引用
收藏
页码:619 / 627
页数:9
相关论文
共 41 条
[1]   Group-Sensitive Triplet Embedding for Vehicle Reidentification [J].
Bai, Yan ;
Lou, Yihang ;
Gao, Feng ;
Wang, Shiqi ;
Wu, Yuwei ;
Duan, Ling-Yu .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) :2385-2399
[2]   Vehicle Re-identification with Viewpoint-aware Metric Learning [J].
Chu, Ruihang ;
Sun, Yifan ;
Li, Yadong ;
Liu, Zheng ;
Zhang, Chi ;
Wei, Yichen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8281-8290
[3]   Supervised Transformer Network for Efficient Face Detection [J].
Chen, Dong ;
Hua, Gang ;
Wen, Fang ;
Sun, Jian .
COMPUTER VISION - ECCV 2016, PT V, 2016, 9909 :122-138
[4]  
Guo HY, 2018, AAAI CONF ARTIF INTE, P6853
[5]   Part-regularized Near-duplicate Vehicle Re-identification [J].
He, Bing ;
Li, Jia ;
Zhao, Yifan ;
Tian, Yonghong .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3992-4000
[6]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[7]   Foreground-aware Pyramid Reconstruction for Alignment-free Occluded Person Re-identification [J].
He, Lingxiao ;
Wang, Yinggang ;
Liu, Wu ;
Zhao, He ;
Sun, Zhenan ;
Feng, Jiashi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :8449-8458
[8]  
Hermans A, 2017, ARXIV
[9]  
Jaderberg M, 2015, ADV NEUR IN, V28
[10]   Pose-Invariant Face Alignment via CNN-Based Dense 3D Model Fitting [J].
Jourabloo, Amin ;
Liu, Xiaoming .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 124 (02) :187-203