Fine-grained Feature Alignment with Part Perspective Transformation for Vehicle ReID

被引:35
作者
Meng, Dechao [1 ,2 ]
Li, Liang [1 ]
Wang, Shuhui [1 ]
Gao, Xingyu [3 ]
Zha, Zheng-Jun [4 ]
Huang, Qingming [1 ,2 ]
机构
[1] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing, Peoples R China
[2] Univ Chinese Acad Sci, Sch Comp Sci & Technol, Beijing, Peoples R China
[3] Chinese Acad Sci, Inst Microelect, Beijing, Peoples R China
[4] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei, Peoples R China
来源
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA | 2020年
基金
国家重点研发计划; 中国国家自然科学基金;
关键词
vehicle ReID; computer vision; feature alignment; perspective transformation; REIDENTIFICATION;
D O I
10.1145/3394171.3413573
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Given a query image, vehicle Re-Identification is to search the same vehicle in multi-camera scenarios, which are attracting much attention in recent years. However, vehicle ReID severely suffers from the perspective variation problem. For different vehicles with similar color and type which are taken from different perspectives, all visual patterns are misaligned and warped, which is hard for the model to find out the exact discriminative regions. In this paper, we propose part perspective transformation module (PPT) to map the different parts of vehicle into a unified perspective respectively. The PPT disentangles the vehicle features of different perspectives and then aligns them in a fine-grained level. Further, we propose a dynamically batch hard triplet loss to select the common visible regions of the compared vehicles. Our approach helps the model to generate the perspective invariant features and find out the exact distinguishable regions for vehicle ReID. Extensive experiments on three standard vehicle ReID datasets show the effectiveness of our method.
引用
收藏
页码:619 / 627
页数:9
相关论文
共 41 条
[11]   Inverse Compositional Spatial Transformer Networks [J].
Lin, Chen-Hsuan ;
Lucey, Simon .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2252-2260
[12]   Deep Relative Distance Learning: Tell the Difference Between Similar Vehicles [J].
Liu, Hongye ;
Tian, Yonghong ;
Wang, Yaowei ;
Pang, Lu ;
Huang, Tiejun .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :2167-2175
[13]   Beyond Human-level License Plate Super-resolution with Progressive Vehicle Search and Domain Priori GAN [J].
Liu, Wu ;
Liu, Xinchen ;
Ma, Huadong ;
Cheng, Peng .
PROCEEDINGS OF THE 2017 ACM MULTIMEDIA CONFERENCE (MM'17), 2017, :1618-1626
[14]  
Liu XB, 2018, IEEE INT CON MULTI
[15]  
Liu XC, 2016, IEEE INT CON MULTI
[16]   PROVID: Progressive and Multimodal Vehicle Reidentification for Large-Scale Urban Surveillance [J].
Liu, Xinchen ;
Liu, Wu ;
Mei, Tao ;
Ma, Huadong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (03) :645-658
[17]   Adaptive Reconstruction Network for Weakly Supervised Referring Expression Grounding [J].
Liu, Xuejing ;
Li, Liang ;
Wang, Shuhui ;
Zha, Zheng-Jun ;
Meng, Dechao ;
Huang, Qingming .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :2611-2620
[18]   VERI-Wild: A Large Dataset and a New Method for Vehicle Re-Identification in the Wild [J].
Lou, Yihang ;
Bai, Yan ;
Liu, Jun ;
Wang, Shiqi ;
Duan, Ling-Yu .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3230-3238
[19]   Embedding Adversarial Learning for Vehicle Re-Identification [J].
Lou, Yihang ;
Bai, Yan ;
Liu, Jun ;
Wang, Shiqi ;
Duan, Ling-Yu .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (08) :3794-3807
[20]   Bag of Tricks and A Strong Baseline for Deep Person Re-identification [J].
Luo, Hao ;
Gu, Youzhi ;
Liao, Xingyu ;
Lai, Shenqi ;
Jiang, Wei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), 2019, :1487-1495