PATReId: Pose Apprise Transformer Network for Vehicle Re-Identification

被引:5
作者
Kishore, Rishi [1 ]
Aslam, Nazia [1 ]
Kolekar, Maheshkumar H. [1 ]
机构
[1] Indian Inst Technol, Dept Elect Engn, Patna 801106, India
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 05期
关键词
Vehicle re-identification; vision transformer; vehicle pose estimation; triplet loss;
D O I
10.1109/TETCI.2024.3372391
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicle re-identification is a procedure for identifying a vehicle using multiple non-overlapping cameras. The use of licence plates for re-identification have constraints because a licence plates may not be seen owing to viewpoint differences. Also, the high intra-class variability (due to the shape and appearance from different angles) and small inter-class variability (due to the similarity in appearance and shapes of vehicles from different manufacturers) make it more challenging. To address these issues, we have proposed a novel PATReId, Pose Apprise Transformer network for Vehicle Re-identification. This network works two-fold: 1) generating the poses of the vehicles using the heatmap, keypoints, and segments, which eliminate the viewpoint dependencies, and 2) jointly classify the attributes of the vehicles (colour and type) while performing ReId by utilizing the multitask learning through a two-stream neural network-integrated with the pose. The vision transformer and ResNet50 networks are employed to create the two-stream neural network. Extensive experiments have been conducted on Veri776, VehicleID and Veri Wild datasets to demonstrate the accuracy and efficacy of the proposed PATReId framework.
引用
收藏
页码:3691 / 3702
页数:12
相关论文
共 71 条
  • [61] Exploiting Multi-Grain Ranking Constraints for Precisely Searching Visually-similar Vehicles
    Yan, Ke
    Tian, Yonghong
    Wang, Yaowei
    Zeng, Wei
    Huang, Tiejun
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 562 - 570
  • [62] Yang LJ, 2015, PROC CVPR IEEE, P3973, DOI 10.1109/CVPR.2015.7299023
  • [63] Yang XL, 2019, IEEE IMAGE PROC, P3113, DOI 10.1109/ICIP.2019.8803246
  • [64] Hard-Aware Deeply Cascaded Embedding
    Yuan, Yuhui
    Yang, Kuiyuan
    Zhang, Chao
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 814 - 823
  • [65] Zhang YH, 2017, IEEE INT CON MULTI, P1386, DOI 10.1109/ICME.2017.8019491
  • [66] Person Re-Identification Based on Heterogeneous Part-Based Deep Network in Camera Networks
    Zhang, Zhong
    Huang, Meiyan
    [J]. IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2020, 4 (01): : 51 - 60
  • [67] Structural Analysis of Attributes for Vehicle Re-Identification and Retrieval
    Zhao, Yanzhu
    Shen, Chunhua
    Wang, Huibing
    Chen, Shengyong
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (02) : 723 - 734
  • [68] Vehicle Re-identification by Adversarial Bi-directional LSTM Network
    Zhou, Yi
    Shao, Ling
    [J]. 2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, : 653 - 662
  • [69] Viewpoint-aware Attentive Multi-view Inference for Vehicle Re-identification
    Zhou, Yi
    Shao, Ling
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : CP99 - CP99
  • [70] Vehicle Re-Identification Using Quadruple Directional Deep Learning Features
    Zhu, Jianqing
    Zeng, Huanqiang
    Huang, Jingchang
    Liao, Shengcai
    Lei, Zhen
    Cai, Canhui
    Zheng, Lixin
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (01) : 410 - 420