PATReId: Pose Apprise Transformer Network for Vehicle Re-Identification

被引:5
作者
Kishore, Rishi [1 ]
Aslam, Nazia [1 ]
Kolekar, Maheshkumar H. [1 ]
机构
[1] Indian Inst Technol, Dept Elect Engn, Patna 801106, India
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 05期
关键词
Vehicle re-identification; vision transformer; vehicle pose estimation; triplet loss;
D O I
10.1109/TETCI.2024.3372391
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicle re-identification is a procedure for identifying a vehicle using multiple non-overlapping cameras. The use of licence plates for re-identification have constraints because a licence plates may not be seen owing to viewpoint differences. Also, the high intra-class variability (due to the shape and appearance from different angles) and small inter-class variability (due to the similarity in appearance and shapes of vehicles from different manufacturers) make it more challenging. To address these issues, we have proposed a novel PATReId, Pose Apprise Transformer network for Vehicle Re-identification. This network works two-fold: 1) generating the poses of the vehicles using the heatmap, keypoints, and segments, which eliminate the viewpoint dependencies, and 2) jointly classify the attributes of the vehicles (colour and type) while performing ReId by utilizing the multitask learning through a two-stream neural network-integrated with the pose. The vision transformer and ResNet50 networks are employed to create the two-stream neural network. Extensive experiments have been conducted on Veri776, VehicleID and Veri Wild datasets to demonstrate the accuracy and efficacy of the proposed PATReId framework.
引用
收藏
页码:3691 / 3702
页数:12
相关论文
共 71 条
  • [1] Ansari JA, 2018, IEEE INT C INT ROBOT, P8404, DOI 10.1109/IROS.2018.8593698
  • [2] Bai Y, 2020, PROCEEDINGS OF THE TWENTY-NINTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P474
  • [3] Group-Sensitive Triplet Embedding for Vehicle Reidentification
    Bai, Yan
    Lou, Yihang
    Gao, Feng
    Wang, Shiqi
    Wu, Yuwei
    Duan, Ling-Yu
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (09) : 2385 - 2399
  • [4] Deep Meta Metric Learning
    Chen, Guangyi
    Zhang, Tianren
    Lu, Jiwen
    Zhou, Jie
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9546 - 9555
  • [5] Chen H., 2019, P CVPR WORKSH, P184, DOI DOI 10.1109/ICCE-BERLIN47944.2019.8966217
  • [6] Beyond triplet loss: a deep quadruplet network for person re-identification
    Chen, Weihua
    Chen, Xiaotang
    Zhang, Jianguo
    Huang, Kaiqi
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1320 - 1329
  • [7] Vehicle Re-identification with Viewpoint-aware Metric Learning
    Chu, Ruihang
    Sun, Yifan
    Li, Yadong
    Liu, Zheng
    Zhang, Chi
    Wei, Yichen
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 8281 - 8290
  • [8] Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
  • [9] Ge YX, 2020, ADV NEUR IN, V33
  • [10] Ge YX, 2020, Arxiv, DOI [arXiv:2001.01526, 10.48550/arXiv.2001.01526]