Maritime vessel re-identification: novel VR-VCA dataset and a multi-branch architecture MVR-net

被引:16
作者
Ghahremani, Amir [1 ]
Alkanat, Tunc [1 ]
Bondarev, Egor [1 ]
de With, Peter H. N. [1 ]
机构
[1] Eindhoven Univ Technol TU E, Video Coding & Architectures VCA Grp, Dept Elect Engn, Eindhoven, North Brabant, Netherlands
基金
欧盟地平线“2020”;
关键词
Maritime surveillance; Deep learning; CNNs; Image retrieval; Maritime vessel re-identification; ILLEGAL;
D O I
10.1007/s00138-021-01199-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Maritime vessel re-identification (re-ID) is a computer vision task of vessel identity matching across disjoint camera views. Prominent applications of vessel re-ID exist in the fields of surveillance and maritime traffic flow analysis. However, the field suffers from the absence of a large-scale dataset that enables training of deep learning models. In this study, we present a new dataset that includes 4614 images of 729 vessels along with 5-bin orientation and 8-class vessel-type annotations to promote further research. A second contribution of this study is the baseline re-ID analysis of our new dataset. Performances of 10 recent deep learning architectures are quantitatively compared to reveal the best practices. Lastly, we propose a novel multi-branch deep learning architecture, Maritime Vessel Re-ID network (MVR-net), to address the challenging problem of vessel re-ID. Evaluation of our approach on the new dataset yields 74.5% mAP and 77.9% Rank-1 score, providing a performance increase of 5.7% mAP and 5.0% Rank-1 over the best-performing baseline. MVR-net also outperforms the PRN (a pioneering vehicle re-ID network), by 2.9% and 4.3% higher mAP and Rank-1, respectively.
引用
收藏
页数:14
相关论文
共 35 条
[1]  
[Anonymous], 2006, CVPR
[2]   Maritime transportation of illegal drugs from South America [J].
Atkinson, Michael P. ;
Kress, Moshe ;
Szechtman, Roberto .
INTERNATIONAL JOURNAL OF DRUG POLICY, 2017, 39 :43-51
[3]  
Bak Slawomir, 2010, Proceedings 7th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS 2010), P435, DOI 10.1109/AVSS.2010.34
[4]   Symmetry-driven accumulation of local features for human characterization and re-identification [J].
Bazzani, Loris ;
Cristani, Marco ;
Murino, Vittorio .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2013, 117 (02) :130-144
[5]   A survey of approaches and trends in person re-identification [J].
Bedagkar-Gala, Apurva ;
Shah, Shishir K. .
IMAGE AND VISION COMPUTING, 2014, 32 (04) :270-286
[6]  
Chen H., 2019, P IEEE COMPUTER SOC, P184, DOI DOI 10.1109/ICIP46576.2022.9897541
[7]   Beyond triplet loss: a deep quadruplet network for person re-identification [J].
Chen, Weihua ;
Chen, Xiaotang ;
Zhang, Jianguo ;
Huang, Kaiqi .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1320-1329
[8]   Project Catch: A space based solution to combat illegal, unreported and unregulated fishing Part I: Vessel monitoring system [J].
Detsis, Emmanouil ;
Brodsky, Yuval ;
Knudtson, Peter ;
Cuba, Manuel ;
Fuqua, Heidi ;
Szalai, Bianca .
ACTA ASTRONAUTICA, 2012, 80 :114-123
[9]   Towards Parameter-Optimized Vessel Re-identification Based on IORnet [J].
Ghahremani, Amir ;
Kong, Yitian ;
Bondarev, Egor ;
de With, Peter H. N. .
COMPUTATIONAL SCIENCE - ICCS 2019, PT V, 2019, 11540 :125-136
[10]  
Hamdoun O, 2008, 8 INT WORKSH VIS SUR