Maritime vessel re-identification: novel VR-VCA dataset and a multi-branch architecture MVR-net

被引:16
作者
Ghahremani, Amir [1 ]
Alkanat, Tunc [1 ]
Bondarev, Egor [1 ]
de With, Peter H. N. [1 ]
机构
[1] Eindhoven Univ Technol TU E, Video Coding & Architectures VCA Grp, Dept Elect Engn, Eindhoven, North Brabant, Netherlands
基金
欧盟地平线“2020”;
关键词
Maritime surveillance; Deep learning; CNNs; Image retrieval; Maritime vessel re-identification; ILLEGAL;
D O I
10.1007/s00138-021-01199-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Maritime vessel re-identification (re-ID) is a computer vision task of vessel identity matching across disjoint camera views. Prominent applications of vessel re-ID exist in the fields of surveillance and maritime traffic flow analysis. However, the field suffers from the absence of a large-scale dataset that enables training of deep learning models. In this study, we present a new dataset that includes 4614 images of 729 vessels along with 5-bin orientation and 8-class vessel-type annotations to promote further research. A second contribution of this study is the baseline re-ID analysis of our new dataset. Performances of 10 recent deep learning architectures are quantitatively compared to reveal the best practices. Lastly, we propose a novel multi-branch deep learning architecture, Maritime Vessel Re-ID network (MVR-net), to address the challenging problem of vessel re-ID. Evaluation of our approach on the new dataset yields 74.5% mAP and 77.9% Rank-1 score, providing a performance increase of 5.7% mAP and 5.0% Rank-1 over the best-performing baseline. MVR-net also outperforms the PRN (a pioneering vehicle re-ID network), by 2.9% and 4.3% higher mAP and Rank-1, respectively.
引用
收藏
页数:14
相关论文
共 35 条
[11]  
Hermans Alexander, 2017, Defense of the Triplet loss
[12]   Person Re-Identification by Efficient Impostor-based Metric Learning [J].
Hirzer, Martin ;
Roth, Peter M. ;
Bischof, Horst .
2012 IEEE NINTH INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL-BASED SURVEILLANCE (AVSS), 2012, :203-208
[13]  
Jungling Kai., 2011, COMPUTER VISION PATT, P55, DOI 10.1109/CVPRW.2011.5981771
[14]   Human Semantic Parsing for Person Re-identification [J].
Kalayeh, Mahdi M. ;
Basaran, Emrah ;
Gokmen, Muhittin ;
Kamasak, Mustafa E. ;
Shah, Mubarak .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1062-1071
[15]   A survey of advances in vision-based vehicle re-identification [J].
Khan, Sultan Daud ;
Ullah, Habib .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 182 :50-63
[16]  
Kingma DP, 2014, ADV NEUR IN, V27
[17]   A Cellular Automata-based Healthcare Data Encryption Technique for IoT Networks [J].
Kumar, Ritesh ;
Khan, Pritam ;
Kumar, Sudhir .
2019 IEEE 16TH INDIA COUNCIL INTERNATIONAL CONFERENCE (IEEE INDICON 2019), 2019,
[18]   Harmonious Attention Network for Person Re-Identification [J].
Li, Wei ;
Zhu, Xiatian ;
Gong, Shaogang .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :2285-2294
[19]  
Liao SC, 2015, PROC CVPR IEEE, P2197, DOI 10.1109/CVPR.2015.7298832
[20]  
Ma BP, 2012, LECT NOTES COMPUT SC, V7583, P413, DOI 10.1007/978-3-642-33863-2_41