Self-Supervised Marine Video Analysis via Siamese Network

被引:0
作者
Liang, Ju [1 ]
Song, Jihan [1 ,2 ]
Li, Qianqian [1 ]
Shi, Zhensheng [1 ,3 ]
Gu, Zhaorui [1 ]
Zheng, Haiyong [1 ]
Zheng, Bing [1 ,4 ]
机构
[1] Ocean Univ China, Underwater Vis Lab Ouc Ai, Qingdao, Peoples R China
[2] Ocean Univ China, Coll Informat Sci & Engn, Qingdao, Peoples R China
[3] Ocean Univ China, Frontiers Sci Ctr Deep Ocean Multispheres & Earth, Qingdao, Peoples R China
[4] Ocean Univ China, Sanya Oceanog Inst, Qingdao, Peoples R China
来源
OCEANS 2021: SAN DIEGO - PORTO | 2021年
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Marine video analysis; Siamese network; Marine organism detection; Marine scene recognition; Marine organism action recognition; SCENE;
D O I
暂无
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
At present, advanced equipment has provided strong data support for marine scientific research. However, it is unrealistic to rely on manpower analysis to analyze the huge amount of data. Therefore, it is an effective and good method to use computer vision method to automatically identify and analyze marine video. In this paper, a self-supervised learning method based on siamese network is designed to learn the effective visual representation in marine unlabeled video, and the model is transferred to three downstream tasks: marine organism action recognition, marine organism detection, and marine scene recognition. We are on the latest dataset to experiment to evaluation the effectiveness of our method. Experimental results show that our method has certain competitiveness and effectiveness in the three downstream tasks.
引用
收藏
页数:7
相关论文
共 42 条
[1]  
[Anonymous], 2014, Overfeat: integrated recognition, localization and detection using convolutional networks
[2]  
[Anonymous], INTRO STAT PATTERN R
[3]  
Bachman P, 2019, ADV NEUR IN, V32
[4]   Improved fish detection in data from split-beam sonar [J].
Balk, H ;
Lindem, T .
AQUATIC LIVING RESOURCES, 2000, 13 (05) :297-303
[5]  
Bromley J., 1993, International Journal of Pattern Recognition and Artificial Intelligence, V7, P669, DOI 10.1142/S0218001493000339
[6]   Cascade R-CNN: High Quality Object Detection and Instance Segmentation [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1483-1498
[7]  
Caron Mathilde, 2020, CORR
[8]  
Chen G., 2017, HIERARCHICAL LEARNIN
[9]  
Chen T., 2020, P 37 INT C MACH LEAR, P1597, DOI DOI 10.48550/ARXIV.2002.05709
[10]  
Chen X., 2021, arXiv preprint arXiv:2104.02057