Self-Supervised Marine Video Analysis via Siamese Network

被引:0
|
作者
Liang, Ju [1 ]
Song, Jihan [1 ,2 ]
Li, Qianqian [1 ]
Shi, Zhensheng [1 ,3 ]
Gu, Zhaorui [1 ]
Zheng, Haiyong [1 ]
Zheng, Bing [1 ,4 ]
机构
[1] Ocean Univ China, Underwater Vis Lab Ouc Ai, Qingdao, Peoples R China
[2] Ocean Univ China, Coll Informat Sci & Engn, Qingdao, Peoples R China
[3] Ocean Univ China, Frontiers Sci Ctr Deep Ocean Multispheres & Earth, Qingdao, Peoples R China
[4] Ocean Univ China, Sanya Oceanog Inst, Qingdao, Peoples R China
基金
中国国家自然科学基金;
关键词
Self-supervised learning; Marine video analysis; Siamese network; Marine organism detection; Marine scene recognition; Marine organism action recognition; SCENE;
D O I
暂无
中图分类号
U6 [水路运输]; P75 [海洋工程];
学科分类号
0814 ; 081505 ; 0824 ; 082401 ;
摘要
At present, advanced equipment has provided strong data support for marine scientific research. However, it is unrealistic to rely on manpower analysis to analyze the huge amount of data. Therefore, it is an effective and good method to use computer vision method to automatically identify and analyze marine video. In this paper, a self-supervised learning method based on siamese network is designed to learn the effective visual representation in marine unlabeled video, and the model is transferred to three downstream tasks: marine organism action recognition, marine organism detection, and marine scene recognition. We are on the latest dataset to experiment to evaluation the effectiveness of our method. Experimental results show that our method has certain competitiveness and effectiveness in the three downstream tasks.
引用
收藏
页数:7
相关论文
共 50 条
  • [21] Self-supervised video object segmentation via pseudo label rectification
    Guo, Pinxue
    Zhang, Wei
    Li, Xiaoqiang
    Fan, Jianping
    Zhang, Wenqiang
    PATTERN RECOGNITION, 2025, 163
  • [22] Siamese Image Modeling for Self-Supervised Vision Representation Learning
    Tao, Chenxin
    Zhu, Xizhou
    Su, Weijie
    Huang, Gao
    Li, Bin
    Zhou, Jie
    Qiao, Yu
    Wang, Xiaogang
    Dai, Jifeng
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 2132 - 2141
  • [23] A Self-Supervised Learning Solution With Momentum-Based Siamese Network for Robotic Visual Task
    Huang, Yuehong
    Tseng, Yu-Chee
    IEEE ACCESS, 2023, 11 : 112764 - 112775
  • [24] S2SiamFC: Self-supervised Fully Convolutional Siamese Network for Visual Tracking
    Sio, Chon Hou
    Ma, Yu-Jen
    Shuai, Hong-Han
    Chen, Jun-Cheng
    Cheng, Wen-Huang
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1948 - 1957
  • [25] Enhanced intertrace variations extraction via a self-supervised network for prestack seismic analysis
    Fei, Yifeng
    Cai, Hanpeng
    He, Xin
    Liang, Jiandong
    Li, Dajun
    Hu, Guangmin
    GEOPHYSICS, 2025, 90 (02) : A9 - A13
  • [26] Network-to-Network: Self-Supervised Network Representation Learning via Position Prediction
    Liu, Jie
    Zhang, Chunhai
    He, Zhicheng
    Zhang, Wenzheng
    Li, Na
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (03) : 1354 - 1365
  • [27] Self-Supervised Video Desmoking for Laparoscopic Surgery
    Wul, Renlong
    Zhang, Zhilu
    Zhang, Shuohao
    Guo, Longfei
    Chen, Haobin
    Zhang, Lei
    Chen, Hao
    Zu, Wangmeng
    COMPUTER VISION - ECCV 2024, PT LXXII, 2025, 15130 : 307 - 324
  • [28] DSS-Net: Dynamic Self-Supervised Network for Video Anomaly Detection
    Wu, Peihao
    Wang, Wenqian
    Chang, Faliang
    Liu, Chunsheng
    Wang, Bin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 2124 - 2136
  • [29] SELF-SUPERVISED REPRESENTATION LEARNING FOR ULTRASOUND VIDEO
    Jiao, Jianbo
    Droste, Richard
    Drukker, Lior
    Papageorghiou, Aris T.
    Noble, J. Alison
    2020 IEEE 17TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2020), 2020, : 1847 - 1850
  • [30] Self-supervised Amodal Video Object Segmentation
    Yao, Jian
    Hong, Yuxin
    Wang, Chiyu
    Xiao, Tianjun
    He, Tong
    Locatello, Francesco
    Wipf, David
    Fu, Yanwei
    Zhang, Zheng
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 35 (NEURIPS 2022), 2022,