Self-Supervised Marine Organism Detection From Underwater Images

被引:0
作者
Li, Jiahua [1 ]
Yang, Wentao [1 ]
Qiao, Shishi [1 ]
Gu, Zhaorui [1 ]
Zheng, Bing [1 ,2 ]
Zheng, Haiyong [1 ]
机构
[1] Ocean Univ China, Coll Elect Engn, Qingdao 266404, Peoples R China
[2] Ocean Univ China, Sanya Oceanog Inst, Sanya 572025, Peoples R China
基金
中国国家自然科学基金;
关键词
Data augmentation; marine organism detection (MOD); self-supervised learning; underwater image; visual attention; VISUAL-ATTENTION; ENHANCEMENT; MODEL; NETWORKS;
D O I
10.1109/JOE.2024.3455565
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
In recent years, in light of the significant progress in deep learning on general object detection, research on marine organism detection has become increasingly popular. However, manual annotation of marine organism images usually requires specialized expertise, resulting in a scarcity of labeled data for research purposes. In addition, the complex and dynamic marine environment leads to varying degrees of light absorption and scattering, causing severe degradation issues in the collected images. These factors hinder the acquisition of high-quality representations for subsequent detection objectives. To overcome the reliance on annotated marine data sets and derive high-quality representations from extensive unlabeled and degraded data, we propose a self-supervised marine organism detection (SMOD) framework. To the best of the authors' knowledge, it is the first time that self-supervised learning has been introduced into the task of marine organism object detection. Specifically, in order to improve the quality of learned image representation from degraded data, a set of underwater augmentation strategies to improve the perceptional quality of underwater images is designed. To further address the challenging issue posed by numerous marine objects and diverse backgrounds, an underwater attention module is elaborately devised such that the model prioritizes objects over backgrounds during representation learning. Experimental results on URPC2021 data set show that our SMOD achieves competitive performance in the marine organism object detection task.
引用
收藏
页码:120 / 135
页数:16
相关论文
共 89 条
[1]  
Bahdanau D, 2016, Arxiv, DOI arXiv:1409.0473
[2]  
Balestriero R., 2023, ARXIV
[3]   Improved fish detection in data from split-beam sonar [J].
Balk, H ;
Lindem, T .
AQUATIC LIVING RESOURCES, 2000, 13 (05) :297-303
[4]  
Bao H., 2022, P INT C LEARN REPR
[5]   A Fully Automated Method to Detect and Segment a Manufactured Object in an Underwater Color Image [J].
Barat, Christian ;
Phlypo, Ronald .
EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2010,
[6]  
Bazeille S., 2007, P C DET CLASS UND TA, P1
[7]   Cascade R-CNN: High Quality Object Detection and Instance Segmentation [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1483-1498
[8]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[9]  
Caron M, 2020, ADV NEUR IN, V33
[10]   Pre-Trained Image Processing Transformer [J].
Chen, Hanting ;
Wang, Yunhe ;
Guo, Tianyu ;
Xu, Chang ;
Deng, Yiping ;
Liu, Zhenhua ;
Ma, Siwei ;
Xu, Chunjing ;
Xu, Chao ;
Gao, Wen .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :12294-12305