Self-Supervised Underwater Image Generation for Underwater Domain Pre-Training

被引:3
作者
Wu, Zhiheng [1 ,2 ]
Wu, Zhengxing [1 ,2 ]
Chen, Xingyu [3 ]
Lu, Yue [1 ,2 ]
Yu, Junzhi [3 ]
机构
[1] Chinese Acad Sci, Inst Automat, Lab Cognit & Decis Intelligence Complex Syst, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Peking Univ, Coll Engn, Dept Adv Mfg & Robot, State Key Lab Turbulence & Complex Syst,BIC ESAT, Beijing 100871, Peoples R China
基金
北京市自然科学基金;
关键词
Object detection; pre-training; self-supervised learning; semantic segmentation; underwater image generation;
D O I
10.1109/TIM.2024.3373105
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The rapid progress in computer vision has presented new opportunities for enhancing the visual capabilities of underwater robots. However, most deep learning-based visual perception algorithms often underperform due to the scarcity of underwater datasets. To address this issue, we propose an underwater image synthesis method for pre-training in the underwater domain. By leveraging self-supervised learning, we simulate the physical imaging process of underwater scenes, allowing for style transfer from in-air images to underwater images using a reduced amount of underwater data. Furthermore, we propose a pre-training strategy that utilizes synthetic underwater images to enhance underwater visual perception. Finally, abundant experiments are conducted, including quantitative and qualitative comparisons. The results validate the effectiveness and superiority of the proposed underwater image synthesis method, highlighting the substantial improvement in underwater environment perception achieved through the underwater domain pre-training (UDP) strategy.
引用
收藏
页码:1 / 14
页数:14
相关论文
共 47 条
[1]   Sea-thru: A Method For Removing Water From Underwater Images [J].
Akkaynak, Derya ;
Treibitz, Tali .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1682-1691
[2]  
Anwar S, 2018, Arxiv, DOI arXiv:1807.03528
[3]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[4]   Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset [J].
Carreira, Joao ;
Zisserman, Andrew .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4724-4733
[5]   Sparus II AUV-A Hovering Vehicle for Seabed Inspection [J].
Carreras, Marc ;
David Hernandez, Juan ;
Vidal, Eduard ;
Palomeras, Narcis ;
Ribas, David ;
Ridao, Pere .
IEEE JOURNAL OF OCEANIC ENGINEERING, 2018, 43 (02) :344-355
[6]  
Chen K, 2019, Arxiv, DOI arXiv:1906.07155
[7]  
Chen LC, 2017, Arxiv, DOI arXiv:1706.05587
[8]   Towards Real-Time Advancement of Underwater Visual Quality With GAN [J].
Chen, Xingyu ;
Yu, Junzhi ;
Kong, Shihan ;
Wu, Zhengxing ;
Fang, Xi ;
Wen, Li .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (12) :9350-9359
[9]   Domain Adaptive Faster R-CNN for Object Detection in the Wild [J].
Chen, Yuhua ;
Li, Wen ;
Sakaridis, Christos ;
Dai, Dengxin ;
Van Gool, Luc .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3339-3348
[10]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848