A gated cross-domain collaborative network for underwater object detection

被引:15
作者
Dai, Linhui [1 ]
Liu, Hong [1 ]
Song, Pinhao [2 ]
Liu, Mengyuan [1 ]
机构
[1] Peking Univ, Shenzhen Grad Sch, Key Lab Machine Percept, Shenzhen, Peoples R China
[2] Katholieke Univ Leuven, Robot Res Grp, Leuven, Belgium
基金
中国国家自然科学基金;
关键词
Underwater object detection; Underwater image enhancement; Cross-domain; IMAGE-ENHANCEMENT;
D O I
10.1016/j.patcog.2023.110222
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater object detection (UOD) plays a significant role in aquaculture and marine environmental protection. Considering the challenges posed by low contrast and low -light conditions in underwater environments, several underwater image enhancement (UIE) methods have been proposed to improve the quality of underwater images. However, only using the enhanced images does not improve the performance of UOD, since it may unavoidably remove or alter critical patterns and details of underwater objects. In contrast, we believe that exploring the complementary information from the two domains is beneficial for UOD. The raw image preserves the natural characteristics of the scene and texture information of the objects, while the enhanced image improves the visibility of underwater objects. Based on this perspective, we propose a Gated Cross -domain Collaborative Network (GCC-Net) to address the challenges of poor visibility and low contrast in underwater environments, which comprises three dedicated components. Firstly, a real-time UIE method is employed to generate enhanced images, which can improve the visibility of objects in low -contrast areas. Secondly, a cross -domain feature interaction module is introduced to facilitate the interaction and mine complementary information between raw and enhanced image features. Thirdly, to prevent the contamination of unreliable generated results, a gated feature fusion module is proposed to adaptively control the fusion ratio of cross -domain information. Our method presents a new UOD paradigm from the perspective of cross -domain information interaction and fusion. Experimental results demonstrate that the proposed GCC-Net achieves state-of-the-art performance on four underwater datasets.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Sea-thru: A Method For Removing Water From Underwater Images
    Akkaynak, Derya
    Treibitz, Tali
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 1682 - 1691
  • [2] Cascade R-CNN: Delving into High Quality Object Detection
    Cai, Zhaowei
    Vasconcelos, Nuno
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 6154 - 6162
  • [3] Chen K, 2019, Arxiv, DOI [arXiv:1906.07155, DOI 10.48550/ARXIV.1906.07155]
  • [4] SWIPENET: Object detection in noisy underwater scenes
    Chen, Long
    Zhou, Feixiang
    Wang, Shengke
    Dong, Junyu
    Li, Ning
    Ma, Haiping
    Wang, Xin
    Zhou, Huiyu
    [J]. PATTERN RECOGNITION, 2022, 132
  • [5] Chen XY, 2020, Arxiv, DOI arXiv:2003.01913
  • [6] Achieving domain generalization for underwater object detection by domain mixup and contrastive learning
    Chen, Yang
    Song, Pinhao
    Liu, Hong
    Dai, Linhui
    Zhang, Xiaochuan
    Ding, Runwei
    Li, Shengquan
    [J]. NEUROCOMPUTING, 2023, 528 : 20 - 34
  • [7] Underwater Image Enhancement by Wavelength Compensation and Dehazing
    Chiang, John Y.
    Chen, Ying-Ching
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2012, 21 (04) : 1756 - 1769
  • [8] Dai LH, 2023, Arxiv, DOI arXiv:2306.00440
  • [9] AO2-DETR: Arbitrary-Oriented Object Detection Transformer
    Dai, Linhui
    Liu, Hong
    Tang, Hao
    Wu, Zhiwei
    Song, Pinhao
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2342 - 2356
  • [10] Underwater image enhancement via integrated RGB and LAB color models
    Dong, Lili
    Zhang, Weidong
    Xu, Wenhai
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 2022, 104