CLIB: Contrastive learning of ignoring background for underwater fish image classification

被引:0
|
作者
Yan, Qiankun [1 ,2 ]
Du, Xiujuan [1 ,2 ,3 ]
Li, Chong [1 ,2 ]
Tian, Xiaojing [1 ,2 ]
机构
[1] Qinghai Normal Univ, Coll Comp, Xining, Peoples R China
[2] Qinghai Prov Key Lab IoT, Xining, Peoples R China
[3] State Key Lab Tibetan Intelligent Informat Proc &, Xining, Peoples R China
来源
FRONTIERS IN NEUROROBOTICS | 2024年 / 18卷
基金
中国国家自然科学基金;
关键词
underwater fish image classification; contrastive learning; deep learning; self-supervised visual representation learning; background noise; TEXTURE;
D O I
10.3389/fnbot.2024.1423848
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the problem that the existing methods are insufficient in dealing with the background noise anti-interference of underwater fish images, a contrastive learning method of ignoring background called CLIB for underwater fish image classification is proposed to improve the accuracy and robustness of underwater fish image classification. First, CLIB effectively separates the subject from the background in the image through the extraction module and applies it to contrastive learning by composing three complementary views with the original image. To further improve the adaptive ability of CLIB in complex underwater images, we propose a multi-view-based contrastive loss function, whose core idea is to enhance the similarity between the original image and the subject and maximize the difference between the subject and the background, making CLIB focus more on learning the core features of the subject during the training process, and effectively ignoring the interference of background noise. Experiments on the Fish4Knowledge, Fish-gres, WildFish-30, and QUTFish-89 public datasets show that our method performs well, with improvements of 1.43-6.75%, 8.16-8.95%, 13.1-14.82%, and 3.92-6.19%, respectively, compared with the baseline model, further validating the effectiveness of CLIB.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Underwater Image Enhancement With Cascaded Contrastive Learning
    Liu, Yi
    Jiang, Qiuping
    Wang, Xinyi
    Luo, Ting
    Zhou, Jingchun
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 1512 - 1525
  • [2] Prototypical contrastive learning for image classification
    Yang, Han
    Li, Jun
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (02): : 2059 - 2069
  • [3] Label contrastive learning for image classification
    Han Yang
    Jun Li
    Soft Computing, 2023, 27 : 13477 - 13486
  • [4] Prototypical contrastive learning for image classification
    Han Yang
    Jun Li
    Cluster Computing, 2024, 27 : 2059 - 2069
  • [5] Label contrastive learning for image classification
    Yang, Han
    Li, Jun
    SOFT COMPUTING, 2023, 27 (18) : 13477 - 13486
  • [6] Contrastive Learning Based on Transformer for Hyperspectral Image Classification
    Hu, Xiang
    Li, Teng
    Zhou, Tong
    Liu, Yu
    Peng, Yuanxi
    APPLIED SCIENCES-BASEL, 2021, 11 (18):
  • [7] Contrastive Learning Ideas in Underwater Terrain Image Matching
    Zhang, Feng
    Bian, Hongyu
    Wei, Mingzhe
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [8] Cross-Domain Contrastive Learning for Hyperspectral Image Classification
    Guan, Peiyan
    Lam, Edmund Y.
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [9] Twin Adversarial Contrastive Learning for Underwater Image Enhancement and Beyond
    Liu, Risheng
    Jiang, Zhiying
    Yang, Shuzhou
    Fan, Xin
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 4922 - 4936
  • [10] Foreground-Background Contrastive Learning for Few-Shot Remote Sensing Image Scene Classification
    Geng, Jie
    Xue, Bohan
    Jiang, Wen
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61