CLIB: Contrastive learning of ignoring background for underwater fish image classification

被引:0
|
作者
Yan, Qiankun [1 ,2 ]
Du, Xiujuan [1 ,2 ,3 ]
Li, Chong [1 ,2 ]
Tian, Xiaojing [1 ,2 ]
机构
[1] Qinghai Normal Univ, Coll Comp, Xining, Peoples R China
[2] Qinghai Prov Key Lab IoT, Xining, Peoples R China
[3] State Key Lab Tibetan Intelligent Informat Proc &, Xining, Peoples R China
来源
FRONTIERS IN NEUROROBOTICS | 2024年 / 18卷
基金
中国国家自然科学基金;
关键词
underwater fish image classification; contrastive learning; deep learning; self-supervised visual representation learning; background noise; TEXTURE;
D O I
10.3389/fnbot.2024.1423848
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the problem that the existing methods are insufficient in dealing with the background noise anti-interference of underwater fish images, a contrastive learning method of ignoring background called CLIB for underwater fish image classification is proposed to improve the accuracy and robustness of underwater fish image classification. First, CLIB effectively separates the subject from the background in the image through the extraction module and applies it to contrastive learning by composing three complementary views with the original image. To further improve the adaptive ability of CLIB in complex underwater images, we propose a multi-view-based contrastive loss function, whose core idea is to enhance the similarity between the original image and the subject and maximize the difference between the subject and the background, making CLIB focus more on learning the core features of the subject during the training process, and effectively ignoring the interference of background noise. Experiments on the Fish4Knowledge, Fish-gres, WildFish-30, and QUTFish-89 public datasets show that our method performs well, with improvements of 1.43-6.75%, 8.16-8.95%, 13.1-14.82%, and 3.92-6.19%, respectively, compared with the baseline model, further validating the effectiveness of CLIB.
引用
收藏
页数:14
相关论文
共 50 条
  • [41] Computer vision and deep learning for fish classification in underwater habitats: A survey
    Saleh, Alzayat
    Sheaves, Marcus
    Azghadi, Mostafa Rahimi
    FISH AND FISHERIES, 2022, 23 (04) : 977 - 999
  • [42] Deep Learning for Marine Bioacoustics and Fish Classification Using Underwater Sounds
    Laplante, Jean-Francois
    Akhloufi, Moulay A.
    Gervaise, Cedric
    2022 IEEE CANADIAN CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (CCECE), 2022, : 288 - 293
  • [43] Research on underwater fish image denoising method based on deep learning
    Xie, Yufeng
    Wu, Shuangle
    Wang, Lang
    Hu, Qiu
    2024 IEEE 19TH CONFERENCE ON INDUSTRIAL ELECTRONICS AND APPLICATIONS, ICIEA 2024, 2024,
  • [44] Weakly supervised pathological whole slide image classification based on contrastive learning
    Xie, Yining
    Long, Jun
    Hou, Jianxin
    Chen, Deyun
    Guan, Guohui
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (21) : 60809 - 60831
  • [45] LACL: Lesion-Aware Contrastive Learning Framework for Medical Image Classification
    Tang, Yu
    Yang, Gang
    Zhao, Jianchun
    Ding, Dayong
    Wu, Jun
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 966 - 971
  • [46] Negative Samples Mining Matters: Reconsidering Hyperspectral Image Classification With Contrastive Learning
    Liu, Hui
    Huang, Chenjia
    Chen, Ning
    Xie, Tao
    Lu, Mingyue
    Huang, Zhou
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [47] Progressive Contrastive Learning Based on Noisy Negatives Cleaning for Hyperspectral Image Classification
    Zhao, Lin
    Feng, Yang
    Dai, YuanJie
    Wu, Jianhui
    Zhang, Guoyun
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [48] ConVaT: A Variational Generative Transformer With Momentum Contrastive Learning for Hyperspectral Image Classification
    Liang, Miaomiao
    Liu, Zuo
    Dong, Jian
    Yu, Lingjuan
    Yu, Xiangchun
    Li, Jun
    Jiao, Licheng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [49] Domain Fusion Contrastive Learning for Cross-Scene Hyperspectral Image Classification
    Qiu, Zhao
    Xu, Jie
    Peng, Jiangtao
    Sun, Weiwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
  • [50] Contrastive prototype learning with semantic patchmix for few-shot image classification
    Dong, Mengping
    Lei, Fei
    Li, Zhenbo
    Liu, Xue
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 142