CLIB: Contrastive learning of ignoring background for underwater fish image classification

被引:0
|
作者
Yan, Qiankun [1 ,2 ]
Du, Xiujuan [1 ,2 ,3 ]
Li, Chong [1 ,2 ]
Tian, Xiaojing [1 ,2 ]
机构
[1] Qinghai Normal Univ, Coll Comp, Xining, Peoples R China
[2] Qinghai Prov Key Lab IoT, Xining, Peoples R China
[3] State Key Lab Tibetan Intelligent Informat Proc &, Xining, Peoples R China
来源
FRONTIERS IN NEUROROBOTICS | 2024年 / 18卷
基金
中国国家自然科学基金;
关键词
underwater fish image classification; contrastive learning; deep learning; self-supervised visual representation learning; background noise; TEXTURE;
D O I
10.3389/fnbot.2024.1423848
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the problem that the existing methods are insufficient in dealing with the background noise anti-interference of underwater fish images, a contrastive learning method of ignoring background called CLIB for underwater fish image classification is proposed to improve the accuracy and robustness of underwater fish image classification. First, CLIB effectively separates the subject from the background in the image through the extraction module and applies it to contrastive learning by composing three complementary views with the original image. To further improve the adaptive ability of CLIB in complex underwater images, we propose a multi-view-based contrastive loss function, whose core idea is to enhance the similarity between the original image and the subject and maximize the difference between the subject and the background, making CLIB focus more on learning the core features of the subject during the training process, and effectively ignoring the interference of background noise. Experiments on the Fish4Knowledge, Fish-gres, WildFish-30, and QUTFish-89 public datasets show that our method performs well, with improvements of 1.43-6.75%, 8.16-8.95%, 13.1-14.82%, and 3.92-6.19%, respectively, compared with the baseline model, further validating the effectiveness of CLIB.
引用
收藏
页数:14
相关论文
共 50 条
  • [11] GraphCLIP: Image-graph contrastive learning for multimodal artwork classification
    Scaringi, Raffaele
    Fiameni, Giuseppe
    Vessio, Gennaro
    Castellano, Giovanna
    KNOWLEDGE-BASED SYSTEMS, 2025, 310
  • [12] Background-focused contrastive learning for unpaired image-to-image translation
    Shao, Mingwen
    Han, Minggui
    Meng, Lingzhuang
    Liu, Fukang
    JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (04)
  • [13] Vision Transformer With Contrastive Learning for Hyperspectral Image Classification
    Zhou, Heng
    Zhang, Xin
    Zhang, Chunlei
    Ma, Qiaoyu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [14] sMoBYAL: Supervised Contrastive Active Learning for Image Classification
    Thanh Hong Dang
    Thanh Tung Nguyen
    Huy Quang Trinh
    Linh Bao Doan
    Toan Van Pham
    SIXTEENTH INTERNATIONAL CONFERENCE ON MACHINE VISION, ICMV 2023, 2024, 13072
  • [15] Deformable Convolutional Network Constrained by Contrastive Learning for Underwater Image Enhancement
    Tian, Jing
    Guo, Xinran
    Liu, Weifeng
    Tao, Dapeng
    Liu, Baodi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [16] A Simple Framework for Depth-Augmented Contrastive Learning for Endoscopic Image Classification
    Weng, Weihao
    Zhu, Xin
    Cheikh, Faouzi Alaya
    Ullah, Mohib
    Imaizumi, Mitsuyoshi
    Murono, Shigeyuki
    Kubota, Satoshi
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [17] Detection of Bone Metastases on Bone Scans through Image Classification with Contrastive Learning
    Hsieh, Te-Chun
    Liao, Chiung-Wei
    Lai, Yung-Chi
    Law, Kin-Man
    Chan, Pak-Ki
    Kao, Chia-Hung
    JOURNAL OF PERSONALIZED MEDICINE, 2021, 11 (12):
  • [18] Histopathology Image Classification Using Deep Manifold Contrastive Learning
    Tan, Jing Wei
    Jeong, Won-Ki
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION, MICCAI 2023, PT VI, 2023, 14225 : 683 - 692
  • [19] Mask-Enhanced Contrastive Learning for Hyperspectral Image Classification
    Cao, Xianghai
    Yu, Jiayu
    Xu, Ruijie
    Wei, Jiaxuan
    Jiao, Licheng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [20] PROTOTYPE GOVERNED CONTRASTIVE LEARNING FOR ROBUST IMAGE CLASSIFICATION IN HISTOPATHOLOGY
    Tinaikar, Aashay
    Raipuria, Geetank
    Singhal, Nitin
    2023 IEEE 20TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING, ISBI, 2023,