CLIB: Contrastive learning of ignoring background for underwater fish image classification

被引:0
|
作者
Yan, Qiankun [1 ,2 ]
Du, Xiujuan [1 ,2 ,3 ]
Li, Chong [1 ,2 ]
Tian, Xiaojing [1 ,2 ]
机构
[1] Qinghai Normal Univ, Coll Comp, Xining, Peoples R China
[2] Qinghai Prov Key Lab IoT, Xining, Peoples R China
[3] State Key Lab Tibetan Intelligent Informat Proc &, Xining, Peoples R China
来源
FRONTIERS IN NEUROROBOTICS | 2024年 / 18卷
基金
中国国家自然科学基金;
关键词
underwater fish image classification; contrastive learning; deep learning; self-supervised visual representation learning; background noise; TEXTURE;
D O I
10.3389/fnbot.2024.1423848
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Aiming at the problem that the existing methods are insufficient in dealing with the background noise anti-interference of underwater fish images, a contrastive learning method of ignoring background called CLIB for underwater fish image classification is proposed to improve the accuracy and robustness of underwater fish image classification. First, CLIB effectively separates the subject from the background in the image through the extraction module and applies it to contrastive learning by composing three complementary views with the original image. To further improve the adaptive ability of CLIB in complex underwater images, we propose a multi-view-based contrastive loss function, whose core idea is to enhance the similarity between the original image and the subject and maximize the difference between the subject and the background, making CLIB focus more on learning the core features of the subject during the training process, and effectively ignoring the interference of background noise. Experiments on the Fish4Knowledge, Fish-gres, WildFish-30, and QUTFish-89 public datasets show that our method performs well, with improvements of 1.43-6.75%, 8.16-8.95%, 13.1-14.82%, and 3.92-6.19%, respectively, compared with the baseline model, further validating the effectiveness of CLIB.
引用
收藏
页数:14
相关论文
共 50 条
  • [21] Adversarial Domain Alignment With Contrastive Learning for Hyperspectral Image Classification
    Liu, Fang
    Gao, Wenfei
    Liu, Jia
    Tang, Xu
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [22] Supervised Contrastive Learning-Based Classification for Hyperspectral Image
    Huang, Lingbo
    Chen, Yushi
    He, Xin
    Ghamisi, Pedram
    REMOTE SENSING, 2022, 14 (21)
  • [23] Renal Pathological Image Classification Based on Contrastive and Transfer Learning
    Liu, Xinkai
    Zhu, Xin
    Tian, Xingjian
    Iwasaki, Tsuyoshi
    Sato, Atsuya
    Kazama, Junichiro James
    ELECTRONICS, 2024, 13 (07)
  • [24] SPATIAL-SPECTRAL CONTRASTIVE LEARNING FOR HYPERSPECTRAL IMAGE CLASSIFICATION
    Guan, Peiyan
    Lam, Edmund Y.
    2022 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2022), 2022, : 1372 - 1375
  • [25] Domain-Collaborative Contrastive Learning for Hyperspectral Image Classification
    Luo, Haiyang
    Qiao, Xueyi
    Xu, Yongming
    Zhong, Shengwei
    Gong, Chen
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21
  • [26] Source Model Selection for Transfer Learning of Image Classification using Supervised Contrastive Loss
    Cho, Young-Seong
    Kim, Samuel
    Lee, Jee-Hyong
    2021 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP 2021), 2021, : 325 - 329
  • [27] Underwater Image Fish Recognition Technology Based on Transfer Learning and Image Enhancement
    Yuan, Hongchun
    Zhang, Shuo
    Chen, Guanqi
    Yang, Yue
    JOURNAL OF COASTAL RESEARCH, 2020, : 124 - 128
  • [28] Multi-scale contrastive learning method for PolSAR image classification
    Hua, Wenqiang
    Wang, Chen
    Sun, Nan
    Liu, Lin
    JOURNAL OF APPLIED REMOTE SENSING, 2024, 18 (01)
  • [29] Multi-scale Contrastive Learning with Attention for Histopathology Image Classification
    Tan, Jing Wei
    Khoa Tuan Nguyen
    Lee, Kyoungbun
    Jeong, Won-Ki
    MEDICAL IMAGING 2023, 2023, 12471
  • [30] Clustering-Guided Twin Contrastive Learning for Endomicroscopy Image Classification
    Zhou, Jingjun
    Dong, Xiangjiang
    Liu, Qian
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (05) : 2879 - 2890