Semantic-aware representations for unsupervised Camouflaged Object Detection

被引:0
|
作者
Lu, Zelin [1 ]
Zhao, Xing [1 ]
Xie, Liang [1 ]
Liang, Haoran [1 ]
Liang, Ronghua [1 ]
机构
[1] Zhejiang Univ Technol, Coll Comp Sci & Technol, 288 Liuhe Rd, Hangzhou 310023, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantic-aware segmentation; Unsupervised object detection; Camouflaged Object Detection; NETWORK; NET;
D O I
10.1016/j.jvcir.2024.104366
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised image segmentation algorithms face challenges due to the lack of human annotations. They typically employ representations derived from self-supervised models to generate pseudo-labels for supervising model training. Using this strategy, the model's performance largely depends on the quality of the generated pseudo-labels. In this study, we design an unsupervised framework to perform COD (Camouflaged Object Detection) without the need for generating pseudo-labels. Specifically, we utilize semantic-aware representations, trained in a self-supervised manner on large-scale unlabeled datasets, to guide the training process. These representations not only capturing rich contextual semantic information but also assist in refining the blurred boundaries of camouflaged objects. Furthermore, we design a framework that integrates these semantic- aware representations with task-specific features, enabling the model to perform the UCOD (Unsupervised Camouflaged Object Detection) task with enhanced contextual understanding. Moreover, we introduce an innovative multi-scale token loss function, which maintain the structural integrity of objects at various scales in the model's predictions through mutual supervision between different features and scales. Extensive experimental validation demonstrates that our model significantly enhances the performance of UCOD, closely approaching the capabilities of state-of-the-art weakly-supervised COD models.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Semantic-aware transformer with feature integration for remote sensing change detection
    Li, Penglei
    Si, Tongzhen
    Ye, Chuanlong
    Guo, Qingbei
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 135
  • [22] Camouflaged object detection with counterfactual intervention
    Li, Xiaofei
    Li, Hongying
    Zhou, Hao
    Yu, Miaomiao
    Chen, Dong
    Li, Shuohao
    Zhang, Jun
    NEUROCOMPUTING, 2023, 553
  • [23] Boundary-guided context-aware network for camouflaged object detection
    Jin Xiao
    Tianyou Chen
    Xiaoguang Hu
    Guofeng Zhang
    Shaojie Wang
    Neural Computing and Applications, 2023, 35 : 15075 - 15093
  • [24] Attention-induced semantic and boundary interaction network for camouflaged object detection
    Zhang, Qiao
    Sun, Xiaoxiao
    Chen, Yurui
    Ge, Yanliang
    Bi, Hongbo
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2023, 233
  • [25] Boundary-guided context-aware network for camouflaged object detection
    Xiao, Jin
    Chen, Tianyou
    Hu, Xiaoguang
    Zhang, Guofeng
    Wang, Shaojie
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (20): : 15075 - 15093
  • [26] Semantic-spatial guided context propagation network for camouflaged object detection
    Ren, Junchao
    Zhang, Qiao
    Kang, Bingbing
    Zhong, Yuxi
    He, Min
    Ge, Yanliang
    Bi, Hongbo
    APPLIED INTELLIGENCE, 2025, 55 (05)
  • [27] Camouflaged object detection via boundary refinement
    Zhang, Miaohui
    Shen, Chenxing
    Deng, Yangyang
    Wang, Li
    MULTIMEDIA SYSTEMS, 2025, 31 (01)
  • [28] Depth-aided Camouflaged Object Detection
    Wang, Qingwei
    Yang, Jinyu
    Yu, Xiaosheng
    Wang, Fangyi
    Chen, Peng
    Zheng, Feng
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3297 - 3306
  • [29] Frequency Representation Integration for Camouflaged Object Detection
    Xie, Chenxi
    Xia, Changqun
    Yu, Tianshu
    Li, Jia
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1789 - 1797
  • [30] Zero-Shot Camouflaged Object Detection
    Li, Haoran
    Feng, Chun-Mei
    Xu, Yong
    Zhou, Tao
    Yao, Lina
    Chang, Xiaojun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 5126 - 5137