Semantic-aware representations for unsupervised Camouflaged Object Detection

被引:0
|
作者
Lu, Zelin [1 ]
Zhao, Xing [1 ]
Xie, Liang [1 ]
Liang, Haoran [1 ]
Liang, Ronghua [1 ]
机构
[1] Zhejiang Univ Technol, Coll Comp Sci & Technol, 288 Liuhe Rd, Hangzhou 310023, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantic-aware segmentation; Unsupervised object detection; Camouflaged Object Detection; NETWORK; NET;
D O I
10.1016/j.jvcir.2024.104366
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Unsupervised image segmentation algorithms face challenges due to the lack of human annotations. They typically employ representations derived from self-supervised models to generate pseudo-labels for supervising model training. Using this strategy, the model's performance largely depends on the quality of the generated pseudo-labels. In this study, we design an unsupervised framework to perform COD (Camouflaged Object Detection) without the need for generating pseudo-labels. Specifically, we utilize semantic-aware representations, trained in a self-supervised manner on large-scale unlabeled datasets, to guide the training process. These representations not only capturing rich contextual semantic information but also assist in refining the blurred boundaries of camouflaged objects. Furthermore, we design a framework that integrates these semantic- aware representations with task-specific features, enabling the model to perform the UCOD (Unsupervised Camouflaged Object Detection) task with enhanced contextual understanding. Moreover, we introduce an innovative multi-scale token loss function, which maintain the structural integrity of objects at various scales in the model's predictions through mutual supervision between different features and scales. Extensive experimental validation demonstrates that our model significantly enhances the performance of UCOD, closely approaching the capabilities of state-of-the-art weakly-supervised COD models.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Frequency-aware Camouflaged Object Detection
    Lin, Jiaying
    Tan, Xin
    Xu, Ke
    Ma, Lizhuang
    Lau, Rynsonw. H.
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [2] An edge-aware high-resolution framework for camouflaged object detection
    Ma, Jingyuan
    Chen, Tianyou
    Xiao, Jin
    Hu, Xiaoguang
    Wang, Yingxun
    IMAGE AND VISION COMPUTING, 2025, 157
  • [3] Deep Texture-Aware Features for Camouflaged Object Detection
    Ren, Jingjing
    Hu, Xiaowei
    Zhu, Lei
    Xu, Xuemiao
    Xu, Yangyang
    Wang, Weiming
    Deng, Zijun
    Heng, Pheng-Ann
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (03) : 1157 - 1167
  • [4] Camouflaged Object Detection with Feature Grafting and Distractor Aware
    Song, Yuxuan
    Li, Xinyue
    Qi, Lin
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2459 - 2464
  • [5] OAFormer: Occlusion Aware Transformer for Camouflaged Object Detection
    Yang, Xin
    Zhu, Hengliang
    Mao, Guojun
    Xing, Shuli
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1421 - 1426
  • [6] Camouflaged object detection based on context-aware and boundary refinement
    Shi, Caijuan
    Ren, Bijuan
    Chen, Houru
    Zhao, Lin
    Lin, Chunyu
    Zhao, Yao
    APPLIED INTELLIGENCE, 2023, 53 (19) : 22429 - 22445
  • [7] Weighted Dense Semantic Aggregation and Explicit Boundary Modeling for Camouflaged Object Detection
    Liang, Weiyun
    Wu, Jiesheng
    Mu, Xinyue
    Hao, Fangwei
    Du, Ji
    Xu, Jing
    Li, Ping
    IEEE SENSORS JOURNAL, 2024, 24 (13) : 21108 - 21122
  • [8] Rethinking Camouflaged Object Detection: Models and Datasets
    Bi, Hongbo
    Zhang, Cong
    Wang, Kang
    Tong, Jinghui
    Zheng, Feng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) : 5708 - 5724
  • [9] A new benchmark for camouflaged object detection: RGB-D camouflaged object detection dataset
    Zhang, Dongdong
    Wang, Chunping
    Fu, Qiang
    OPEN PHYSICS, 2024, 22 (01):
  • [10] Learning Discriminative Representations From Cross-Scale Features for Camouflaged Object Detection
    Wang, Yongchao
    Bi, Xiuli
    Liu, Bo
    Wei, Yang
    Li, Weisheng
    Xiao, Bin
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12756 - 12769