Frequency-Spatial Entanglement Learning for Camouflaged Object Detection

被引:7
|
作者
Sun, Yanguang [1 ]
Xu, Chunyan [1 ]
Yang, Jian [1 ]
Xuan, Hanyu [2 ]
Luo, Lei [1 ]
机构
[1] Nanjing Univ Sci & Technol, PCA Lab, Nanjing, Peoples R China
[2] Anhui Univ, Sch Big Data & Stat, Hefei, Peoples R China
来源
COMPUTER VISION - ECCV 2024, PT VI | 2025年 / 15064卷
关键词
Camouflaged object detection; Computer vision; Frequency-Spatial entanglement learning; NETWORK;
D O I
10.1007/978-3-031-72658-3_20
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Camouflaged object detection has attracted a lot of attention in computer vision. The main challenge lies in the high degree of similarity between camouflaged objects and their surroundings in the spatial domain, making identification difficult. Existing methods attempt to reduce the impact of pixel similarity by maximizing the distinguishing ability of spatial features with complicated design, but often ignore the sensitivity and locality of features in the spatial domain, leading to sub-optimal results. In this paper, we propose a new approach to address this issue by jointly exploring the representation in the frequency and spatial domains, introducing the Frequency-Spatial Entanglement Learning (FSEL) method. This method consists of a series of well-designed Entanglement Transformer Blocks (ETB) for representation learning, a Joint Domain Perception Module for semantic enhancement, and a Dual-domain Reverse Parser for feature integration in the frequency and spatial domains. Specifically, the ETB utilizes frequency self-attention to effectively characterize the relationship between different frequency bands, while the entanglement feed-forward network facilitates information interaction between features of different domains through entanglement learning. Our extensive experiments demonstrate the superiority of our FSEL over 21 state-of-the-art methods, through comprehensive quantitative and qualitative comparisons in three widely-used datasets. The source code is available at: https://github.com/CSYSI/FSEL.
引用
收藏
页码:343 / 360
页数:18
相关论文
共 50 条
  • [1] Promoting camouflaged object detection through novel edge-target interaction and frequency-spatial fusion
    Guan, Juwei
    Qian, Weiqi
    Zhu, Tongxin
    Fang, Xiaolin
    NEUROCOMPUTING, 2025, 617
  • [2] Frequency-Guided Spatial Adaptation for Camouflaged Object Detection
    Zhang, Shizhou
    Kong, Dexuan
    Xing, Yinghui
    Lu, Yue
    Ran, Lingyan
    Liang, Guoqiang
    Wang, Hexu
    Zhang, Yanning
    IEEE TRANSACTIONS ON MULTIMEDIA, 2025, 27 : 72 - 83
  • [3] Multidimensional fusion of frequency and spatial domain information for enhanced camouflaged object detection
    Wang, Tingran
    Yu, Zaiyang
    Fang, Jianwei
    Xie, Jinlong
    Yang, Feng
    Zhang, Huang
    Zhang, Liping
    Du, Minghua
    Li, Lusi
    Ning, Xin
    INFORMATION FUSION, 2025, 117
  • [4] Frequency Perception Network for Camouflaged Object Detection
    Cong, Runmin
    Sun, Mengyao
    Zhang, Sanyi
    Zhou, Xiaofei
    Zhang, Wei
    Zhao, Yao
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1179 - 1189
  • [5] Frequency Representation Integration for Camouflaged Object Detection
    Xie, Chenxi
    Xia, Changqun
    Yu, Tianshu
    Li, Jia
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 1789 - 1797
  • [6] Frequency-aware Camouflaged Object Detection
    Lin, Jiaying
    Tan, Xin
    Xu, Ke
    Ma, Lizhuang
    Lau, Rynsonw. H.
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (02)
  • [7] Mutual Graph Learning for Camouflaged Object Detection
    Zhai, Qiang
    Li, Xin
    Yang, Fan
    Chen, Chenglizhao
    Cheng, Hong
    Fan, Deng-Ping
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 12992 - 13002
  • [8] Frequency-spatial domain based salient region detection
    Sun, Xiaoliang
    Zhu, Zunshang
    Liu, Xiaolin
    Shang, Yang
    Yu, Qifeng
    OPTIK, 2015, 126 (9-10): : 942 - 949
  • [9] Deep Gradient Learning for Efficient Camouflaged Object Detection
    Ge-Peng Ji
    Deng-Ping Fan
    Yu-Cheng Chou
    Dengxin Dai
    Alexander Liniger
    Luc Van Gool
    Machine Intelligence Research, 2023, 20 : 92 - 108
  • [10] Camouflaged Object Detection
    Fan, Deng-Ping
    Ji, Ge-Peng
    Sun, Guolei
    Cheng, Ming-Ming
    Shen, Jianbing
    Shao, Ling
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 2774 - 2784