Camouflaged Object Detection via Complementary Information-Selected Network Based on Visual and Semantic Separation

被引:1
作者
Yin, Chao [1 ]
Yang, Kequan [1 ]
Li, Jide [1 ]
Li, Xiaoqiang [1 ]
Wu, Yifan [1 ]
机构
[1] Shanghai Univ, Comp Engn & Sci Dept, Shanghai 200444, Peoples R China
关键词
Feature extraction; Semantics; Visualization; Task analysis; Image segmentation; Object detection; Data mining; Binary segmentation; camouflaged object detection (COD); deep learning; FRAMEWORK;
D O I
10.1109/TII.2024.3426979
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Camouflaged object detection (COD) is a promising yet challenging task that aims to segment objects concealed within intricate surroundings, a capability crucial for modern industrial applications. Current COD methods primarily focus on the direct fusion of high-level and low-level information, without considering their differences and inconsistencies. Consequently, accurately segmenting highly camouflaged objects in challenging scenarios presents a considerable problem. To mitigate this concern, we propose a novel framework called visual and semantic separation network (VSSNet), which separately extracts low-level visual and high-level semantic cues and adaptively combines them for accurate predictions. Specifically, it features the information extractor module for capturing dimension-aware visual or semantic information from various perspectives. The complementary information-selected module leverages the complementary nature of visual and semantic information for adaptive selection and fusion. In addition, the region disparity weighting strategy encourages the model to prioritize the boundaries of highly camouflaged and difficult-to-predict objects. Experimental results on benchmark datasets show the VSSNet significantly outperforms State-of-the-Art COD approaches without data augmentations and multiscale training techniques. Furthermore, our method demonstrates satisfactory cross-domain generalization performance in real-world industrial environments.
引用
收藏
页码:12871 / 12881
页数:11
相关论文
共 50 条
  • [21] Mining Semantic Information in Rumor Detection via a Deep Visual Perception Based Recurrent Neural Networks
    Xing, Feng
    Guo, Caili
    [J]. 2019 IEEE INTERNATIONAL CONGRESS ON BIG DATA (IEEE BIGDATA CONGRESS 2019), 2019, : 17 - 23
  • [22] Visual Object Recognition and Pose Estimation Based on a Deep Semantic Segmentation Network
    Lin, Chien-Ming
    Tsai, Chi-Yi
    Lai, Yu-Cheng
    Li, Shin-An
    Wong, Ching-Chang
    [J]. IEEE SENSORS JOURNAL, 2018, 18 (22) : 9370 - 9381
  • [23] Visual SLAM Based on Object Detection Network: A Review br
    Peng, Jiansheng
    Chen, Dunhua
    Yang, Qing
    Yang, Chengjun
    Xu, Yong
    Qin, Yong
    [J]. CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 77 (03): : 3209 - 3236
  • [24] Semi-Supervised Camouflaged Object Detection: Multi Information Fusion Combined with Adaptive Receptive Field Selection Network
    Yang, Guang
    Xiao, Feng
    Liu, Ruyu
    Zhang, Jiawei
    Zhang, Jianhua
    Chen, Shengyong
    [J]. PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT XII, 2025, 15042 : 143 - 156
  • [25] Object detection of transmission line visual images based on deep convolutional neural network
    Zhou Zhu-bo
    Gao Jiao
    Zhang Wei
    Wang Xiao-jing
    Zhang Jiang
    [J]. CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2018, 33 (04) : 317 - 325
  • [26] Small Object Detection Network Based on Feature Information Enhancement
    Luo, Huilan
    Wang, Pei
    Chen, Hongkun
    Kowelo, Vladimir Peter
    [J]. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE, 2022, 2022
  • [27] OBJECT DETECTION VIA FEATURE FUSION BASED SINGLE NETWORK
    Li, Jian
    Qian, Jianjun
    Yang, Jian
    [J]. 2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 3390 - 3394
  • [28] A visual tracking method via object detection based on deep learning
    Tang C.
    Ling Y.
    Yang H.
    Yang X.
    Zheng C.
    [J]. Hongwai yu Jiguang Gongcheng/Infrared and Laser Engineering, 2018, 47 (05):
  • [29] Visual Attention Estimation Algorithm and Dynamic Neural Network Based Object Detection for Intelligent Vehicles
    Zhao, Baixuan
    Hu, Chuan
    Zhu, Wangwang
    Hu, Shuang
    Zhang, Xi
    [J]. IEEE SENSORS JOURNAL, 2024, 24 (11) : 18535 - 18545
  • [30] Weakly Semantic Based Attention Network for Interpretable Object Detection in Remote Sensing Imagery
    Zhou Y.
    Chen S.-L.
    Zhao J.-Q.
    Zhang D.
    Wang H.-Z.
    [J]. Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2021, 49 (04): : 679 - 689