Two guidance joint network based on coarse map and edge map for camouflaged object detection

被引:7
作者
Tang, Zhe [1 ,2 ]
Tang, Jing [1 ]
Zou, Dengpeng [1 ]
Rao, Junyi [3 ]
Qi, Fang [1 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Hunan, Peoples R China
[2] Changsha Xiangfeng Intelligent Equipment Co Ltd, Changsha 410083, Hunan, Peoples R China
[3] Jilin Univ, Coll Commun Engn, Changchun 130012, Jilin, Peoples R China
关键词
Camouflaged object detection; Image segmentation; Convolutional neural network; Boundary-aware network; IMAGE COMPRESSION;
D O I
10.1007/s10489-024-05559-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Camouflaged object detection (COD) entails identifying objects in an image that blend with the background. However, most traditional COD methods have not comprehensively considered the information provided by the overall region and edges of the objects. To address this problem, a new two-guidance joint network based on coarse and edge maps is proposed for COD. Particularly, an information guidance module is designed to inject edges and overall information into the network's backbone features. Meanwhile, a feature observation model based on skip connections and multi-scale perception is designed to capture multi-scale image details and structures. To avoid the loss of semantic information in low-level features, a full-image attention mechanism is designed to integrate high-level features into low-level features, thereby improving the resolution of the object masks. We compared the proposed network with state-of-the-art models on three well-known datasets, and the experimental results show the proposed network has significant improvement. By exploring valuable boundary information and overall object information, the proposed network can segment object edges while also considering the segmentation effect of the entire object. Our code has been open-sourced at https://github.com/Huah2019/TJNet.
引用
收藏
页码:7531 / 7544
页数:14
相关论文
共 41 条
[1]   Camouflage Images [J].
Chu, Hung-Kuo ;
Hsu, Wei-Hsin ;
Mitra, Niloy J. ;
Cohen-Or, Daniel ;
Wong, Tien-Tsin ;
Lee, Tong-Yee .
ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (04)
[2]   Disruptive coloration and background pattern matching [J].
Cuthill, IC ;
Stevens, M ;
Sheppard, J ;
Maddocks, T ;
Párraga, CA ;
Troscianko, TS .
NATURE, 2005, 434 (7029) :72-74
[3]  
Deng-Ping Fan, 2020, Medical Image Computing and Computer Assisted Intervention - MICCAI 2020. 23rd International Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12266), P263, DOI 10.1007/978-3-030-59725-2_26
[4]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[5]  
Du XQ, 2022, PROCEEDINGS OF THE THIRTY-FIRST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, IJCAI 2022, P877
[6]  
Fan D.-P., 2021, Scientia Sinica Informationis, V6
[7]   Concealed Object Detection [J].
Fan, Deng-Ping ;
Ji, Ge-Peng ;
Cheng, Ming-Ming ;
Shao, Ling .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) :6024-6042
[8]   Structure-measure: A New Way to Evaluate Foreground Maps [J].
Fan, Deng-Ping ;
Cheng, Ming-Ming ;
Liu, Yun ;
Li, Tao ;
Borji, Ali .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4558-4567
[9]   Camouflaged Object Detection [J].
Fan, Deng-Ping ;
Ji, Ge-Peng ;
Sun, Guolei ;
Cheng, Ming-Ming ;
Shen, Jianbing ;
Shao, Ling .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2774-2784
[10]   Res2Net: A New Multi-Scale Backbone Architecture [J].
Gao, Shang-Hua ;
Cheng, Ming-Ming ;
Zhao, Kai ;
Zhang, Xin-Yu ;
Yang, Ming-Hsuan ;
Torr, Philip .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (02) :652-662