Boosting Camouflaged Object Detection with Dual-Task Interactive Transformer

被引:48
作者
Liu, Zhengyi [1 ]
Zhang, Zhili [1 ]
Tan, Yacheng [1 ]
Wu, Wei [1 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Hefei, Anhui, Peoples R China
来源
2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR) | 2022年
关键词
camouflaged object detection; boundary detection; transformer; interactive; multi-task learning;
D O I
10.1109/ICPR56361.2022.9956724
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Camouflaged object detection intends to discover the concealed objects hidden in the surroundings. Existing methods follow the bio-inspired framework, which first locates the object and second refines the boundary. We argue that the discovery of camouflaged objects depends on the recurrent search for the object and the boundary. The recurrent processing makes the human tired and helpless, but it is just the advantage of the transformer with global search ability. Therefore, a dual-task interactive transformer is proposed to detect both accurate position of the camouflaged object and its detailed boundary. The boundary feature is considered as Query to improve the camouflaged object detection, and meanwhile the object feature is considered as Query to improve the boundary detection. The camouflaged object detection and the boundary detection are fully interacted by multi-head self-attention. Besides, to obtain the initial object feature and boundary feature, transformer-based backbones are adopted to extract the foreground and background. The foreground is just object, while foreground minus background is considered as boundary. Here, the boundary feature can be obtained from blurry boundary region of the foreground and background. Supervised by the object, the background and the boundary ground truth, the proposed model achieves state-of-the-art performance in public datasets. https://github.com/liuzywen/COD
引用
收藏
页码:140 / 146
页数:7
相关论文
共 42 条
[1]  
Bhajantri NU, 2006, ICIT 2006: 9TH INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY, PROCEEDINGS, P145
[3]  
Chu XX, 2021, ADV NEUR IN
[4]  
Dai S, 2017, INT CONF ACOUST SPEE, P1028, DOI 10.1109/ICASSP.2017.7952312
[5]   BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network [J].
Fan, Deng-Ping ;
Zhai, Yingjie ;
Borji, Ali ;
Yang, Jufeng ;
Shao, Ling .
COMPUTER VISION - ECCV 2020, PT XII, 2020, 12357 :275-292
[6]  
Dong B, 2024, Arxiv, DOI arXiv:2108.06932
[7]  
Dosovitskiy A., 2021, P 9 INT C LEARN REPR
[8]   Concealed Object Detection [J].
Fan, Deng-Ping ;
Ji, Ge-Peng ;
Cheng, Ming-Ming ;
Shao, Ling .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) :6024-6042
[9]   Camouflaged Object Detection [J].
Fan, Deng-Ping ;
Ji, Ge-Peng ;
Sun, Guolei ;
Cheng, Ming-Ming ;
Shen, Jianbing ;
Shao, Ling .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :2774-2784
[10]   Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images [J].
Fan, Deng-Ping ;
Zhou, Tao ;
Ji, Ge-Peng ;
Zhou, Yi ;
Chen, Geng ;
Fu, Huazhu ;
Shen, Jianbing ;
Shao, Ling .
IEEE TRANSACTIONS ON MEDICAL IMAGING, 2020, 39 (08) :2626-2637