FEATURE ENHANCEMENT AND FUSION FOR RGB-T SALIENT OBJECT DETECTION

被引:3
作者
Sun, Fengming [1 ]
Zhang, Kang [1 ]
Yuan, Xia [1 ]
Zhao, Chunxia [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP | 2023年
关键词
RGB-T; Salient Object Detection; Feature Enhancement; Cross-modality Feature Fusion; REFINEMENT;
D O I
10.1109/ICIP49359.2023.10222404
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Cross-modal information fusion plays a vital role in the RGB-T salient object detection. Due to RGB and thermal images come from different domains, the modality difference will lead to the unsatisfactory effect of simple feature fusion. How to explore and integrate useful information is the key to the RGB-T saliency detection methods. In this paper, we introduce an Enhancement and Fusion Network. In detail, we propose a Self-modality Feature Enhancement Module that effectively integrate the feature representation of a single modality through global context information. And we propose a Cross-modality Feature Dynamic Fusion Module to realize the effective fusion of cross-modal features in the way of dynamic weighting. Experiments on public datasets show that the proposed method achieves satisfactory results compared with other state-of-the-art salient object detection approaches.
引用
收藏
页码:1300 / 1304
页数:5
相关论文
共 50 条
[41]   UMINet: a unified multi-modality interaction network for RGB-D and RGB-T salient object detection [J].
Gao, Lina ;
Fu, Ping ;
Xu, Mingzhu ;
Wang, Tiantian ;
Liu, Bing .
VISUAL COMPUTER, 2024, 40 (03) :1565-1582
[42]   UMINet: a unified multi-modality interaction network for RGB-D and RGB-T salient object detection [J].
Lina Gao ;
Ping Fu ;
Mingzhu Xu ;
Tiantian Wang ;
Bing Liu .
The Visual Computer, 2024, 40 :1565-1582
[43]   EDGE-Net: an edge-guided enhanced network for RGB-T salient object detection [J].
Zheng, Xin ;
Wang, Boyang ;
Ai, Liefu ;
Tang, Pan ;
Liu, Deyang .
JOURNAL OF ELECTRONIC IMAGING, 2023, 32 (06) :63032
[44]   Modality Registration and Object Search Framework for UAV-Based Unregistered RGB-T Image Salient Object Detection [J].
Song, Kechen ;
Wen, Hongwei ;
Xue, Xiaotong ;
Huang, Liming ;
Ji, Yingying ;
Yan, Yunhui .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61 :1-15
[45]   Transformer-Based Cross-Modal Integration Network for RGB-T Salient Object Detection [J].
Lv, Chengtao ;
Zhou, Xiaofei ;
Wan, Bin ;
Wang, Shuai ;
Sun, Yaoqi ;
Zhang, Jiyong ;
Yan, Chenggang .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (02) :4741-4755
[46]   Lightweight multi-level feature difference fusion network for RGB-D-T salient object detection [J].
Song, Kechen ;
Wang, Han ;
Zhao, Ying ;
Huang, Liming ;
Dong, Hongwen ;
Yan, Yunhui .
JOURNAL OF KING SAUD UNIVERSITY COMPUTER AND INFORMATION SCIENCES, 2023, 35 (08)
[47]   SFEN: Salient feature enhancement network for salient object detection [J].
Du, Yafei ;
Che, Shengbing ;
Tuo, Yangzhuo ;
Liu, Wenxin ;
Wang, Wanqin ;
Zhang, Zixuan .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2025, 111
[48]   Transformer-based cross-modality interaction guidance network for RGB-T salient object detection [J].
Luo, Jincheng ;
Li, Yongjun ;
Li, Bo ;
Zhang, Xinru ;
Li, Chaoyue ;
Chenjin, Zhimin ;
He, Jingyi ;
Liang, Yifei .
NEUROCOMPUTING, 2024, 600
[49]   Salient Object Detection Based on Feature Enhancement in Complex Scene [J].
Li B. ;
Rao H. .
Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2021, 49 (11) :135-144
[50]   A SALIENCY ENHANCED FEATURE FUSION BASED MULTISCALE RGB-D SALIENT OBJECT DETECTION NETWORK [J].
Huang, Rui ;
Zhao, Qingyi ;
Xing, Yan ;
Gao, Sihua ;
Xu, Weifeng ;
Zhang, Yuxiang ;
Fan, Wei .
2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2024), 2024, :9356-9360