Cross-Collaboration Weighted Fusion Network for RGB-T Salient Detection

被引:0
作者
Wang, Yumei [1 ]
Dongye, Changlei [1 ]
Zhao, Wenxiu [1 ]
机构
[1] Shandong Univ Sci & Technol, Huangdao, Peoples R China
来源
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IV, ICIC 2024 | 2024年 / 14865卷
关键词
Salient object detection; Illumination weights; Image quality; RGB-T;
D O I
10.1007/978-981-97-5591-2_26
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
RGB-T salient object detection (SOD) aims to accurately and effectively detect and segment salient objects by using the complementary information from RGB and thermal modalities. However, existing RGB-T SOD methods often overlook the fact that RGB and thermal images may not consistently aid in precise detection. To address this issue, we propose a novel approach called CWFNet for RGB-T SOD enhancing the model's adaptiveness in variable illumination scenarios. First of all, we introduce a global illumination learning module (GILM) to evaluate the illumination conditions. The generated illuminance weights not only adjust modality interaction but also serve to weaken the influence of undesirable modalities. Subsequently, in the encoding stage, guided by the illuminance weights, we design an RGB-guided fusion module (RFM) to complete early fusion of cross-modal features. In the decoding stage, we propose a thermal-guided localization supplement module (TLSM) to strengthen the perception of salient object locations. Extensive experiments are conducted on three benchmark RGBT datasets and compared to state-of-the-art methods. Our experimental results validate the superiority of our model in the RGB-T SOD task.
引用
收藏
页码:301 / 312
页数:12
相关论文
共 17 条
[1]   CGMDRNet: Cross-Guided Modality Difference Reduction Network for RGB-T Salient Object Detection [J].
Chen, Gang ;
Shao, Feng ;
Chai, Xiongli ;
Chen, Hangwei ;
Jiang, Qiuping ;
Meng, Xiangchao ;
Ho, Yo-Sung .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (09) :6308-6323
[2]   Does Thermal Really Always Matter for RGB-T Salient Object Detection? [J].
Cong, Runmin ;
Zhang, Kepu ;
Zhang, Chen ;
Zheng, Feng ;
Zhao, Yao ;
Huang, Qingming ;
Kwong, Sam .
IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 :6971-6982
[3]   Unified Information Fusion Network for Multi-Modal RGB-D and RGB-T Salient Object Detection [J].
Gao, Wei ;
Liao, Guibiao ;
Ma, Siwei ;
Li, Ge ;
Liang, Yongsheng ;
Lin, Weisi .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (04) :2091-2106
[4]   Real-Time One-Stream Semantic-Guided Refinement Network for RGB-Thermal Salient Object Detection [J].
Huo, Fushuo ;
Zhu, Xuegui ;
Zhang, Qian ;
Liu, Ziming ;
Yu, Wenchao .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71
[5]   Efficient Context-Guided Stacked Refinement Network for RGB-T Salient Object Detection [J].
Huo, Fushuo ;
Zhu, Xuegui ;
Zhang, Lei ;
Liu, Qifeng ;
Shu, Yu .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (05) :3111-3124
[6]   Multi-modal interactive attention and dual progressive decoding network for RGB-D/T salient object detection [J].
Liang, Yanhua ;
Qin, Guihe ;
Sun, Minghui ;
Qin, Jun ;
Yan, Jie ;
Zhang, Zhonghan .
NEUROCOMPUTING, 2022, 490 :132-145
[7]   Cross-Collaborative Fusion-Encoder Network for Robust RGB-Thermal Salient Object Detection [J].
Liao, Guibiao ;
Gao, Wei ;
Li, Ge ;
Wang, Junle ;
Kwong, Sam .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) :7646-7661
[8]   Scribble-Supervised RGB-T Salient Object Detection [J].
Liu, Zhengyi ;
Huang, Xiaoshen ;
Zhang, Guanghui ;
Fang, Xianyong ;
Wang, Linbo ;
Tang, Bin .
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, :2369-2374
[9]   SwinNet: Swin Transformer Drives Edge-Aware RGB-D and RGB-T Salient Object Detection [J].
Liu, Zhengyi ;
Tan, Yacheng ;
He, Qian ;
Xiao, Yun .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (07) :4486-4497
[10]   Multiple Graph Affinity Interactive Network and a Variable Illumination Dataset for RGBT Image Salient Object Detection [J].
Song, Kechen ;
Huang, Liming ;
Gong, Aojun ;
Yan, Yunhui .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (07) :3104-3118