Saliency Detection Based on Context-aware Cross-layer Feature Fusion for Light Field Images

被引:1
作者
Deng, Huiping
Cao, Zhaoyang [1 ]
Xiang, Sen
Wu, Jin
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Peoples R China
关键词
Light field images; Saliency detection; Cross-layer feature fusion; Context-awareness; OBJECT DETECTION;
D O I
10.11999/JEIT221270
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Saliency detection of light field images is a key technique in applications such as visual tracking, target detection, and image compression. However, the existing deep learning methods ignore feature differences and global contextual information when processing features, resulting in blurred saliency maps and even incomplete detection objects and difficult background suppression in scenes with similar foreground and background colors, textures, or background clutter. A context-aware cross-layer feature fusion-based saliency detection network for light field images is proposed. First, a cross-layer feature fusion module is built to select adaptively complementary components from input features to reduce feature differences and avoid inaccurate integration of features in order to more effectively fuse adjacent layer features and informative coefficients; Meanwhile, a Parallel Cascaded Feedback Decoder (PCFD) is constructed using the cross-layer feature fusion module to iteratively refine features using a multi-level feedback mechanism to avoid feature loss and dilution of high-level contextual features; Finally, a Global Context Module (GCM) generates multi-scale features to exploit the rich global context information in order to obtain the correlation between different salient regions and mitigate the dilution of high-level features. Experimental results on the latest light field dataset show that the textual method outperforms the compared methods both quantitatively and qualitatively, and is able to detect accurately complete salient objects and obtain clear saliency maps from similar front/background scenes.
引用
收藏
页码:4489 / 4498
页数:10
相关论文
共 22 条
[1]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Cheng, Ming-Ming ;
Jiang, Huaizu ;
Li, Jia .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5706-5722
[2]   Attentional Feature Fusion [J].
Dai, Yimian ;
Gieseke, Fabian ;
Oehmcke, Stefan ;
Wu, Yiquan ;
Barnard, Kobus .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WACV 2021, 2021, :3559-3568
[3]   Saliency detection combined with selective light field refocusing of camera array [J].
Feng Jie ;
Wang Shi-gang ;
Wei Jian ;
Zhao Yan .
CHINESE OPTICS, 2021, 14 (03) :587-595
[4]   Object recognition with hierarchical discriminant saliency networks [J].
Han, Sunhyoung ;
Vasconcelos, Nuno .
FRONTIERS IN COMPUTATIONAL NEUROSCIENCE, 2014, 8
[5]   Deeply Supervised Salient Object Detection with Short Connections [J].
Hou, Qibin ;
Cheng, Ming-Ming ;
Hu, Xiaowei ;
Borji, Ali ;
Tu, Zhuowen ;
Torr, Philip .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5300-5309
[6]   Saliency Detection on Light Field [J].
Li, Nianyi ;
Ye, Jinwei ;
Ji, Yu ;
Ling, Haibin ;
Yu, Jingyi .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :2806-2813
[7]  
LI Shuang, 2020, Journal of Image and Graphics, V25, P2578, DOI [10.11834/jig.190675, DOI 10.11834/JIG.190675]
[8]   A Survey of Appearance Models in Visual Object Tracking [J].
Li, Xi ;
Hu, Weiming ;
Shen, Chunhua ;
Zhang, Zhongfei ;
Dick, Anthony ;
Van den Hengel, Anton .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2013, 4 (04)
[9]   Learning Selective Self-Mutual Attention for RGB-D Saliency Detection [J].
Liu, Nian ;
Zhang, Ni ;
Han, Junwei .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :13753-13762
[10]   PANet: Patch-Aware Network for Light Field Salient Object Detection [J].
Piao, Yongri ;
Jiang, Yongyao ;
Zhang, Miao ;
Wang, Jian ;
Lu, Huchuan .
IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (01) :379-391