Salient Object Detection: A Discriminative Regional Feature Integration Approach

被引:155
作者
Wang, Jingdong [1 ]
Jiang, Huaizu [2 ]
Yuan, Zejian [3 ]
Cheng, Ming-Ming [4 ]
Hu, Xiaowei [4 ]
Zheng, Nanning [3 ]
机构
[1] Microsoft Res, Beijing, Peoples R China
[2] Univ Massachusetts, Amherst, MA 01003 USA
[3] Xi An Jiao Tong Univ, Xian, Shaanxi, Peoples R China
[4] Nankai Univ, CCCE & CS, Tianjin, Peoples R China
基金
中国国家自然科学基金;
关键词
Salient object detection; Data-driven; IMAGE SALIENCY; ATTENTION; MAP;
D O I
10.1007/s11263-016-0977-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature integration provides a computational framework for saliency detection, and a lot of hand-crafted integration rules have been developed. In this paper, we present a principled extension, supervised feature integration, which learns a random forest regressor to discriminatively integrate the saliency features for saliency computation. In addition to contrast features, we introduce regional object-sensitive descriptors: the objectness descriptor characterizing the common spatial and appearance property of the salient object, and the image-specific backgroundness descriptor characterizing the appearance of the background of a specific image, which are shown more important for estimating the saliency. To the best of our knowledge, our supervised feature integration framework is the first successful approach to perform the integration over the saliency features for salient object detection, and outperforms the integration approach over the saliency maps. Together with fusing the multi-level regional saliency maps to impose the spatial saliency consistency, our approach significantly outperforms state-of-the-art methods on seven benchmark datasets. We also discuss several followup works which jointly learn the representation and the saliency map using deep learning.
引用
收藏
页码:251 / 268
页数:18
相关论文
共 50 条
[41]   Salient object detection network with multi-scale feature refinement and boundary feedback [J].
Zhang, Qing ;
Li, Xiang .
IMAGE AND VISION COMPUTING, 2021, 116
[42]   Feature Quality-Based Dynamic Feature Selection for Improving Salient Object Detection [J].
Naqvi, Syed Saud ;
Browne, Will N. ;
Hollitt, Christopher .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (09) :4298-4313
[43]   RMFDNet: Redundant and Missing Feature Decoupling Network for salient object detection [J].
Zhou, Qianwei ;
Wang, Jintao ;
Li, Jiaqi ;
Zhou, Chen ;
Hu, Haigen ;
Hu, Keli .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 139
[44]   Salient Object Detection With Lossless Feature Reflection and Weighted Structural Loss [J].
Zhang, Pingping ;
Liu, Wei ;
Lu, Huchuan ;
Shen, Chunhua .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (06) :3048-3060
[45]   Coarse to Fine: Weak Feature Boosting Network for Salient Object Detection [J].
Zhang, Chenhao ;
Gao, Shanshan ;
Pan, Xiao ;
Wang, Yuting ;
Zhou, Yuanfeng .
COMPUTER GRAPHICS FORUM, 2020, 39 (07) :411-420
[46]   Quasi-Equilibrium Feature Pyramid Network for Salient Object Detection [J].
Song, Yue ;
Tang, Hao ;
Zhao, Mengyi ;
Sebe, Nicu ;
Wang, Wei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :7144-7153
[47]   A pooling-based feature pyramid network for salient object detection [J].
Shi, Caijuan ;
Zhang, Weiming ;
Duan, Changyu ;
Chen, Houru .
IMAGE AND VISION COMPUTING, 2021, 107
[48]   A Universal Framework for Salient Object Detection [J].
Lei, Jianjun ;
Wang, Bingren ;
Fang, Yuming ;
Lin, Weisi ;
Le Callet, Patrick ;
Ling, Nam ;
Hou, Chunping .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (09) :1783-1795
[49]   Rich-scale feature fusion network for salient object detection [J].
Sun, Fengming ;
Cui, Junjie ;
Yuan, Xia ;
Zhao, Chunxia .
IET IMAGE PROCESSING, 2023, 17 (03) :794-806
[50]   Enhanced Point Feature Network for Point Cloud Salient Object Detection [J].
Zhang, Ziyan ;
Gao, Pan ;
Peng, Siyi ;
Duan, Chang ;
Zhang, Ping .
IEEE SIGNAL PROCESSING LETTERS, 2023, 30 :1617-1621