Top-Down Saliency Detection Based on Deep-Learned Features

被引:7
作者
Zhang, Duzhen [1 ,2 ]
Zakir, Ali [2 ]
机构
[1] Jiangsu Normal Univ, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[2] Nanjing Univ Sci & Technol, Sch Comp Sci & Engn, Nanjing 210094, Jiangsu, Peoples R China
关键词
Saliency detection; top-down; deep learning; convolutional neural networks; VISUAL SALIENCY; OBJECT TRACKING; SCENES; MODEL;
D O I
10.1142/S1469026819500093
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
How to localize objects in images accurately and efficiently is a challenging problem in computer vision. In this paper, a novel top-down fine-grained salient object detection method based on deep-learned features is proposed, which can detect the same object in input image as the query image. The query image and its three subsample images are used as top-down cues to guide saliency detection. We ameliorate convolutional neural network (CNN) using the fast VGG network (VGG-f) pre-trained on ImageNet and re-trained on the Pascal VOC 2012 dataset. Experiment on the FiFA dataset demonstrates that proposed method can localize the saliency region and find the specific object (e.g., human face) as the query. Experiments on the David1 and Face1 sequences conclusively prove that the proposed algorithm is able to effectively deal with many challenging factors including illumination change, shape deformation, scale change and partial occlusion.
引用
收藏
页数:12
相关论文
共 46 条
[11]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[12]   Neural Mechanisms of Selective Visual Attention [J].
Moore, Tirin ;
Zirnsak, Marc .
ANNUAL REVIEW OF PSYCHOLOGY, VOL 68, 2017, 68 :47-72
[13]   Modelling search for people in 900 scenes: A combined source model of eye guidance [J].
Ehinger, Krista A. ;
Hidalgo-Sotelo, Barbara ;
Torralba, Antonio ;
Oliva, Aude .
VISUAL COGNITION, 2009, 17 (6-7) :945-978
[14]  
Erhan D, 2010, J MACH LEARN RES, V11, P625
[15]   The PASCAL Visual Object Classes Challenge: A Retrospective [J].
Everingham, Mark ;
Eslami, S. M. Ali ;
Van Gool, Luc ;
Williams, Christopher K. I. ;
Winn, John ;
Zisserman, Andrew .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 111 (01) :98-136
[16]   Discriminant Saliency, the Detection of Suspicious Coincidences, and Applications to Visual Recognition [J].
Gao, Dashan ;
Han, Sunhyoung ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, 31 (06) :989-1005
[17]  
Gu J., ARXIV151207108V5CSCV
[18]  
Hare S, 2011, IEEE I CONF COMP VIS, P263, DOI 10.1109/ICCV.2011.6126251
[19]   Exemplar-Driven Top-Down Saliency Detection via Deep Association [J].
He, Shengfeng ;
Lau, Rynson W. H. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5723-5732
[20]   SuperCNN: A Superpixelwise Convolutional Neural Network for Salient Object Detection [J].
He, Shengfeng ;
Lau, Rynson W. H. ;
Liu, Wenxi ;
Huang, Zhe ;
Yang, Qingxiong .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2015, 115 (03) :330-344