A Co-Saliency Model of Image Pairs

被引:217
作者
Li, Hongliang [1 ]
Ngan, King Ngi [2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Elect Engn, Chengdu 610054, Peoples R China
[2] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Hong Kong, Peoples R China
关键词
Attention model; co-saliency; similarity; Sim-Rank; VIDEO SEGMENTATION; FACE SEGMENTATION; VISUAL-ATTENTION; TRACKING; OBJECTS;
D O I
10.1109/TIP.2011.2156803
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we introduce a method to detect co-saliency from an image pair that may have some objects in common. The co-saliency is modeled as a linear combination of the single-image saliency map (SISM) and the multi-image saliency map (MISM). The first term is designed to describe the local attention, which is computed by using three saliency detection techniques available in literature. To compute the MISM, a co-multilayer graph is constructed by dividing the image pair into a spatial pyramid representation. Each node in the graph is described by two types of visual descriptors, which are extracted from a representation of some aspects of local appearance, e. g., color and texture properties. In order to evaluate the similarity between two nodes, we employ a normalized single-pair Sim-Rank algorithm to compute the similarity score. Experimental evaluation on a number of image pairs demonstrates the good performance of the proposed method on the co-saliency detection task.
引用
收藏
页码:3365 / 3375
页数:11
相关论文
共 45 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]  
[Anonymous], 2002, P 8 ACM SIGKDD INT C
[3]  
[Anonymous], 1955, PRINCIPLES GESTALT P
[4]   Deictic codes for the embodiment of cognition [J].
Ballard, DH ;
Hayhoe, MM ;
Pook, PK ;
Rao, RPN .
BEHAVIORAL AND BRAIN SCIENCES, 1997, 20 (04) :723-+
[5]  
Batra D., 2009, P IEEE INT C IM PROC
[6]   On the distribution of saliency [J].
Berengolts, Alexander ;
Lindenbaum, Michael .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :1973-1990
[7]  
Boykov YY, 2001, EIGHTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOL I, PROCEEDINGS, P105, DOI 10.1109/ICCV.2001.937505
[8]   Dynamic bit allocation for multiple video object coding [J].
Chen, Zhenzhong ;
Han, Junwei ;
Ngan, King Ngi .
IEEE TRANSACTIONS ON MULTIMEDIA, 2006, 8 (06) :1117-1124
[9]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[10]  
Cho MS, 2008, LECT NOTES COMPUT SC, V5305, P144