A Co-Saliency Model of Image Pairs

被引:217
作者
Li, Hongliang [1 ]
Ngan, King Ngi [2 ]
机构
[1] Univ Elect Sci & Technol China, Sch Elect Engn, Chengdu 610054, Peoples R China
[2] Chinese Univ Hong Kong, Dept Elect Engn, Hong Kong, Hong Kong, Peoples R China
关键词
Attention model; co-saliency; similarity; Sim-Rank; VIDEO SEGMENTATION; FACE SEGMENTATION; VISUAL-ATTENTION; TRACKING; OBJECTS;
D O I
10.1109/TIP.2011.2156803
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we introduce a method to detect co-saliency from an image pair that may have some objects in common. The co-saliency is modeled as a linear combination of the single-image saliency map (SISM) and the multi-image saliency map (MISM). The first term is designed to describe the local attention, which is computed by using three saliency detection techniques available in literature. To compute the MISM, a co-multilayer graph is constructed by dividing the image pair into a spatial pyramid representation. Each node in the graph is described by two types of visual descriptors, which are extracted from a representation of some aspects of local appearance, e. g., color and texture properties. In order to evaluate the similarity between two nodes, we employ a normalized single-pair Sim-Rank algorithm to compute the similarity score. Experimental evaluation on a number of image pairs demonstrates the good performance of the proposed method on the co-saliency detection task.
引用
收藏
页码:3365 / 3375
页数:11
相关论文
共 45 条
[21]   Saliency model-based face segmentation and tracking in head-and-shoulder video sequences [J].
Li, Hongliang ;
Ngan, King N. .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2008, 19 (05) :320-333
[22]   Unsupervized video segmentation with low depth of field [J].
Li, Hongliang ;
Ngan, King N. .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2007, 17 (12) :1742-1751
[23]   Automatic video segmentation and tracking for content-based applications [J].
Li, Hongliang ;
Ngan, King N. .
IEEE COMMUNICATIONS MAGAZINE, 2007, 45 (01) :27-33
[24]   FaceSeg: Automatic Face Segmentation for Real-Time Video [J].
Li, Hongliang ;
Ngan, King N. ;
Liu, Qiang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2009, 11 (01) :77-88
[25]  
Liao JC, 2010, EBM 2010: INTERNATIONAL CONFERENCE ON ENGINEERING AND BUSINESS MANAGEMENT, VOLS 1-8, P4057
[26]  
Mahadevan V, 2009, PROC CVPR IEEE, P1007, DOI 10.1109/CVPRW.2009.5206573
[27]  
Mori G, 2004, PROC CVPR IEEE, P326
[28]  
Mukherjee L, 2009, PROC CVPR IEEE, P2028, DOI 10.1109/CVPRW.2009.5206652
[29]  
Rahtu E, 2010, LECT NOTES COMPUT SC, V6315, P366, DOI 10.1007/978-3-642-15555-0_27
[30]  
Ren XF, 2003, NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, P10