Random Walks on Graphs for Salient Object Detection in Images

被引:149
作者
Gopalakrishnan, Viswanath [1 ]
Hu, Yiqun [1 ]
Rajan, Deepu [1 ]
机构
[1] Nanyang Technol Univ, Ctr Multimedia & Network Technol, Sch Comp Engn, Singapore 639798, Singapore
关键词
Graph modeling; random walks; semisupervised learning; visual saliency; VISUAL-ATTENTION; MODEL;
D O I
10.1109/TIP.2010.2053940
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We formulate the problem of salient object detection in images as an automatic labeling problem on the vertices of a weighted graph. The seed (labeled) nodes are first detected using Markov random walks performed on two different graphs that represent the image. While the global properties of the image are computed from the random walk on a complete graph, the local properties are computed from a sparse k-regular graph. The most salient node is selected as the one which is globally most isolated but falls on a locally compact object. A few background nodes and salient nodes are further identified based upon the random walk based hitting time to the most salient node. The salient nodes and the background nodes will constitute the labeled nodes. A new graph representation of the image that represents the saliency between nodes more accurately, the "pop-out graph" model, is computed further based upon the knowledge of the labeled salient and background nodes. A semisupervised learning technique is used to determine the labels of the unlabeled nodes by optimizing a smoothness objective label function on the newly created "pop-out graph" model along with some weighted soft constraints on the labeled nodes.
引用
收藏
页码:3232 / 3242
页数:11
相关论文
共 27 条
  • [1] [Anonymous], 2006, P SIGCHI C HUM FACT
  • [2] [Anonymous], VISUAL SALIENCY ATTE
  • [3] [Anonymous], 1995, REVERSIBLE MARKOV CH
  • [4] Bruce N., 2005, ADV NEURAL INFORM PR, V18, P155
  • [5] A visual attention model for adapting images on small displays
    Chen, LQ
    Xie, X
    Fan, X
    Ma, WY
    Zhang, HJ
    Zhou, HQ
    [J]. MULTIMEDIA SYSTEMS, 2003, 9 (04) : 353 - 364
  • [6] Cheng G., 2008, Transportation Research Board 87th Annual Meeting Compendium of Papers, P1
  • [7] Interactive image segmentation using probabilistic hypergraphs
    Ding, Lei
    Yilmaz, Alper
    [J]. PATTERN RECOGNITION, 2010, 43 (05) : 1863 - 1873
  • [8] DUCHENNE O, 2008, P IEEE C COMP VIS PA, P1
  • [9] Frintrop S, 2005, LECT NOTES COMPUT SC, V3663, P117
  • [10] Gao D., 2004, Advances in Neural Information Processing Systems, V17, P481