Detection of Co-salient Objects by Looking Deep and Wide

被引:303
作者
Zhang, Dingwen [1 ]
Han, Junwei [1 ]
Li, Chao [1 ]
Wang, Jingdong [2 ]
Li, Xuelong [3 ]
机构
[1] Northwestern Polytech Univ, Sch Automat, Xian 710072, Peoples R China
[2] Microsoft Res Asia, Beijing, Peoples R China
[3] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Xian, Peoples R China
基金
美国国家科学基金会;
关键词
Co-saliency detection; Domain adaptive convolutional neural network; Bayesian framework; COSEGMENTATION; SEGMENTATION; EXTRACTION; DISCOVERY; MODEL;
D O I
10.1007/s11263-016-0907-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a unified co-salient object detection framework by introducing two novel insights: (1) looking deep to transfer higher-level representations by using the convolutional neural network with additional adaptive layers could better reflect the sematic properties of the co-salient objects; (2) looking wide to take advantage of the visually similar neighbors from other image groups could effectively suppress the influence of the common background regions. The wide and deep information are explored for the object proposal windows extracted in each image. The window-level co-saliency scores are calculated by integrating the intra-image contrast, the intra-group consistency, and the inter-group separability via a principled Bayesian formulation and are then converted to the superpixel-level co-saliency maps through a foreground region agreement strategy. Comprehensive experiments on two existing and one newly established datasets have demonstrated the consistent performance gain of the proposed approach.
引用
收藏
页码:215 / 232
页数:18
相关论文
共 60 条
  • [1] Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
  • [2] Fully Automatic Extraction of Salient Objects from Videos in Near Real Time
    Akamine, Kazuma
    Fukuchi, Ken
    Kimura, Akisato
    Takagi, Shigeru
    [J]. COMPUTER JOURNAL, 2012, 55 (01) : 3 - 14
  • [3] [Anonymous], 2011, P IEEE MTT S INT MIC
  • [4] [Anonymous], PROC CVPR IEEE
  • [5] [Anonymous], 2013, INT C LEARN REPR ICL
  • [6] iCoseg: Interactive Co-segmentation with Intelligent Scribble Guidance
    Batra, Dhruv
    Kowdle, Adarsh
    Parikh, Devi
    Luo, Jiebo
    Chen, Tsuhan
    [J]. 2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, : 3169 - 3176
  • [7] Learning Deep Architectures for AI
    Bengio, Yoshua
    [J]. FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01): : 1 - 127
  • [8] In defense of Nearest-Neighbor based image classification
    Boiman, Oren
    Shechtman, Eli
    Irani, Michal
    [J]. 2008 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOLS 1-12, 2008, : 1992 - +
  • [9] Co-saliency Detection via Base Reconstruction
    Cao, Xiaochun
    Cheng, Yupeng
    Tao, Zhiqiang
    Fu, Huazhu
    [J]. PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, : 997 - 1000
  • [10] Self-Adaptively Weighted Co-Saliency Detection via Rank Constraint
    Cao, Xiaochun
    Tao, Zhiqiang
    Zhang, Bao
    Fu, Huazhu
    Feng, Wei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) : 4175 - 4186