Co-saliency Detection Based on Convolutional Neural Network and Global Optimization

被引:2
作者
Wu Zemin [1 ]
Wang Jun [1 ]
Hu Lei [1 ]
Tian Chang [1 ]
Zeng Mingyong [1 ]
Du Lin [1 ]
机构
[1] Army Engn Univ PLA, Coll Commun Engn, Nanjing 210007, Jiangsu, Peoples R China
关键词
Co-saliency; Deep Learning; Convolutional Neural Network; Global Optimization;
D O I
10.11999/JEIT180241
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
To solve the problems in current co-saliency detection algorithms, a novel co-saliency detection algorithm is proposed which applies fully convolution neural network and global optimization model. First, a fully convolution saliency detection network is built based on VGG16Net. The network can simulate the human visual attention mechanism and extract the saliency region in an image from the semantic level. Second, based on the traditional saliency optimization model, the global co-saliency optimization model is constructed, which realizes the transmission and sharing of the current superpixel saliency value in inter-images and intra-image through superpixel matching, making the final saliency map has better co-saliency value. Third, the inter-image saliency value propagation constraint parameter is innovatively introduced to overcome the disadvantages of superpixel mismatching. Experimental results on public test datasets show that the proposed algorithm is superior over current state-of-the-art methods in terms of detection accuracy and detection efficiency, and has strong robustness.
引用
收藏
页码:2896 / 2904
页数:9
相关论文
共 25 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Interactively Co-segmentating Topically Related Images with Intelligent Scribble Guidance [J].
Batra, Dhruv ;
Kowdle, Adarsh ;
Parikh, Devi ;
Luo, Jiebo ;
Chen, Tsuhan .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2011, 93 (03) :273-292
[3]   Self-Adaptively Weighted Co-Saliency Detection via Rank Constraint [J].
Cao, Xiaochun ;
Tao, Zhiqiang ;
Zhang, Bao ;
Fu, Huazhu ;
Feng, Wei .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (09) :4175-4186
[4]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[5]   Cluster-Based Co-Saliency Detection [J].
Fu, Huazhu ;
Cao, Xiaochun ;
Tu, Zhuowen .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (10) :3766-3778
[6]  
Jacobs D. E., 2010, P 23ND ANN ACM S USE, P219
[7]   Caffe: Convolutional Architecture for Fast Feature Embedding [J].
Jia, Yangqing ;
Shelhamer, Evan ;
Donahue, Jeff ;
Karayev, Sergey ;
Long, Jonathan ;
Girshick, Ross ;
Guadarrama, Sergio ;
Darrell, Trevor .
PROCEEDINGS OF THE 2014 ACM CONFERENCE ON MULTIMEDIA (MM'14), 2014, :675-678
[8]  
Kai-Yueh Chang, 2011, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), P2129, DOI 10.1109/CVPR.2011.5995415
[9]   A Co-Saliency Model of Image Pairs [J].
Li, Hongliang ;
Ngan, King Ngi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (12) :3365-3375
[10]   DeepSaliency: Multi-Task Deep Neural Network Model for Salient Object Detection [J].
Li, Xi ;
Zhao, Liming ;
Wei, Lina ;
Yang, Ming-Hsuan ;
Wu, Fei ;
Zhuang, Yueting ;
Ling, Haibin ;
Wang, Jingdong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (08) :3919-3930