Saliency Detection Using Global and Local Information Under Multilayer Cellular Automata

被引:3
作者
Liu, Yihang [1 ]
Yuan, Peiyan [1 ]
机构
[1] Henan Normal Univ, Coll Comp & Informat Engn, Xinxiang 453007, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
Saliency detection; global and local maps; multilayer cellular automata; CNN-based encoder-decoder model; sparse coding; OBJECT DETECTION;
D O I
10.1109/ACCESS.2019.2915261
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To detect the salient object in natural images with low contrast and complex backgrounds, a saliency detection method that fuses global and local information under multilayer cellular automata is proposed. First, a global saliency map was obtained by the iteratively trained convolutional neural network (CNN)-based encoder-decoder model. Moreover, to transmit high-level information to the lower-level layers and further reinforce the object edge, the skip connections and edge penalty term were added to the network. Second, the foreground and background codebooks were generated by the global saliency map, and sparse coding was subsequently obtained by the locality-constrained linear coding model. Thus, a local saliency map was generated. Finally, the final saliency map was obtained by fusing the global and local saliency maps under the multilayer cellular automata framework. The experimental results show that the average F-measure of our method on the MSRA 10K, ECSSD, DUT-OMRON, HKU-IS, THUR 15K, and XPIE datasets is 93.4%, 89.5%, 79.4%, 88.7%, 73.6%, and 85.2%, respectively, and the MAE is 0.046, 0.067, 0.054, 0.044, 0.072, and 0.049. Ultimately, these findings prove that our method has both high saliency detection accuracies and strong generalization abilities. In particular, our method can effectively detect the salient object of natural images with low contrast and complex backgrounds.
引用
收藏
页码:72736 / 72748
页数:13
相关论文
共 39 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
[Anonymous], 2010, Computer Vision and Pattern Recognition (CVPR), 2010 IEEE Conference on, DOI DOI 10.1109/CVPR.2010.5540018
[3]  
[Anonymous], 2017, P IEEE C COMP VIS PA, DOI DOI 10.1109/CVPR.2017.468
[4]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Cheng, Ming-Ming ;
Jiang, Huaizu ;
Li, Jia .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5706-5722
[5]   Look, Perceive and Segment: Finding the Salient Objects in Images via Two-stream Fixation-Semantic CNNs [J].
Chen, Xiaowu ;
Zheng, Anlin ;
Li, Jia ;
Lu, Feng .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :1050-1058
[6]   SalientShape: group saliency in image collections [J].
Cheng, Ming-Ming ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
VISUAL COMPUTER, 2014, 30 (04) :443-453
[7]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[8]   Deeply Supervised Salient Object Detection with Short Connections [J].
Hou, Qibin ;
Cheng, Ming-Ming ;
Hu, Xiaowei ;
Borji, Ali ;
Tu, Zhuowen ;
Torr, Philip .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5300-5309
[9]   Deep Saliency with Encoded Low level Distance Map and High Level Features [J].
Lee, Gayoung ;
Tai, Yu-Wing ;
Kim, Junmo .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :660-668
[10]  
Li GB, 2015, PROC CVPR IEEE, P5455, DOI 10.1109/CVPR.2015.7299184