Superpixel Segmentation Based on Spatially Constrained Subspace Clustering

被引:12
作者
Li, Hua [1 ,2 ]
Jia, Yuheng [3 ]
Cong, Runmin [4 ,5 ]
Wu, Wenhui [6 ]
Kwong, Sam Tak Wu [2 ,7 ]
Chen, Chuanbo [1 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Software Engn, Wuhan 430074, Peoples R China
[2] City Univ Hong Kong, Dept Comp Sci, Kowloon, Hong Kong 999077, Peoples R China
[3] Southeast Univ, Sch Comp Sci & Engn, Nanjing 211189, Peoples R China
[4] Beijing Jiaotong Univ, Inst Informat Sci, Beijing 100044, Peoples R China
[5] Beijing Key Lab Adv Informat Sci & Network Techno, Beijing 100044, Peoples R China
[6] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518060, Peoples R China
[7] City Univ Hong Kong, Shenzhen Res Inst, Shenzhen 518057, Peoples R China
基金
中国博士后科学基金;
关键词
Image segmentation; Task analysis; Correlation; Electronic mail; Encoding; Clustering algorithms; Urban areas; Locality-constrained; spatial correlation; subspace clustering; superpixel segmentation; ALGORITHM; LEVEL;
D O I
10.1109/TII.2020.3044068
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Superpixel segmentation aims at dividing the input image into some representative regions containing pixels with similar and consistent intrinsic properties, without any prior knowledge about the shape and size of each superpixel. In this article, to alleviate the limitation of superpixel segmentation applied in practical industrial tasks that detailed boundaries are difficult to be kept, we regard each representative region with independent semantic information as a subspace, and correspondingly formulate superpixel segmentation as a subspace clustering problem to preserve more detailed content boundaries. We show that a simple integration of superpixel segmentation with the conventional subspace clustering does not effectively work due to the spatial correlation of the pixels within a superpixel, which may lead to boundary confusion and segmentation error when the correlation is ignored. Consequently, we devise a spatial regularization and propose a novel convex locality-constrained subspace clustering model that is able to constrain the spatial adjacent pixels with similar attributes to be clustered into a superpixel and generate the content-aware superpixels with more detailed boundaries. Finally, the proposed model is solved by an efficient alternating direction method of multipliers solver. Experiments on different standard datasets demonstrate that the proposed method achieves superior performance both quantitatively and qualitatively compared with some state-of-the-art methods.
引用
收藏
页码:7501 / 7512
页数:12
相关论文
共 38 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
[Anonymous], 2015, VISAPP
[3]  
Bach F, 2012, OPTIMIZATION FOR MACHINE LEARNING, P19
[4]   ALGORITHM - SOLUTION OF MATRIX EQUATION AX+XB = C [J].
BARTELS, RH ;
STEWART, GW .
COMMUNICATIONS OF THE ACM, 1972, 15 (09) :820-&
[5]  
Boyd S., 2011, Distributed Optimization and Statistical Learning Via the Alternating Direction Method of Multipliers, DOI [DOI 10.1561/2200000016, 10.1561/2200000016]
[6]   Linear Spectral Clustering Superpixel [J].
Chen, Jiansheng ;
Li, Zhengqin ;
Huang, Bo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (07) :3317-3330
[7]   An Effective Subsuperpixel-Based Approach for Background Subtraction [J].
Chen, Yu-Qiu ;
Sun, Zhan-Li ;
Lam, Kin-Man .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2020, 67 (01) :601-609
[8]   An Iterative Co-Saliency Framework for RGBD Images [J].
Cong, Runmin ;
Lei, Jianjun ;
Fu, Huazhu ;
Lin, Weisi ;
Huang, Qingming ;
Cao, Xiaochun ;
Hou, Chunping .
IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (01) :233-246
[9]   Co-Saliency Detection for RGBD Images Based on Multi-Constraint Feature Matching and Cross Label Propagation [J].
Cong, Runmin ;
Lei, Jianjun ;
Fu, Huazhu ;
Huang, Qingming ;
Cao, Xiaochun ;
Hou, Chunping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (02) :568-579
[10]   The Cityscapes Dataset for Semantic Urban Scene Understanding [J].
Cordts, Marius ;
Omran, Mohamed ;
Ramos, Sebastian ;
Rehfeld, Timo ;
Enzweiler, Markus ;
Benenson, Rodrigo ;
Franke, Uwe ;
Roth, Stefan ;
Schiele, Bernt .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3213-3223