SPMF-Net: Weakly Supervised Building Segmentation by Combining Superpixel Pooling and Multi-Scale Feature Fusion

被引:60
作者
Chen, Jie [1 ]
He, Fen [1 ]
Zhang, Yi [1 ]
Sun, Geng [1 ]
Deng, Min [1 ]
机构
[1] Cent South Univ, Sch Geosci & Infophys, Changsha 410083, Peoples R China
基金
中国国家自然科学基金;
关键词
building detection; weakly supervised learning; superpixel; semantic segmentation; deep learning; CONVOLUTIONAL NEURAL-NETWORK; EXTRACTION;
D O I
10.3390/rs12061049
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
The lack of pixel-level labeling limits the practicality of deep learning-based building semantic segmentation. Weakly supervised semantic segmentation based on image-level labeling results in incomplete object regions and missing boundary information. This paper proposes a weakly supervised semantic segmentation method for building detection. The proposed method takes the image-level label as supervision information in a classification network that combines superpixel pooling and multi-scale feature fusion structures. The main advantage of the proposed strategy is its ability to improve the intactness and boundary accuracy of a detected building. Our method achieves impressive results on two 2D semantic labeling datasets, which outperform some competing weakly supervised methods and are close to the result of the fully supervised method.
引用
收藏
页数:13
相关论文
共 31 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Hierarchical Bayesian nets for building extraction using dense digital surface models [J].
Brunn, A ;
Weidner, U .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 1998, 53 (05) :296-307
[3]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[4]   Complex building description and extraction based on Hough transformation and cycle detection [J].
Cui, Shiyong ;
Yan, Qin ;
Reinartz, Peter .
REMOTE SENSING LETTERS, 2012, 3 (02) :151-159
[5]   BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentation [J].
Dai, Jifeng ;
He, Kaiming ;
Sun, Jian .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1635-1643
[6]  
Durand T., P IEEE C COMP VIS PA, P642
[7]   WSF-NET: Weakly Supervised Feature-Fusion Network for Binary Segmentation in Remote Sensing Image [J].
Fu, Kun ;
Lu, Wanxuan ;
Diao, Wenhui ;
Yan, Menglong ;
Sun, Hao ;
Zhang, Yi ;
Sun, Xian .
REMOTE SENSING, 2018, 10 (12)
[8]   Multiscale and Multifeature Segmentation of High-Spatial Resolution Remote Sensing Images Using Superpixels with Mutual Optimal Strategy [J].
Fu, Zhongliang ;
Sun, Yangjie ;
Fan, Liang ;
Han, Yutao .
REMOTE SENSING, 2018, 10 (08)
[9]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90
[10]  
Kwak S, 2017, AAAI CONF ARTIF INTE, P4111