Progressive Guidance Edge Perception Network for Semantic Segmentation of Remote-Sensing Images

被引:10
作者
Pan, Shaoming [1 ]
Tao, Yulong [1 ]
Chen, Xiaoshu [1 ]
Chong, Yanwen [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Semantics; Convolution; Noise measurement; Remote sensing; Image segmentation; Feature extraction; Decoding; Encoder-decoder structure; high-level information; noisy features; remote-sensing images; semantic segmentation;
D O I
10.1109/LGRS.2021.3058427
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Remarkable improvements have been seen in the semantic segmentation of remote-sensing images. As an effective structure to aggregate shallow information and deep information, encoder-decoder structure has been widely used in many state-of-the-art models, but it possesses two drawbacks that have not been fully addressed. On the one hand, encoder-decoder structure fuses the features obtained from shallow and deep layers directly; despite harvesting some detailed information, it also brings in noisy features owing to the poor discriminant ability of the shallow layers. On the other hand, existing encoder-decoder structure merely fuses the high-level information generated by the last layer of encoder once, which neglects its guidance ability to the feature aggregation process in the decoder. In this letter, we first propose an edge perception module (EPM) to eliminate the noisy features in the shallow information, as well as enhance features' structural information. And then, we generate the most suitable guidance information adaptively for different stages in the decoder through high-level information module (HIM). Finally, we apply the guidance information to achieve feature aggregation in the feature aggregation module (FAM). Combined with EPM, HIM, and FAM, our proposed model achieves 89.5% overall accuracy (OA) on the challenging ISPRS Vaihingen test set, which is the new state-of-the-art in the semantic segmentation of remote-sensing images.
引用
收藏
页数:5
相关论文
共 13 条
[1]   Recurrent Multiresolution Convolutional Networks for VHR Image Classification [J].
Bergado, John Ray ;
Persello, Claudio ;
Stein, Alfred .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (11) :6361-6374
[2]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[3]   Dual context prior and refined prediction for semantic segmentation [J].
Chen, Long ;
Liu, Jiajie ;
Li, Han ;
Zhan, Wujing ;
Zhou, Baoding ;
Li, Qingquan .
GEO-SPATIAL INFORMATION SCIENCE, 2021, 24 (02) :228-240
[4]   AugFPN: Improving Multi-scale Feature Learning for Object Detection [J].
Guo, Chaoxu ;
Fan, Bin ;
Zhang, Qian ;
Xiang, Shiming ;
Pan, Chunhong .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, :12592-12601
[5]  
HE K, 2016, IDENTITY MAPPINGS DE, DOI [10.1007/978-3-319-46493-0_38, DOI 10.1007/978-3-319-46493-0_38, DOI 10.1109/CVPR.2016.90]
[6]   RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation [J].
Lin, Guosheng ;
Milan, Anton ;
Shen, Chunhua ;
Reid, Ian .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5168-5177
[7]   Semantic labeling in very high resolution images via a self-cascaded convolutional neural network [J].
Liu, Yongcheng ;
Fan, Bin ;
Wang, Lingfeng ;
Bai, Jun ;
Xiang, Shiming ;
Pan, Chunhong .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 145 :78-95
[8]   A Relation-Augmented Fully Convolutional Network for Semantic Segmentation in Aerial Scenes [J].
Mou, Lichao ;
Hua, Yuansheng ;
Zhu, Xiao Xiang .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :12408-12417
[9]   Densely Based Multi-Scale and Multi-Modal Fully Convolutional Networks for High-Resolution Remote-Sensing Image Semantic Segmentation [J].
Peng, Cheng ;
Li, Yangyang ;
Jiao, Licheng ;
Chen, Yanqiao ;
Shang, Ronghua .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2019, 12 (08) :2612-2626
[10]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241