Strengthen the Feature Distinguishability of Geo-Object Details in the Semantic Segmentation of High-Resolution Remote Sensing Images

被引:14
作者
Chen, Jie [1 ]
Wang, Hao [1 ]
Guo, Ya [1 ]
Sun, Geng [1 ]
Zhang, Yi [1 ]
Deng, Min [1 ]
机构
[1] Cent South Univ, Sch Geosci & Infophys, Changsha 410083, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Image segmentation; Visualization; Remote sensing; Decoding; Data mining; Attention mechanism; geo-object details; high-resolution remote sensing imagery; multiscale feature representation; semantic segmentation; CONVOLUTIONAL NEURAL-NETWORK; SCENE CLASSIFICATION; EXTRACTION; FOREST;
D O I
10.1109/JSTARS.2021.3053067
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic segmentation is one of the hot topics in the field of remote sensing image intelligent analysis. Deep convolutional neural network (DCNN) has become a mainstream technology in semantic segmentation due to its powerful semantic feature representation. The emergence of high-resolution remote sensing imagery has provided massive detail information, but difficulties and challenges remain in the "feature representation of fine geo objects" and "feature distinction of easily confusing geo objects." To this end, this article focuses on the distinguishing features of geo-object details and proposes a novel DCNN-based semantic segmentation. First, the cascaded relation attention module is adopted to determine the relationship among different channels or positions. Then, information connection and error correction are used to capture and fuse the features of geo-object details. The output feature representations are provided by the multiscale feature module. Besides, the proposed model uses the boundary affinity loss to gain accurate and clear geo-object boundary. The experimental results on the Potsdam and Vaihingen datasets demonstrate that the proposed model can achieve excellent segmentation performance on overall accuracy and mean intersection over union. Furthermore, the results of ablation and visualization analyses also verify the feasibility and effectiveness of the proposed method.
引用
收藏
页码:2327 / 2340
页数:14
相关论文
共 47 条
[1]   Aerial LaneNet: Lane-Marking Semantic Segmentation in Aerial Imagery Using Wavelet-Enhanced Cost-Sensitive Symmetric Fully Convolutional Neural Networks [J].
Azimi, Seyed Majid ;
Fischer, Peter ;
Koerner, Marco ;
Reinartz, Peter .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (05) :2920-2938
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   SMAF-Net: Sharing Multiscale Adversarial Feature for High-Resolution Remote Sensing Imagery Semantic Segmentation [J].
Chen, Jie ;
Zhu, Jingru ;
Sun, Geng ;
Li, Jianhui ;
Deng, Min .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (11) :1921-1925
[4]   SPMF-Net: Weakly Supervised Building Segmentation by Combining Superpixel Pooling and Multi-Scale Feature Fusion [J].
Chen, Jie ;
He, Fen ;
Zhang, Yi ;
Sun, Geng ;
Deng, Min .
REMOTE SENSING, 2020, 12 (06)
[5]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[6]   Context Aggregation Network for Semantic Labeling in Aerial Images [J].
Cheng, Wensheng ;
Yang, Wen ;
Wang, Min ;
Wang, Gang ;
Chen, Jinyong .
REMOTE SENSING, 2019, 11 (10)
[7]  
Ciresan D., 2012, P ADV NEUR INF PROC, P2843
[8]   Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique-Subtropical Area for Example [J].
Dong, Luofan ;
Du, Huaqiang ;
Mao, Fangjie ;
Han, Ning ;
Li, Xuejian ;
Zhou, Guomo ;
Zhu, Di'en ;
Zheng, Junlong ;
Zhang, Meng ;
Xing, Luqi ;
Liu, Tengyan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :113-128
[9]   Deep Learning for Soil and Crop Segmentation from Remotely Sensed Data [J].
Dyson, Jack ;
Mancini, Adriano ;
Frontoni, Emanuele ;
Zingaretti, Primo .
REMOTE SENSING, 2019, 11 (16)
[10]   Dual Learning-Based Siamese Framework for Change Detection Using Bi-Temporal VHR Optical Remote Sensing Images [J].
Fang, Bo ;
Pan, Li ;
Kou, Rong .
REMOTE SENSING, 2019, 11 (11)