Dual Attention Feature Fusion and Adaptive Context for Accurate Segmentation of Very High-Resolution Remote Sensing Images

被引:13
作者
Shi, Hao [1 ,2 ,3 ]
Fan, Jiahe [1 ,2 ,3 ]
Wang, Yupei [1 ,2 ,3 ]
Chen, Liang [1 ,2 ,3 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Radar Res Lab, Beijing 100081, Peoples R China
[2] Beijing Key Lab Embedded Real Time Informat Proc, Beijing 100081, Peoples R China
[3] Beijing Inst Technol, Chongqing Innovat Ctr, Chongqing 401120, Peoples R China
关键词
deep learning; land cover classification; semantic segmentation; SEMANTIC SEGMENTATION; CLASSIFICATION; NETWORK;
D O I
10.3390/rs13183715
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Land cover classification of high-resolution remote sensing images aims to obtain pixel-level land cover understanding, which is often modeled as semantic segmentation of remote sensing images. In recent years, convolutional network (CNN)-based land cover classification methods have achieved great advancement. However, previous methods fail to generate fine segmentation results, especially for the object boundary pixels. In order to obtain boundary-preserving predictions, we first propose to incorporate spatially adapting contextual cues. In this way, objects with similar appearance can be effectively distinguished with the extracted global contextual cues, which are very helpful to identify pixels near object boundaries. On this basis, low-level spatial details and high-level semantic cues are effectively fused with the help of our proposed dual attention mechanism. Concretely, when fusing multi-level features, we utilize the dual attention feature fusion module based on both spatial and channel attention mechanisms to relieve the influence of the large gap, and further improve the segmentation accuracy of pixels near object boundaries. Extensive experiments were carried out on the ISPRS 2D Semantic Labeling Vaihingen data and GaoFen-2 data to demonstrate the effectiveness of our proposed method. Our method achieves better performance compared with other state-of-the-art methods.
引用
收藏
页数:18
相关论文
共 64 条
[51]   BAS4Net: Boundary-Aware Semi-Supervised Semantic Segmentation Network for Very High Resolution Remote Sensing Images [J].
Sun, Xian ;
Shi, Aijun ;
Huang, Hai ;
Mayer, Helmut .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :5398-5413
[52]  
Szegedy C, 2015, PROC CVPR IEEE, P1, DOI 10.1109/CVPR.2015.7298594
[53]   Urban Change Analysis with Multi-Sensor Multispectral Imagery [J].
Tang, Yuqi ;
Zhang, Liangpei .
REMOTE SENSING, 2017, 9 (03)
[54]   Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation [J].
Tian, Zhi ;
He, Tong ;
Shen, Chunhua ;
Yan, Youliang .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3121-3130
[55]  
Vaswani A, 2017, ADV NEUR IN, V30
[56]   Applying Surface Normal Information in Drivable Area and Road Anomaly Detection for Ground Mobile Robots [J].
Wang, Hengli ;
Fan, Rui ;
Sun, Yuxiang ;
Liu, Ming .
2020 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2020, :2706-2711
[57]   Gated Convolutional Neural Network for Semantic Segmentation in High-Resolution Images [J].
Wang, Hongzhen ;
Wang, Ying ;
Zhang, Qian ;
Xiang, Shiming ;
Pan, Chunhong .
REMOTE SENSING, 2017, 9 (05)
[58]   DenseASPP for Semantic Segmentation in Street Scenes [J].
Yang, Maoke ;
Yu, Kun ;
Zhang, Chi ;
Li, Zhiwei ;
Yang, Kuiyuan .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :3684-3692
[59]   Learning a Discriminative Feature Network for Semantic Segmentation [J].
Yu, Changqian ;
Wang, Jingbo ;
Peng, Chao ;
Gao, Changxin ;
Yu, Gang ;
Sang, Nong .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1857-1866
[60]   Hyperspectral Image Classification via Multitask Joint Sparse Representation and Stepwise MRF Optimization [J].
Yuan, Yuan ;
Lin, Jianzhe ;
Wang, Qi .
IEEE TRANSACTIONS ON CYBERNETICS, 2016, 46 (12) :2966-2977