Strengthen the Feature Distinguishability of Geo-Object Details in the Semantic Segmentation of High-Resolution Remote Sensing Images

被引:14
作者
Chen, Jie [1 ]
Wang, Hao [1 ]
Guo, Ya [1 ]
Sun, Geng [1 ]
Zhang, Yi [1 ]
Deng, Min [1 ]
机构
[1] Cent South Univ, Sch Geosci & Infophys, Changsha 410083, Peoples R China
基金
中国国家自然科学基金;
关键词
Feature extraction; Semantics; Image segmentation; Visualization; Remote sensing; Decoding; Data mining; Attention mechanism; geo-object details; high-resolution remote sensing imagery; multiscale feature representation; semantic segmentation; CONVOLUTIONAL NEURAL-NETWORK; SCENE CLASSIFICATION; EXTRACTION; FOREST;
D O I
10.1109/JSTARS.2021.3053067
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic segmentation is one of the hot topics in the field of remote sensing image intelligent analysis. Deep convolutional neural network (DCNN) has become a mainstream technology in semantic segmentation due to its powerful semantic feature representation. The emergence of high-resolution remote sensing imagery has provided massive detail information, but difficulties and challenges remain in the "feature representation of fine geo objects" and "feature distinction of easily confusing geo objects." To this end, this article focuses on the distinguishing features of geo-object details and proposes a novel DCNN-based semantic segmentation. First, the cascaded relation attention module is adopted to determine the relationship among different channels or positions. Then, information connection and error correction are used to capture and fuse the features of geo-object details. The output feature representations are provided by the multiscale feature module. Besides, the proposed model uses the boundary affinity loss to gain accurate and clear geo-object boundary. The experimental results on the Potsdam and Vaihingen datasets demonstrate that the proposed model can achieve excellent segmentation performance on overall accuracy and mean intersection over union. Furthermore, the results of ablation and visualization analyses also verify the feasibility and effectiveness of the proposed method.
引用
收藏
页码:2327 / 2340
页数:14
相关论文
共 47 条
[11]   Learning Hierarchical Features for Scene Labeling [J].
Farabet, Clement ;
Couprie, Camille ;
Najman, Laurent ;
LeCun, Yann .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1915-1929
[12]   Multi-Resolution Weed Classification via Convolutional Neural Network and Superpixel Based Local Binary Pattern Using Remote Sensing Images [J].
Farooq, Adnan ;
Jia, Xiuping ;
Hu, Jiankun ;
Zhou, Jun .
REMOTE SENSING, 2019, 11 (14)
[13]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149
[14]   Learning and Adapting Robust Features for Satellite Image Segmentation on Heterogeneous Data Sets [J].
Ghassemi, Sina ;
Fiandrotti, Attilio ;
Francini, Gianluca ;
Magli, Enrico .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (09) :6517-6529
[15]  
Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
[16]   Automatic building extraction from high-resolution aerial images and LiDAR data using gated residual refinement network [J].
Huang, Jianfeng ;
Zhang, Xinchang ;
Xin, Qinchuan ;
Sun, Ying ;
Zhang, Pengcheng .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 151 :91-105
[17]   Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set [J].
Ji, Shunping ;
Wei, Shiqing ;
Lu, Meng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (01) :574-586
[18]   Adaptive Affinity Fields for Semantic Segmentation [J].
Ke, Tsung-Wei ;
Hwang, Jyh-Jing ;
Liu, Ziwei ;
Yu, Stella X. .
COMPUTER VISION - ECCV 2018, PT I, 2018, 11205 :605-621
[19]   DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation [J].
Li, Hanchao ;
Xiong, Pengfei ;
Fan, Haoqiang ;
Sun, Jian .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :9514-9523
[20]   Expectation-Maximization Attention Networks for Semantic Segmentation [J].
Li, Xia ;
Zhong, Zhisheng ;
Wu, Jianlong ;
Yang, Yibo ;
Lin, Zhouchen ;
Liu, Hong .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9166-9175