Multiscale Location Attention Network for Building and Water Segmentation of Remote Sensing Image

被引:65
作者
Dai, Xin [1 ]
Xia, Min [1 ]
Weng, Liguo [1 ]
Hu, Kai [1 ]
Lin, Haifeng [2 ]
Qian, Ming [3 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equipm, Nanjing 210044, Peoples R China
[2] Nanjing Forestry Univ, Coll Informat Sci & Technol, Nanjing 210037, Peoples R China
[3] Wuhan Univ, State Key Lab LIESMARS, Wuhan 430072, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Image segmentation; Buildings; Feature extraction; Convolution; Semantics; Remote sensing; Water resources; Attention; building and water; deep learning; image segmentation;
D O I
10.1109/TGRS.2023.3276703
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Traditional building and water segmentation methods are vulnerable to noise interference, and hence, they could not avoid missed and false detections in the detection process. Excessive deep learning downsampling would lead to significant loss of feature map information, image location information offset, and the overall effect of falling apart. To address these issues, a multiscale location attention network (MSLANet) is proposed. Location-spatial information and channel information are particularly important for edge detail segmentation in building and water cover. The network includes a location channel attention (LCA) unit to focus on tributary details of rivers and segmentation of building edge eaves. Moreover, this article builds a dual-branch multiscale aggregation (DBMSA) unit to obtain deeper multiscale semantic information. Finally, the multiscale fusion unit (MSF) is used to guide the information merging of multiple stages, and the boundary information is improved by splicing the acquired deep multiscale information with the information of the relevant feature extraction layer in the downsampling. The experimental results on several datasets show that the proposed approach outperforms other methodologies in segmentation accuracy.
引用
收藏
页数:19
相关论文
共 45 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   Attention Augmented Convolutional Networks [J].
Bello, Irwan ;
Zoph, Barret ;
Vaswani, Ashish ;
Shlens, Jonathon ;
Le, Quoc V. .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :3285-3294
[3]   MANet: a multi-level aggregation network for semantic segmentation of high-resolution remote sensing images [J].
Chen, Bingyu ;
Xia, Min ;
Qian, Ming ;
Huang, Junqing .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (15-16) :5874-5894
[4]   MFANet: A Multi-Level Feature Aggregation Network for Semantic Segmentation of Land Cover [J].
Chen, Bingyu ;
Xia, Min ;
Huang, Junqing .
REMOTE SENSING, 2021, 13 (04) :1-20
[5]   Building Extraction from Remote Sensing Images with Sparse Token Transformers [J].
Chen, Keyan ;
Zou, Zhengxia ;
Shi, Zhenwei .
REMOTE SENSING, 2021, 13 (21)
[6]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[7]   Enhanced contextual representation with deep neural networks for land cover classification based on remote sensing images [J].
Cheng, Xijie ;
He, Xiaohui ;
Qiao, Mengjia ;
Li, Panle ;
Hu, Shaokai ;
Chang, Peng ;
Tian, Zhihui .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 107
[8]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[9]   GCCINet: Global feature capture and cross-layer information interaction network for building extraction from remote sensing imagery [J].
Feng, Dejun ;
Chen, Hongyu ;
Xie, Yakun ;
Liu, Zichen ;
Liao, Ziyang ;
Zhu, Jun ;
Zhang, Heng .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2022, 114
[10]   Dual Attention Network for Scene Segmentation [J].
Fu, Jun ;
Liu, Jing ;
Tian, Haijie ;
Li, Yong ;
Bao, Yongjun ;
Fang, Zhiwei ;
Lu, Hanqing .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3141-3149