GCCINet: Global feature capture and cross-layer information interaction network for building extraction from remote sensing imagery

被引:20
作者
Feng, Dejun [1 ]
Chen, Hongyu [1 ]
Xie, Yakun [1 ]
Liu, Zichen [1 ]
Liao, Ziyang [1 ]
Zhu, Jun [1 ]
Zhang, Heng [1 ,2 ,3 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Environm Engn, Chengdu 611756, Peoples R China
[2] China Railway Design Corp, Tianjin 300308, Peoples R China
[3] Natl Engn Res Ctr Digital Construct & Evaluat Urba, Tianjin 300308, Peoples R China
关键词
Building extraction; Remote sensing imagery; Global feature; Cross -layer interaction; Deep learning; INDEX;
D O I
10.1016/j.jag.2022.103046
中图分类号
TP7 [遥感技术];
学科分类号
081102 ; 0816 ; 081602 ; 083002 ; 1404 ;
摘要
The extraction of buildings from remote sensing images is a challenging task. However, existing methods are insufficiently accurate because of the diverse types of buildings, large-scale variability, and complex backgrounds in remote sensing images. There are many deficiencies of the extraction results, such as small building omission, building internal discontinuity, blurred boundary, and irregular building appearance extraction. To solve these problems, a global feature capture and cross-layer information interaction network (GCCINet) is proposed, in which the continuous atrous convolution feature enhancement module is designed to capture a larger range of multiscale building feature information by using continuous atrous convolution to generate different sizes of receptive fields, thus alleviating the problem of discontinuities and the overall appearance of irregular buildings. The global high-low feature cross-fusion module reduces the loss of local information to enhance the ability to identify small buildings through the effective cross-fusion of high-low features. The cross-layer refined fusion and boundary refinement module adopts a unique fusion method to form information fusion between different layers, obtain multiscale context information, and further refine boundaries, thus improving the capability of boundary extraction. The WHU Building Dataset and Inria Dataset are selected for validation. The results show that GCCINet performs state-of-the-art (SOTA) compared with other existing methods, and the performance of GCCINet is verified in terms of usability, interference resistance, robustness, and ablation study. Furthermore, a plug-and-play CAFE module is designed, which can introduce a few parameters to other models while improving their performance.
引用
收藏
页数:13
相关论文
共 54 条
[1]  
Awrangjeb M, 2011, INT ARCH PHOTOGRAMM, V38-3, P143
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   On Building Classification from Remote Sensor Imagery Using Deep Neural Networks and the Relation Between Classification and Reconstruction Accuracy Using Border Localization as Proxy [J].
Chatterjee, Bodhiswatta ;
Poullis, Charalambos .
2019 16TH CONFERENCE ON COMPUTER AND ROBOT VISION (CRV 2019), 2019, :41-48
[4]   ASF-Net: Adaptive Screening Feature Network for Building Footprint Extraction From Remote-Sensing Images [J].
Chen, Jun ;
Jiang, Yuxuan ;
Luo, Linbo ;
Gong, Wenping .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[5]   Building Extraction from Remote Sensing Images with Sparse Token Transformers [J].
Chen, Keyan ;
Zou, Zhengxia ;
Shi, Zhenwei .
REMOTE SENSING, 2021, 13 (21)
[6]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[7]   DR-Net: An Improved Network for Building Extraction from High Resolution Remote Sensing Image [J].
Chen, Meng ;
Wu, Jianjun ;
Liu, Leizhen ;
Zhao, Wenhui ;
Tian, Feng ;
Shen, Qiu ;
Zhao, Bingyu ;
Du, Ruohua .
REMOTE SENSING, 2021, 13 (02) :1-19
[8]   DSA-Net: A novel deeply supervised attention-guided network for building change detection in high-resolution remote sensing images [J].
Ding, Qing ;
Shao, Zhenfeng ;
Huang, Xiao ;
Altan, Orhan .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2021, 105
[9]   Efficient Occluded Road Extraction from High-Resolution Remote Sensing Imagery [J].
Feng, Dejun ;
Shen, Xingyu ;
Xie, Yakun ;
Liu, Yangge ;
Wang, Jian .
REMOTE SENSING, 2021, 13 (24)
[10]   Regularized Building Boundary Extraction From Remote Sensing Imagery Based on Augment Feature Pyramid Network and Morphological Constraint [J].
Feng, Dejun ;
Xie, Yakun ;
Xiong, Sifan ;
Hu, Jinlin ;
Hu, Minjun ;
Li, Qiang ;
Zhu, Jun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 :12212-12223