Multi-Feature Enhanced Building Change Detection Based on Semantic Information Guidance

被引:13
|
作者
Xue, Junkang [1 ]
Xu, Hao [2 ]
Yang, Hui [1 ,3 ,4 ,5 ]
Wang, Biao [1 ,3 ]
Wu, Penghai [1 ,3 ]
Choi, Jaewan [6 ]
Cai, Lixiao [7 ]
Wu, Yanlan [1 ,3 ]
机构
[1] Anhui Univ, Sch Resources & Environm Engn, Hefei 230601, Peoples R China
[2] Inst Spacecraft Syst Engn, Beijing 100094, Peoples R China
[3] Informat Mat & Intelligent Sensing Lab Anhui Prov, Hefei 230601, Peoples R China
[4] Anhui Univ, Inst Phys Sci, Hefei 230601, Peoples R China
[5] Anhui Univ, Inst Informat Technol, Hefei 230601, Peoples R China
[6] Chungbuk Natl Univ, Sch Civil Engn, Chungju 28644, South Korea
[7] Shandong Jianzhu Univ, Sch Design Grp, Jinan 250101, Peoples R China
基金
中国国家自然科学基金;
关键词
remote sensing; building change detection; deep learning; multi-branch; semantic information; IMAGES; NETWORK;
D O I
10.3390/rs13204171
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Building change detection has always been an important research focus in production and urbanization. In recent years, deep learning methods have demonstrated a powerful ability in the field of detecting remote sensing changes. However, due to the heterogeneity of remote sensing and the characteristics of buildings, the current methods do not present an effective means to perceive building changes or the ability to fuse multi-temporal remote sensing features, which leads to fragmented and incomplete results. In this article, we propose a multi-branched network structure to fuse the semantic information of the building changes at different levels. In this model, two accessory branches were used to guide the buildings' semantic information under different time sequences, and the main branches can merge the change information. In addition, we also designed a feature enhancement layer to further strengthen the integration of the main and accessory branch information. For ablation experiments, we designed experiments on the above optimization process. For MDEFNET, we designed experiments which compare with typical deep learning model and recent deep learning change detection methods. Experimentation with the WHU Building Change Detection Dataset showed that the method in this paper obtained accuracies of 0.8526, 0.9418, and 0.9204 in Intersection over Union (IoU), Recall, and F1 Score, respectively, which could assess building change areas with complete boundaries and accurate results.</p>
引用
收藏
页数:16
相关论文
共 50 条
  • [1] Semantic Enhanced Video Captioning with Multi-feature Fusion
    Niu, Tian-Zi
    Dong, Shan-Shan
    Chen, Zhen-Duo
    Luo, Xin
    Guo, Shanqing
    Huang, Zi
    Xu, Xin-Shun
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2023, 19 (06)
  • [2] Crack detection for nuclear containments based on multi-feature fused semantic segmentation
    Pan, Pai
    Xu, Yaming
    Xing, Cheng
    Chen, Yang
    CONSTRUCTION AND BUILDING MATERIALS, 2022, 329
  • [3] Difference Guidance Learning With Feature Alignment for Change Detection
    Liu, Yangguang
    Liu, Fang
    Liu, Jia
    Xiao, Liang
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [4] Multi-feature fusion and random multi-graph synthetic building change method
    Wang C.
    Zhang Y.
    Ji S.
    Zhang L.
    Cehui Xuebao/Acta Geodaetica et Cartographica Sinica, 2021, 50 (02): : 235 - 247
  • [5] Recognizing Image Semantic Information Through Multi-Feature Fusion and SSAE-Based Deep Network
    Yang, Xiaofeng
    Wang, Zhe
    Deng, Hongxia
    Li, Haifang
    Yao, Rong
    Gao, Peng
    Nasher, Saddam Naji Abdu
    JOURNAL OF MEDICAL SYSTEMS, 2020, 44 (02)
  • [6] Recognizing Image Semantic Information Through Multi-Feature Fusion and SSAE-Based Deep Network
    Xiaofeng Yang
    Zhe Wang
    Hongxia Deng
    Haifang Li
    Rong Yao
    Peng Gao
    Saddam naji abdu Nasher
    Journal of Medical Systems, 2020, 44
  • [7] Phishing Detection Based on Multi-Feature Neural Network
    Yu, Shuaicong
    An, Changqing
    Yu, Tao
    Zhao, Ziyi
    Li, Tianshu
    Wang, Jilong
    2022 IEEE INTERNATIONAL PERFORMANCE, COMPUTING, AND COMMUNICATIONS CONFERENCE, IPCCC, 2022,
  • [8] ESDSCNet: an enhanced shallow feature difference and semantic context network for remote sensing change detection: with building change detection as a case
    Du, Tongyao
    Ming, Dongping
    Gu, Haiyan
    Fang, Kun
    Xu, Lu
    Dong, Dehui
    Zhang, Yu
    Liu, Luheng
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (12) : 3726 - 3752
  • [9] ERMF: Edge refinement multi-feature for change detection in bitemporal remote sensing images
    Song, Zixuan
    Li, Xiongfei
    Zhu, Rui
    Wang, Zeyu
    Yang, Yu
    Zhang, Xiaoli
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2023, 116
  • [10] GLACIER INFORMATION EXTRACTION BASED ON MULTI-FEATURE COMBINATION MODEL
    Gong, J. M.
    Yang, X. M.
    Zhang, T.
    Xu, X.
    He, Y. W.
    JOINT INTERNATIONAL CONFERENCE ON THEORY, DATA HANDLING AND MODELLING IN GEOSPATIAL INFORMATION SCIENCE, 2010, 38 : 129 - 133