MFGAN: multi feature guided aggregation network for remote sensing image

被引:14
作者
Chu, Shengguang [1 ]
Li, Peng [1 ]
Xia, Min [1 ,2 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Collaborat Innovat Ctr Atmospher Environm & Equip, Nanjing 210044, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Jiangsu Key Lab Big Data Anal Technol, Nanjing 210044, Peoples R China
关键词
Change detection; Deep learning; Feature aggregation; Convolutional neural networks; SEGMENTATION; CLASSIFICATION; AREAS; MAD;
D O I
10.1007/s00521-022-06999-8
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Remote sensing image change detection is an important technology in remote sensing data analysis. Existing mainstream solutions are divided into supervised and unsupervised solutions. Among supervised methods, most remote sensing image change methods based on deep learning are related to semantic segmentation. However, these methods only use deep learning model to extract and process single-level information of the image, and do not separately train the changed and unchanged areas according to the task characteristics of change detection. Also this model do not aggregate the deep and shallow-level feature information, so many local change details cannot be detected. This paper proposes a multilateral feature-guided aggregation network. The network firstly extracts the whole information, the changed area information and the unchanged area information of remote sensing image through the main network and two auxiliary networks: difference network and assimilation network. Then, the whole information of the image is aggregated with the changed and unchanged region information by feature aggregation network (all subnetworks are composed of convolutional neural networks (CNNs)). The proposed method is end-to-end trainable, and each component in the network does not need to be trained separately.
引用
收藏
页码:10157 / 10173
页数:17
相关论文
共 54 条
[31]   Leveraging semantic segmentation for hybrid image retrieval methods [J].
Ouni, Achref ;
Royer, Eric ;
Chevaldonne, Marc ;
Dhome, Michel .
NEURAL COMPUTING & APPLICATIONS, 2022, 34 (24) :21519-21537
[32]  
Paszke A., 2016, ARXIV PREPRINT ARXIV
[33]   SemiCDNet: A Semisupervised Convolutional Neural Network for Change Detection in High Resolution Remote-Sensing Images [J].
Peng, Daifeng ;
Bruzzone, Lorenzo ;
Zhang, Yongjun ;
Guan, Haiyan ;
Ding, Haiyong ;
Huang, Xu .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07) :5891-5906
[34]   End-to-End Change Detection for High Resolution Satellite Images Using Improved UNet plus [J].
Peng, Daifeng ;
Zhang, Yongjun ;
Guan, Haiyan .
REMOTE SENSING, 2019, 11 (11)
[35]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[36]   Unsupervised Deep Transfer Learning-Based Change Detection for HR Multispectral Images [J].
Saha, Sudipan ;
Solano-Correa, Yady Tatiana ;
Bovolo, Francesca ;
Bruzzone, Lorenzo .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2021, 18 (05) :856-860
[37]   Integrating Landsat TM and SRTM-DEM derived variables with decision trees for habitat classification and change detection in complex neotropical environments [J].
Sesnie, Steven E. ;
Gessler, Paul E. ;
Finegan, Bryan ;
Thessler, Sirpa .
REMOTE SENSING OF ENVIRONMENT, 2008, 112 (05) :2145-2159
[38]  
Simonyan K, 2015, Arxiv, DOI [arXiv:1409.1556, DOI 10.48550/ARXIV.1409.1556]
[39]   The potential of remote sensing for monitoring rural land use changes and their effects on soil conditions [J].
Sommer, S ;
Hill, J ;
Megier, J .
AGRICULTURE ECOSYSTEMS & ENVIRONMENT, 1998, 67 (2-3) :197-209
[40]   A new statistical model for Markovian classification of urban areas in high-resolution SAR images [J].
Tison, C ;
Nicolas, JM ;
Tupin, F ;
Maître, H .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2004, 42 (10) :2046-2057