A Deeply Supervised Attention Metric-Based Network and an Open Aerial Image Dataset for Remote Sensing Change Detection

被引:470
作者
Shi, Qian [1 ]
Liu, Mengxi [1 ]
Li, Shengchen [1 ]
Liu, Xiaoping [1 ]
Wang, Fei [2 ]
Zhang, Liangpei [3 ]
机构
[1] Sun Yat Sen Univ, Guangdong Prov Key Lab Urbanizat & Geosimulat, Sch Geog & Planning, Guangzhou 510275, Peoples R China
[2] Xinjiang Univ, Coll Resource & Environm Sci, Xinjiang Common Univ Key Lab Smart City & Environ, Urumqi 830046, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Data mining; Measurement; Semantics; Hyperspectral imaging; Convolutional neural networks; Benchmark testing; Change detection dataset (CDD); convolutional block attention module (CBAM); deeply supervised (DS) layers; metric learning; remote sensing change detection (CD); LAND-COVER CHANGE; CLASSIFICATION; MAD;
D O I
10.1109/TGRS.2021.3085870
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection (CD) aims to identify surface changes from bitemporal images. In recent years, deep learning (DL)-based methods have made substantial breakthroughs in the field of CD. However, CD results can be easily affected by external factors, including illumination, noise, and scale, which leads to pseudo-changes and noise in the detection map. To deal with these problems and achieve more accurate results, a deeply supervised (DS) attention metric-based network (DSAMNet) is proposed in this article. A metric module is employed in DSAMNet to learn change maps by means of deep metric learning, in which convolutional block attention modules (CBAM) are integrated to provide more discriminative features. As an auxiliary, a DS module is introduced to enhance the feature extractor's learning ability and generate more useful features. Moreover, another challenge encountered by data-driven DL algorithms is posed by the limitations in change detection datasets (CDDs). Therefore, we create a CD dataset, Sun Yat-Sen University (SYSU)-CD, for bitemporal image CD, which contains a total of 20,000 aerial image pairs of size 256 x 256. Experiments are conducted on both the CDD and the SYSU-CD dataset. Compared to other state-of-the-art methods, our network achieves the highest accuracy on both datasets, with an F1 of 93.69% on the CDD dataset and 78.18% on the SYSU-CD dataset.
引用
收藏
页数:16
相关论文
共 55 条
[1]  
[Anonymous], 2017, ACM, DOI DOI 10.1145/3065386
[2]  
[Anonymous], 2015, ARXIV150502496
[3]  
[Anonymous], 2008, ObjectBased Image Analysis: Spatial Concepts for KnowledgeDriven Remote Sensing Applications
[4]  
[Anonymous], 2006, PROC IEEE COMPUT SOC, DOI 10.1109/CVPR.2006.100
[5]   Change detection techniques for remote sensing applications: a survey [J].
Asokan, Anju ;
Anitha, J. .
EARTH SCIENCE INFORMATICS, 2019, 12 (02) :143-160
[6]   Change Detection in Optical Aerial Images by a Multilayer Conditional Mixed Markov Model [J].
Benedek, Csaba ;
Sziranyi, Tamas .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2009, 47 (10) :3416-3430
[7]   CONSTRAINED OPTICAL FLOW FOR AERIAL IMAGE CHANGE DETECTION [J].
Bourdis, Nicolas ;
Marraud, Denis ;
Sahbi, Hichem .
2011 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS), 2011, :4176-4179
[8]   MONITORING LAND-COVER CHANGE BY PRINCIPAL COMPONENT ANALYSIS OF MULTITEMPORAL LANDSAT DATA [J].
BYRNE, GF ;
CRAPPER, PF ;
MAYO, KK .
REMOTE SENSING OF ENVIRONMENT, 1980, 10 (03) :175-184
[9]   Multi-Decadal Mangrove Forest Change Detection and Prediction in Honduras, Central America, with Landsat Imagery and a Markov Chain Model [J].
Chen, Chi-Farn ;
Nguyen-Thanh Son ;
Chang, Ni-Bin ;
Chen, Cheng-Ru ;
Chang, Li-Yu ;
Valdez, Miguel ;
Centeno, Gustavo ;
Thompson, Carlos Alberto ;
Aceituno, Jorge Luis .
REMOTE SENSING, 2013, 5 (12) :6408-6426
[10]   A Spatial-Temporal Attention-Based Method and a New Dataset for Remote Sensing Image Change Detection [J].
Chen, Hao ;
Shi, Zhenwei .
REMOTE SENSING, 2020, 12 (10)