A Deeply Supervised Attention Metric-Based Network and an Open Aerial Image Dataset for Remote Sensing Change Detection

被引:470
作者
Shi, Qian [1 ]
Liu, Mengxi [1 ]
Li, Shengchen [1 ]
Liu, Xiaoping [1 ]
Wang, Fei [2 ]
Zhang, Liangpei [3 ]
机构
[1] Sun Yat Sen Univ, Guangdong Prov Key Lab Urbanizat & Geosimulat, Sch Geog & Planning, Guangzhou 510275, Peoples R China
[2] Xinjiang Univ, Coll Resource & Environm Sci, Xinjiang Common Univ Key Lab Smart City & Environ, Urumqi 830046, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Feature extraction; Data mining; Measurement; Semantics; Hyperspectral imaging; Convolutional neural networks; Benchmark testing; Change detection dataset (CDD); convolutional block attention module (CBAM); deeply supervised (DS) layers; metric learning; remote sensing change detection (CD); LAND-COVER CHANGE; CLASSIFICATION; MAD;
D O I
10.1109/TGRS.2021.3085870
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Change detection (CD) aims to identify surface changes from bitemporal images. In recent years, deep learning (DL)-based methods have made substantial breakthroughs in the field of CD. However, CD results can be easily affected by external factors, including illumination, noise, and scale, which leads to pseudo-changes and noise in the detection map. To deal with these problems and achieve more accurate results, a deeply supervised (DS) attention metric-based network (DSAMNet) is proposed in this article. A metric module is employed in DSAMNet to learn change maps by means of deep metric learning, in which convolutional block attention modules (CBAM) are integrated to provide more discriminative features. As an auxiliary, a DS module is introduced to enhance the feature extractor's learning ability and generate more useful features. Moreover, another challenge encountered by data-driven DL algorithms is posed by the limitations in change detection datasets (CDDs). Therefore, we create a CD dataset, Sun Yat-Sen University (SYSU)-CD, for bitemporal image CD, which contains a total of 20,000 aerial image pairs of size 256 x 256. Experiments are conducted on both the CDD and the SYSU-CD dataset. Compared to other state-of-the-art methods, our network achieves the highest accuracy on both datasets, with an F1 of 93.69% on the CDD dataset and 78.18% on the SYSU-CD dataset.
引用
收藏
页数:16
相关论文
共 55 条
[21]   Support Vector Reduction in SVM Algorithm for Abrupt Change Detection in Remote Sensing [J].
Habib, Tarek ;
Inglada, Jordi ;
Mercier, Gregoire ;
Chanussot, Jocelyn .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2009, 6 (03) :606-610
[22]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[23]   From W-Net to CDGAN: Bitemporal Change Detection via Deep Learning Techniques [J].
Hou, Bin ;
Liu, Qingjie ;
Wang, Heng ;
Wang, Yunhong .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (03) :1790-1802
[24]   Change detection from remotely sensed images: From pixel-based to object-based approaches [J].
Hussain, Masroor ;
Chen, Dongmei ;
Cheng, Angela ;
Wei, Hui ;
Stanley, David .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2013, 80 :91-106
[25]   A change detection model based on neighborhood correlation image analysis and decision tree classification [J].
Im, J ;
Jensen, JR .
REMOTE SENSING OF ENVIRONMENT, 2005, 99 (03) :326-340
[26]  
Ioffe S, 2015, PR MACH LEARN RES, V37, P448
[27]   SPECTRAL INDEXES IN N-SPACE [J].
JACKSON, RD .
REMOTE SENSING OF ENVIRONMENT, 1983, 13 (05) :409-421
[28]   Fully Convolutional Networks for Multisource Building Extraction From an Open Aerial and Satellite Imagery Data Set [J].
Ji, Shunping ;
Wei, Shiqing ;
Lu, Meng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (01) :574-586
[29]   Change vector analysis: a technique for the multispectral monitoring of land cover and condition [J].
Johnson, RD ;
Kasischke, ES .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 1998, 19 (03) :411-426
[30]  
Lee CY, 2015, JMLR WORKSH CONF PRO, V38, P562