Position-Aware Graph-CNN Fusion Network: An Integrated Approach Combining Geospatial Information and Graph Attention Network for Multiclass Change Detection

被引:29
作者
Wang, Moyang [1 ]
Li, Xiang [1 ,2 ,3 ]
Tan, Kun [1 ]
Mango, Joseph [4 ]
Pan, Chen [5 ]
Zhang, Di [1 ]
机构
[1] East China Normal Univ, Key Lab Geog Informat Sci, Minist Educ, Shanghai 200241, Peoples R China
[2] East China Normal Univ, Shanghai Key Lab Urban Ecol Proc & Ecorestorat, Shanghai 200241, Peoples R China
[3] East China Normal Univ, Key Lab Spatial Temporal Big Data Anal & Applicat, Minist Nat Resources, Shanghai 200241, Peoples R China
[4] Univ Dar Es Salaam, Dept Transportat & Geotech Engn, Dar Es Salaam, Tanzania
[5] Shanghai Municipal Inst Surveying & Mapping, Shanghai 200063, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2024年 / 62卷
关键词
Deep learning; Geospatial analysis; Semantics; Remote sensing; Convolutional neural networks; Artificial intelligence; Task analysis; Geospatial artificial intelligence (GeoAI); graph attention network (GAT); multiclass change detection (MCD); position information encoding; urban changes; NET;
D O I
10.1109/TGRS.2024.3350573
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Urban change detection (CD) is crucial for informed decision-making but faces various challenges, including complex features, rapid changes, and extensive human interventions. These challenges underscore the urgent need for innovative multiclass CD (MCD) techniques that extensively incorporate deep learning (DL). Despite several successes achieved with the DL-based MCD methods, still certain shortcomings persist, including the disregard for spatial principles, which significantly hinders the seamless integration of geoscience-knowledge and artificial-intelligence. In this article, a novel DL model known as the position-aware graph-convolutional neural network (CNN) fusion network (PGCFN) is introduced, integrating spatial position encoding to effectively detect urban changes. The model's first part encodes geospatial positions following Tobler's first law (TFL) of geography. It then integrates encoded positions into an MCD model, combining a graph attention network (GAT) with a CNN to enhance performance. The model was tested on 0.5-m resolution remote sensing (RS) images, achieving an impressive minimum mean intersection over union (MIoU) score of 91.20%. Additionally, the model's position-aware graph attention module exhibited a strong emphasis on geographic proximity when evaluating connections between superpixels. Overall, these findings affirm that our model could effectively addresses urban CD challenges and significantly enhances the integration of geoscience knowledge and artificial intelligence (AI).
引用
收藏
页码:1 / 16
页数:16
相关论文
共 50 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
[Anonymous], 1996, Remote Sensing Reviews, DOI [10.1080/02757259609532305, DOI 10.1080/02757259609532305]
[3]   Change detection techniques for remote sensing applications: a survey [J].
Asokan, Anju ;
Anitha, J. .
EARTH SCIENCE INFORMATICS, 2019, 12 (02) :143-160
[4]   A General Survey on Attention Mechanisms in Deep Learning [J].
Brauwers, Gianni ;
Frasincar, Flavius .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (04) :3279-3298
[5]   Xception: Deep Learning with Depthwise Separable Convolutions [J].
Chollet, Francois .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1800-1807
[6]   Multitask learning for large-scale semantic change detection [J].
Daudt, Rodrigo Caye ;
Le Saux, Bertrand ;
Boulch, Alexandre ;
Gousseau, Yann .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2019, 187
[7]  
Daudt RC, 2018, INT GEOSCI REMOTE SE, P2115, DOI 10.1109/IGARSS.2018.8518015
[8]   Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Images [J].
Ding, Lei ;
Guo, Haitao ;
Liu, Sicong ;
Mou, Lichao ;
Zhang, Jing ;
Bruzzone, Lorenzo .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[9]   Geoscience-aware deep learning: A new paradigm for remote sensing [J].
Ge, Yong ;
Zhang, Xining ;
Atkinson, Peter M. ;
Stein, Alfred ;
Li, Lianfa .
SCIENCE OF REMOTE SENSING, 2022, 5
[10]   Effect of Attention Mechanism in Deep Learning-Based Remote Sensing Image Processing: A Systematic Literature Review [J].
Ghaffarian, Saman ;
Valente, Joao ;
van der Voort, Mariska ;
Tekinerdogan, Bedir .
REMOTE SENSING, 2021, 13 (15)