RADANet: Road Augmented Deformable Attention Network for Road Extraction From Complex High-Resolution Remote-Sensing Images

被引:67
作者
Dai, Ling [1 ]
Zhang, Guangyun [1 ]
Zhang, Rongting [1 ]
机构
[1] Nanjing Tech Univ, Sch Geomat Sci & Technol, Nanjing 211816, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
基金
中国国家自然科学基金;
关键词
Deformable attention; high-resolution remote sensing images; road augmentation module (RAM); road extraction; RECOGNITION; AWARE;
D O I
10.1109/TGRS.2023.3237561
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Extracting roads from complex high-resolution remote sensing images to update road networks has become a recent research focus. How to apply the contextual spatial correlation and topological structure of the roads properly to improve the extraction accuracy becomes a challenge in the increasingly complex road environment. In this article, inspired by the prior knowledge of the road shape and the progress in deformable convolution, we proposed a road augmented deformable attention network (RADANet) to learn the long-range dependencies for specific road pixels. We developed a road augmentation module (RAM) to capture the semantic shape information of the road from four strip convolutions. Deformable attention module (DAM) combines the sparse sampling capability of deformable convolution with the spatial self-attention mechanism. The integration of RAM enables DAM to extract road features more specifically. Furthermore, RAM is placed behind the fourth stage of encoder, and DAM is placed between last four stages of encoder and decoder in RADANet to extract multiscale road semantic information. Comprehensive experiments on representative public datasets (DeepGlobe and CHN6-CUG road datasets) demonstrate that our RADANet achieves advanced results compared with the state-of-the-art methods.
引用
收藏
页数:13
相关论文
共 66 条
[41]   U-Net: Convolutional Networks for Biomedical Image Segmentation [J].
Ronneberger, Olaf ;
Fischer, Philipp ;
Brox, Thomas .
MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION, PT III, 2015, 9351 :234-241
[42]   Multiple Object Extraction from Aerial imagery with Convolutional Neural Networks [J].
Saito, Shunta ;
Yamashita, Takayoshi ;
Aoki, Yoshimitsu .
JOURNAL OF IMAGING SCIENCE AND TECHNOLOGY, 2016, 60 (01)
[43]   Automated Geospatial Conflation of Vector Road Maps to High Resolution Imagery [J].
Song, Wenbo ;
Keller, James M. ;
Haithcoat, Timothy L. ;
Davis, Curt H. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (02) :388-400
[44]   A Bayesian approach to classification of multiresolution remote sensing data [J].
Storvik, G ;
Fjortoft, R ;
Solberg, AHS .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2005, 43 (03) :539-547
[45]   Leveraging Crowdsourced GPS Data for Road Extraction from Aerial Imagery [J].
Sun, Tao ;
Di, Zonglin ;
Che, Pengyu ;
Liu, Chun ;
Wang, Yin .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7501-7510
[46]   Non-local Neural Networks [J].
Wang, Xiaolong ;
Girshick, Ross ;
Gupta, Abhinav ;
He, Kaiming .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7794-7803
[47]   NL-LinkNet: Toward Lighter But More Accurate Road Extraction With Nonlocal Operations [J].
Wang, Yooseung ;
Seo, Junghoon ;
Jeon, Taegyun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[48]   A higher-order CRF model for road network extraction [J].
Wegner, Jan D. ;
Montoya-Zegarra, Javier A. ;
Schindler, Konrad .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :1698-1705
[49]   HsgNet: A Road Extraction Network Based on Global Perception of High-Order Spatial Information [J].
Xie, Yan ;
Miao, Fang ;
Zhou, Kai ;
Peng, Jing .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2019, 8 (12)
[50]   Attention-Based Pyramid Network for Segmentation and Classification of High-Resolution and Hyperspectral Remote Sensing Images [J].
Xu, Qingsong ;
Yuan, Xin ;
Ouyang, Chaojun ;
Zeng, Yue .
REMOTE SENSING, 2020, 12 (21) :1-34