GAMSNet: Globally aware road detection network with multi-scale residual learning

被引:52
作者
Lu, Xiaoyan [1 ]
Zhong, Yanfei [1 ,2 ]
Zheng, Zhuo [1 ]
Zhang, Liangpei [1 ,2 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Wuhan Univ, Hubei Prov Engn Res Ctr Nat Resources Remote Sens, Wuhan 430079, Peoples R China
基金
中国国家自然科学基金;
关键词
Road detection; Remote sensing; Global-aware; Multi-scale; Deep learning; NEURAL-NETWORK; EXTRACTION; IMAGES; CLASSIFICATION; FRAMEWORK;
D O I
10.1016/j.isprsjprs.2021.03.008
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
Road detection from very high-resolution (VHR) remote sensing imagery is of great importance in a broad array of applications. However, the most advanced deep learning based methods often produce fragmented road segments, due to the complex backgrounds of the images, such as the occlusions and shadows caused by trees and buildings, or the surrounding objects with similar textures. In this research, the characteristics of the existing deep learning based road detection methods are analyzed and effective road detection methods are explored, and we show that capturing long-range dependencies can significantly improve the road recognition performance. The novel globally aware road detection network with multi-scale residual learning (GAMS-Net) is proposed, in which multi-scale residual learning is applied to obtain multi-scale features and expand the receptive field, and the global awareness operation is used to capture the spatial context dependencies and inter-channel dependencies. Through capturing useful information over long distances, GAMS-Net can significantly improve the road recognition performance. The advantages of the proposed approach are validated using the public Deep-Globe road dataset and large-scale images, and the experimental results confirm the superiority of the proposed method.
引用
收藏
页码:340 / 352
页数:13
相关论文
共 42 条
[11]   Detecting urban road network accessibility problems using taxi GPS data [J].
Cui, JianXun ;
Liu, Feng ;
Janssens, Davy ;
An, Shi ;
Wets, Geert ;
Cools, Mario .
JOURNAL OF TRANSPORT GEOGRAPHY, 2016, 51 :147-157
[12]   DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Images [J].
Demir, Ilke ;
Koperski, Krzysztof ;
Lindenbaum, David ;
Pang, Guan ;
Huang, Jing ;
Bast, Saikat ;
Hughes, Forest ;
Tuia, Devis ;
Raskar, Ramesh .
PROCEEDINGS 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2018, :172-181
[13]   Semisupervised and Weakly Supervised Road Detection Based on Generative Adversarial Networks [J].
Han, Xiaofeng ;
Lu, Jianfeng ;
Zhao, Chunxia ;
You, Shaodi ;
Li, Hongdong .
IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (04) :551-555
[14]  
He K, P IEEE C COMP VIS PA, P770, DOI [DOI 10.1109/CVPR.2016.90, 10.1109/CVPR.2016.90]
[15]   UFCN: a fully convolutional neural network for road extraction in RGB imagery acquired by remote sensing from an unmanned aerial vehicle [J].
Kestur, Ramesh ;
Farooq, Shariq ;
Abdal, Rameen ;
Mehraj, Emad ;
Narasipura, Omkar ;
Mudigere, Meenavathi .
JOURNAL OF APPLIED REMOTE SENSING, 2018, 12
[16]   Region-based urban road extraction from VHR satellite images using Binary Partition Tree [J].
Li, Mengmeng ;
Stein, Alfred ;
Bijker, Wietske ;
Zhan, Qingming .
INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2016, 44 :217-225
[17]   Thin cloud removal with residual symmetrical concatenation network [J].
Li, Wenbo ;
Li, Ying ;
Chen, Di ;
Chan, Jonathan Cheung-Wai .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2019, 153 :137-150
[18]   Remixed Reality: Manipulating Space and Time in Augmented Reality [J].
Lindlbauer, David ;
Wilson, Andrew D. .
PROCEEDINGS OF THE 2018 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS (CHI 2018), 2018,
[19]   Edge-Reinforced Convolutional Neural Network for Road Detection in Very-High-Resolution Remote Sensing Imagery [J].
Lu, Xiaoyan ;
Zhong, Yanfei ;
Zheng, Zhuo ;
Zhao, Ji ;
Zhang, Liangpei .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2020, 86 (03) :153-160
[20]   Multi-Scale and Multi-Task Deep Learning Framework for Automatic Road Extraction [J].
Lu, Xiaoyan ;
Zhong, Yanfei ;
Zheng, Zhuo ;
Liu, Yanfei ;
Zhao, Ji ;
Ma, Ailong ;
Yang, Jie .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (11) :9362-9377