Lightweight multiscale framework for segmentation of high-resolution remote sensing imagery

被引:10
作者
Bello, Inuwa M. [1 ]
Zhang, Ke [1 ]
Wang, Jingyu [1 ]
Li, Haoyu [1 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Xian, Peoples R China
关键词
multiscale multispectral image; neural networks; remote sensing; image segmentation; CONVOLUTIONAL NEURAL-NETWORK; SEMANTIC SEGMENTATION; AERIAL IMAGES;
D O I
10.1117/1.JRS.15.034508
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Deep convolutional neural network semantic segmentation has played a significant role in remote sensing applications due to its capability of end-to-end training and automatic high-level features extraction. Highly accurate predictions have been recorded from different network architectures that are designed using the convolutional layers. However, the accuracy is mainly achieved at a very high cost of computation, which renders the network infeasible for real-time application on resource-constrained devices. Therefore, there is a need to establish a trade-off between accuracy and model efficiency. Our paper proposes a lightweight, highly accurate, memory-efficient segmentation network capable of deployment on resource-constrained devices. Our proposed network of 1.09 million trainable parameters attains an appreciable accuracy of 89.41% and 88.78% on the Vaihingen and Potsdam respective dataset of the ISPRS 2D Semantic Labeling Challenge. The result from the speed and the memory efficiency experiment shows that our proposed network is suitable for real-time remote sensing applications. (C) 2021 Society of Photo-Optical Instrumentation Engineers (SPIE)
引用
收藏
页数:15
相关论文
共 56 条
[1]   Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks [J].
Audebert, Nicolas ;
Le Saux, Bertrand ;
Lefevre, Sebastien .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 140 :20-32
[2]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[3]   Data synthesis methods for semantic segmentation in agriculture: A Capsicum annuum dataset [J].
Barth, R. ;
IJsselmuiden, J. ;
Hemming, J. ;
Van Henten, E. J. .
COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2018, 144 :284-296
[4]   Aerial image semantic segmentation using DCNN predicted distance maps [J].
Chai, Dengfeng ;
Newsam, Shawn ;
Huang, Jingfeng .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 161 :309-322
[5]   Symmetrical Dense-Shortcut Deep Fully Convolutional Networks for Semantic Segmentation of Very-High-Resolution Remote Sensing Images [J].
Chen, Guanzhou ;
Zhang, Xiaodong ;
Wang, Qing ;
Dai, Fan ;
Gong, Yuanfu ;
Zhu, Kun .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2018, 11 (05) :1633-1644
[6]   Semantic Segmentation of Aerial Images With Shuffling Convolutional Neural Networks [J].
Chen, Kaiqiang ;
Fu, Kun ;
Yan, Menglong ;
Gao, Xin ;
Sun, Xian ;
Wei, Xin .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2018, 15 (02) :173-177
[7]   Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation [J].
Chen, Liang-Chieh ;
Zhu, Yukun ;
Papandreou, George ;
Schroff, Florian ;
Adam, Hartwig .
COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 :833-851
[8]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[9]   Supervised methods of image segmentation accuracy assessment in land cover mapping [J].
Costa, Hugo ;
Foody, Giles M. ;
Boyd, Doreen S. .
REMOTE SENSING OF ENVIRONMENT, 2018, 205 :338-351
[10]   Very High Resolution Remote Sensing Imagery Classification Using a Fusion of Random Forest and Deep Learning Technique-Subtropical Area for Example [J].
Dong, Luofan ;
Du, Huaqiang ;
Mao, Fangjie ;
Han, Ning ;
Li, Xuejian ;
Zhou, Guomo ;
Zhu, Di'en ;
Zheng, Junlong ;
Zhang, Meng ;
Xing, Luqi ;
Liu, Tengyan .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :113-128