Real-Time Dense Semantic Labeling with Dual-Path Framework for High-Resolution Remote Sensing Image

被引:14
|
作者
Wang, Yuhao [1 ,2 ]
Chen, Chen [3 ]
Ding, Meng [4 ]
Li, Jiangyun [1 ,2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Minist Educ, Key Lab Knowledge Automat Ind Proc, Beijing 100083, Peoples R China
[3] Univ N Carolina, Dept Elect & Comp Engn, Charlotte, NC 28223 USA
[4] Thermo Fisher Sci, Richardson, TX 75081 USA
基金
中国国家自然科学基金;
关键词
remote sensing image; real-time dense semantic labeling; convolutional neural networks; light-weight;
D O I
10.3390/rs11243020
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Dense semantic labeling plays a pivotal role in high-resolution remote sensing image research. It provides pixel-level classification which is crucial in land cover mapping and urban planning. With the recent success of the convolutional neural network (CNN), accuracy has been greatly improved by previous works. However, most networks boost performance by involving too many parameters and computational overheads, which results in more inference time and hardware resources, while some attempts with light-weight networks do not achieve satisfactory results due to the insufficient feature extraction ability. In this work, we propose an efficient light-weight CNN based on dual-path architecture to address this issue. Our model utilizes three convolution layers as the spatial path to enhance the extraction of spatial information. Meanwhile, we develop the context path with the multi-fiber network (MFNet) followed by the pyramid pooling module (PPM) to obtain a sufficient receptive field. On top of these two paths, we adopt the channel attention block to refine the features from the context path and apply a feature fusion module to combine spatial information with context information. Moreover, a weighted cascade loss function is employed to enhance the learning procedure. With all these components, the performance can be significantly improved. Experiments on the Potsdam and Vaihingen datasets demonstrate that our network performs better than other light-weight networks, even some classic networks. Compared to the state-of-the-art U-Net, our model achieves higher accuracy on the two datasets with 2.5 times less network parameters and 22 times less computational floating point operations (FLOPs).
引用
收藏
页数:20
相关论文
共 50 条
  • [41] A Multi-Level Convolution Pyramid Semantic Fusion Framework for High-Resolution Remote Sensing Image Scene Classification and Annotation
    Sun, Xiongli
    Zhu, Qiqi
    Qin, Qianqing
    IEEE ACCESS, 2021, 9 (09): : 18195 - 18208
  • [42] Real-time high-resolution neural network with semantic guidance for crack segmentation
    Li, Yongshang
    Ma, Ronggui
    Liu, Han
    Cheng, Gaoli
    AUTOMATION IN CONSTRUCTION, 2023, 156
  • [43] Model Parameter Learning for Real-Time High-Resolution Image Enhancement
    Song, Yuda
    Zhu, Yunfang
    Du, Xin
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 (27) : 1844 - 1848
  • [44] DPNet: Dual-Path Network for Real-Time Object Detection With Lightweight Attention
    Zhou, Quan
    Shi, Huimin
    Xiang, Weikang
    Kang, Bin
    Latecki, Longin Jan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [45] DPNet: Dual-Path Network for Real-Time Object Detection With Lightweight Attention
    Zhou, Quan
    Shi, Huimin
    Xiang, Weikang
    Kang, Bin
    Latecki, Longin Jan
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (03) : 4504 - 4518
  • [46] Image cache algorithm for real-time implementation of high-resolution color image warping
    Lee Y.J.
    Ryoo J.R.
    Journal of Institute of Control, Robotics and Systems, 2016, 22 (08) : 643 - 649
  • [47] REAL-TIME, HIGH-RESOLUTION OPTICAL BEAM POSITION-SENSING DEVICE
    TODA, K
    YOSHIDA, S
    REVIEW OF SCIENTIFIC INSTRUMENTS, 1991, 62 (01): : 217 - 222
  • [48] Object discovery in high-resolution remote sensing images: a semantic perspective
    Guo, Dihua
    Xiong, Hui
    Atluri, Vijayalakshmi
    Adam, Nabil R.
    KNOWLEDGE AND INFORMATION SYSTEMS, 2009, 19 (02) : 211 - 233
  • [49] Object discovery in high-resolution remote sensing images: a semantic perspective
    Dihua Guo
    Hui Xiong
    Vijayalakshmi Atluri
    Nabil R. Adam
    Knowledge and Information Systems, 2009, 19 : 211 - 233
  • [50] High-Resolution Remote Sensing Image Segmentation Framework Based on Attention Mechanism and Adaptive Weighting
    Liu, Yifan
    Zhu, Qigang
    Cao, Feng
    Chen, Junke
    Lu, Gang
    ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2021, 10 (04)