Real-Time Dense Semantic Labeling with Dual-Path Framework for High-Resolution Remote Sensing Image

被引:14
|
作者
Wang, Yuhao [1 ,2 ]
Chen, Chen [3 ]
Ding, Meng [4 ]
Li, Jiangyun [1 ,2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Minist Educ, Key Lab Knowledge Automat Ind Proc, Beijing 100083, Peoples R China
[3] Univ N Carolina, Dept Elect & Comp Engn, Charlotte, NC 28223 USA
[4] Thermo Fisher Sci, Richardson, TX 75081 USA
基金
中国国家自然科学基金;
关键词
remote sensing image; real-time dense semantic labeling; convolutional neural networks; light-weight;
D O I
10.3390/rs11243020
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Dense semantic labeling plays a pivotal role in high-resolution remote sensing image research. It provides pixel-level classification which is crucial in land cover mapping and urban planning. With the recent success of the convolutional neural network (CNN), accuracy has been greatly improved by previous works. However, most networks boost performance by involving too many parameters and computational overheads, which results in more inference time and hardware resources, while some attempts with light-weight networks do not achieve satisfactory results due to the insufficient feature extraction ability. In this work, we propose an efficient light-weight CNN based on dual-path architecture to address this issue. Our model utilizes three convolution layers as the spatial path to enhance the extraction of spatial information. Meanwhile, we develop the context path with the multi-fiber network (MFNet) followed by the pyramid pooling module (PPM) to obtain a sufficient receptive field. On top of these two paths, we adopt the channel attention block to refine the features from the context path and apply a feature fusion module to combine spatial information with context information. Moreover, a weighted cascade loss function is employed to enhance the learning procedure. With all these components, the performance can be significantly improved. Experiments on the Potsdam and Vaihingen datasets demonstrate that our network performs better than other light-weight networks, even some classic networks. Compared to the state-of-the-art U-Net, our model achieves higher accuracy on the two datasets with 2.5 times less network parameters and 22 times less computational floating point operations (FLOPs).
引用
收藏
页数:20
相关论文
共 50 条
  • [1] Dual-Path Feature Aware Network for Remote Sensing Image Semantic Segmentation
    Geng, Jie
    Song, Shuai
    Jiang, Wen
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (05) : 3674 - 3686
  • [2] Dense Semantic Labeling with Atrous Spatial Pyramid Pooling and Decoder for High-Resolution Remote Sensing Imagery
    Wang, Yuhao
    Liang, Binxiu
    Ding, Meng
    Li, Jiangyun
    REMOTE SENSING, 2019, 11 (01)
  • [3] Real-time Dense Stereo Matching Architecture for High-resolution Image
    Lee, Seonyoung
    Son, Haengson
    Min, Kyoungwon
    2015 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2015, : 299 - 300
  • [4] Multilevel Feature Fusion and Attention Network for High-Resolution Remote Sensing Image Semantic Labeling
    Zhang, Yijie
    Cheng, Jian
    Bai, Haiwei
    Wang, Qi
    Liang, Xingyu
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [5] Real-Time Coding Scheme for High-Resolution Remote Sensing Images
    Deng Chenwei
    Zhao Baojun
    CHINESE JOURNAL OF ELECTRONICS, 2009, 18 (03): : 444 - 448
  • [6] Calibrated Focal Loss for Semantic Labeling of High-Resolution Remote Sensing Images
    Bai, Haiwei
    Cheng, Jian
    Su, Yanzhou
    Liu, Siyu
    Liu, Xin
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 6531 - 6547
  • [7] Real-time cloud sensing for efficiency improvement of optical high-resolution satellite remote sensing
    Algra, T
    IGARSS 2003: IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOLS I - VII, PROCEEDINGS: LEARNING FROM EARTH'S SHAPES AND SIZES, 2003, : 4311 - 4313
  • [8] Dual-Path Sparse Hierarchical Network for Semantic Segmentation of Remote Sensing Images
    Wang, Yupei
    Shi, Hao
    Dong, Shan
    Zhuang, Yin
    Chen, Liang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [9] Dual-Path Feature Fusion Network for Semantic Segmentation of Remote Sensing Images
    Li, Boyang
    Zhang, Yu
    Zhang, Youmei
    Li, Bin
    Li, Zhenhao
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2024, 21 : 1 - 5
  • [10] SBSS: Stacking-Based Semantic Segmentation Framework for Very High-Resolution Remote Sensing Image
    Cai, Yuanzhi
    Fan, Lei
    Fang, Yuan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61