Multi-Branch Deep Learning Framework for Land Scene Classification in Satellite Imagery

被引:20
作者
Khan, Sultan Daud [1 ]
Basalamah, Saleh [2 ]
机构
[1] Natl Univ Technol, Dept Comp Sci, Islamabad 44000, Pakistan
[2] Umm Al Qura Univ, Dept Comp Engn, Mecca 24382, Saudi Arabia
关键词
scene classification; aerial imagery; deep learning; multi-scale model; remote sensing; scene understanding; BENCHMARK; SALIENCY; NETWORK; COVER; MODEL;
D O I
10.3390/rs15133408
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Land scene classification in satellite imagery has a wide range of applications in remote surveillance, environment monitoring, remote scene analysis, Earth observations and urban planning. Due to immense advantages of the land scene classification task, several methods have been proposed during recent years to automatically classify land scenes in remote sensing images. Most of the work focuses on designing and developing deep networks to identify land scenes from high-resolution satellite images. However, these methods face challenges in identifying different land scenes. Complex texture, cluttered background, extremely small size of objects and large variations in object scale are the common challenges that restrict the models to achieve high performance. To tackle these challenges, we propose a multi-branch deep learning framework that efficiently combines global contextual features with multi-scale features to identify complex land scenes. Generally, the framework consists of two branches. The first branch extracts global contextual information from different regions of the input image, and the second branch exploits a fully convolutional network (FCN) to extract multi-scale local features. The performance of the proposed framework is evaluated on three benchmark datasets, UC-Merced, SIRI-WHU, and EuroSAT. From the experiments, we demonstrate that the framework achieves superior performance compared to other similar models.
引用
收藏
页数:25
相关论文
共 90 条
  • [1] Integrated technique of segmentation and classification methods with connected components analysis for road extraction from orthophoto images
    Abdollahi, Abolfazl
    Pradhan, Biswajeet
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2021, 176
  • [2] An ensemble architecture of deep convolutional Segnet and Unet networks for building semantic segmentation from high-resolution aerial images
    Abdollahi, Abolfazl
    Pradhan, Biswajeet
    Alamri, Abdullah M.
    [J]. GEOCARTO INTERNATIONAL, 2022, 37 (12) : 3355 - 3370
  • [3] Building Footprint Extraction from High Resolution Aerial Images Using Generative Adversarial Network (GAN) Architecture
    Abdollahi, Abolfazl
    Pradhan, Biswajeet
    Gite, Shilpa
    Alamri, Abdullah
    [J]. IEEE ACCESS, 2020, 8 (209517-209527) : 209517 - 209527
  • [4] Towards Low-Cost Classification for Novel Fine-Grained Datasets
    Anwar, Abbas
    Anwar, Hafeez
    Anwar, Saeed
    [J]. ELECTRONICS, 2022, 11 (17)
  • [5] AutoFCL: automatically tuning fully connected layers for handling small dataset
    Basha, S. H. Shabbeer
    Vinakota, Sravan Kumar
    Dubey, Shiv Ram
    Pulabaigari, Viswanath
    Mukherjee, Snehasis
    [J]. NEURAL COMPUTING & APPLICATIONS, 2021, 33 (13) : 8055 - 8065
  • [6] RoadTracer: Automatic Extraction of Road Networks from Aerial Images
    Bastani, Favyen
    He, Songtao
    Abbar, Sofiane
    Alizadeh, Mohammad
    Balakrishnan, Hari
    Chawla, Sanjay
    Madden, Sam
    DeWitt, David
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 4720 - 4728
  • [7] A Novel Detection and Multi-Classification Approach for IoT-Malware Using Random Forest Voting of Fine-Tuning Convolutional Neural Networks
    Ben Atitallah, Safa
    Driss, Maha
    Almomani, Iman
    [J]. SENSORS, 2022, 22 (11)
  • [8] SMS-EMOA: Multiobjective selection based on dominated hypervolume
    Beume, Nicola
    Naujoks, Boris
    Emmerich, Michael
    [J]. EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2007, 181 (03) : 1653 - 1669
  • [9] Fusing Local and Global Features for High-Resolution Scene Classification
    Bian, Xiaoyong
    Chen, Chen
    Tian, Long
    Du, Qian
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2017, 10 (06) : 2889 - 2901
  • [10] Land-use scene classification using multi-scale completed local binary patterns
    Chen, Chen
    Zhang, Baochang
    Su, Hongjun
    Li, Wei
    Wang, Lu
    [J]. SIGNAL IMAGE AND VIDEO PROCESSING, 2016, 10 (04) : 745 - 752