Urban functional zone classification based on self-supervised learning: A case study in Beijing, China

被引:3
作者
Lu, Weipeng [1 ]
Qi, Ji [1 ]
Feng, Huihui [1 ]
机构
[1] Cent South Univ, Sch Geosci & Infophys, Changsha, Peoples R China
关键词
self-supervised learning; urban functional zone; remote sensing; deep learning; image classification; LAND-COVER; SCENE CLASSIFICATION; REMOTE; BENCHMARK; ATTENTION; IMAGES;
D O I
10.3389/fenvs.2022.1010630
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Urban functional zones (UFZs) are the fundamental units for urban management and operation. The advance in earth observation and deep learning technology provides chances for automatically and intelligently classifying UFZs via remote sensing images. However, current methods based on deep learning require numerous high-quality annotations to train a well-performed model, which is time-consuming. Thus, how to train a reliable model using a few annotated data is a problem in UFZ classification. Self-supervised learning (SSL) can optimize models using numerous unannotated data. In this paper, we introduce SSL into UFZ classification to use the instance discrimination pretext task for guiding a model to learn useful features from over 50,000 unannotated remote sensing images and fine tune the model using 700 to 7,000 annotated data. The validation experiment in Beijing, China reveals that 1) using a few annotated data, SSL can achieve a kappa coefficient and an overall accuracy 2.1-11.8% and 2.0-10.0% higher than that of supervised learning (SL), and 2) can also gain results comparable to that got by the SL paradigm using two times annotated data for training. The less the data used for finetuning the more obvious the advantage of SSL to SL. Besides, the comparison experiment between the model pretrained on the research region and that pretrained on the benchmark reveals that the objects with displacement and incompleteness are more difficult for models to classify accurately.
引用
收藏
页数:13
相关论文
共 46 条
[1]   DFCNN-Based Semantic Recognition of Urban Functional Zones by Integrating Remote Sensing Data and POI Data [J].
Bao, Hanqing ;
Ming, Dongping ;
Guo, Ya ;
Zhang, Kui ;
Zhou, Keqi ;
Du, Shigao .
REMOTE SENSING, 2020, 12 (07)
[2]   Deep learning-based remote and social sensing data fusion for urban region function recognition [J].
Cao, Rui ;
Tu, Wei ;
Yang, Cuixin ;
Li, Qing ;
Liu, Jun ;
Zhu, Jiasong ;
Zhang, Qian ;
Li, Qingquan ;
Qiu, Guoping .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2020, 163 :82-97
[3]  
Castelluccio M, 2015, Arxiv, DOI arXiv:1508.00092
[4]  
Chen T, 2020, PR MACH LEARN RES, V119
[5]   Social functional mapping of urban green space using remote sensing and social sensing data [J].
Chen, Wei ;
Huang, Huiping ;
Dong, Jinwei ;
Zhang, Yuan ;
Tian, Yichen ;
Yang, Zhiqi .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2018, 146 :436-452
[6]   Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunities [J].
Cheng, Gong ;
Xie, Xingxing ;
Han, Junwei ;
Guo, Lei ;
Xia, Gui-Song .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2020, 13 :3735-3756
[7]   When Deep Learning Meets Metric Learning: Remote Sensing Image Scene Classification via Learning Discriminative CNNs [J].
Cheng, Gong ;
Yang, Ceyuan ;
Yao, Xiwen ;
Guo, Lei ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (05) :2811-2821
[8]   Remote Sensing Image Scene Classification: Benchmark and State of the Art [J].
Cheng, Gong ;
Han, Junwei ;
Lu, Xiaoqiang .
PROCEEDINGS OF THE IEEE, 2017, 105 (10) :1865-1883
[9]   Satellite Image Classification via Two-Layer Sparse Coding With Biased Image Representation [J].
Dai, Dengxin ;
Yang, Wen .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2011, 8 (01) :173-176
[10]   Multi-task Self-Supervised Visual Learning [J].
Doersch, Carl ;
Zisserman, Andrew .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2070-2079