A Lightweight Remote Sensing Image Super-Resolution Method and Its Application in Smart Cities

被引:3
作者
Zhang, Nenghuan [1 ,2 ]
Wang, Yongbin [1 ,2 ]
Feng, Shuang [1 ,2 ,3 ]
机构
[1] Commun Univ China, State Key Lab Media Convergence & Commun, Beijing 100024, Peoples R China
[2] Commun Univ China, Key Lab Convergent Media & Intelligent Technol, Minist Educ, Beijing 100024, Peoples R China
[3] Commun Univ China, Sch Comp & Cyber Sci, Beijing 100024, Peoples R China
关键词
smart cities; remote sensing image; super-resolution technique; urban region function recognition; CITY;
D O I
10.3390/electronics11071050
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the growth of urban population, a series of urban problems have emerged, and how to speed up smart city construction has received extensive attention. Remote sensing images have the advantages of wide spatial coverage and rich information, and it is suitable for use as research data for smart cities. However, due to limitations in the imaging sensor conditions and complex weather, remote sensing images face the problems of insufficient resolution and cloud occlusion, which cannot meet the resolution requirements of smart city tasks. The remote sensing image super-resolution (SR) technique can improve the details and texture information without upgrading the imaging sensor system, which becomes a feasible solution for the above problems. In this paper, we propose a novel remote sensing image super-resolution method which leverages the texture features from internal and external references to help with SR reconstruction. We introduce the transformer attention mechanism to select and extract parts of texture features with high reference values to ensure that the network is lightweight, effective, and easier to deploy on edge computing devices. In addition, our network can automatically learn and adjust the alignment angles and scales of texture features for better SR results. Extensive comparison experiments show that our proposed method achieves superior performance compared with several state-of-the-art SR methods. In addition, we also evaluate the application value of our proposed SR method in urban region function recognition in smart cities. The dataset used in this task is low-quality. The comparative experiment between the original dataset and the SR dataset generated by our proposed SR method indicates that our method can effectively improve the recognition accuracy.
引用
收藏
页数:18
相关论文
共 42 条
[1]  
DAMERI R.P., 2013, International Journal of Computers and Technology, V11, P2544, DOI [DOI 10.24297/IJCT.V11I5.1142, 10.24297/ijct.v11i5.1142]
[2]   Accelerating the Super-Resolution Convolutional Neural Network [J].
Dong, Chao ;
Loy, Chen Change ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :391-407
[3]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[4]   Blind Super-Resolution With Iterative Kernel Correction [J].
Gu, Jinjin ;
Lu, Hannan ;
Zuo, Wangmeng ;
Dong, Chao .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1604-1613
[5]   Deep Residual Squeeze and Excitation Network for Remote Sensing Image Super-Resolution [J].
Gu, Jun ;
Sun, Xian ;
Zhang, Yue ;
Fu, Kun ;
Wang, Lei .
REMOTE SENSING, 2019, 11 (15)
[6]   The role of big data in smart city [J].
Hashem, Ibrahim Abaker Targio ;
Chang, Victor ;
Anuar, Nor Badrul ;
Adewole, Kayode ;
Yaqoob, Ibrar ;
Gani, Abdullah ;
Ahmed, Ejaz ;
Chiroma, Haruna .
INTERNATIONAL JOURNAL OF INFORMATION MANAGEMENT, 2016, 36 (05) :748-758
[7]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[8]   The use of remote sensing and landscape metrics to describe structures and changes in urban land uses [J].
Herold, M ;
Scepan, J ;
Clarke, KC .
ENVIRONMENT AND PLANNING A-ECONOMY AND SPACE, 2002, 34 (08) :1443-1458
[9]   Densely Connected Convolutional Networks [J].
Huang, Gao ;
Liu, Zhuang ;
van der Maaten, Laurens ;
Weinberger, Kilian Q. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2261-2269
[10]  
Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156