FeNet: Feature Enhancement Network for Lightweight Remote-Sensing Image Super-Resolution

被引:71
作者
Wang, Zheyuan [1 ]
Li, Liangliang [2 ]
Xue, Yuan [1 ]
Jiang, Chenchen [1 ]
Wang, Jiawen [3 ]
Sun, Kaipeng [3 ]
Ma, Hongbing [2 ]
机构
[1] Xinjiang Univ, Coll Informat Sci & Engn, Urumqi 830046, Peoples R China
[2] Tsinghua Univ, Dept Elect Engn, Beijing 100084, Peoples R China
[3] Shanghai Inst Satellite Engn, Shanghai 201109, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
关键词
Convolutional neural network; lightweight feature enhancement network (FeNet); remote sensing; single image super-resolution (SISR);
D O I
10.1109/TGRS.2022.3168787
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
In the field of remote sensing, due to memory consumption and computational burden, the single-image super-resolution (SISR) methods based on deep convolution neural networks (CNNs) are limited in practical application. To address this problem, we propose a lightweight feature enhancement network (FeNet) for accurate remote-sensing image super-resolution (SR). Considering the existence of equipment with extremely poor hardware facilities, we further design a lighter FeNet-baseline with about 158K parameters. Specifically, inspired by lattice structure, we construct a lightweight lattice block (LLB) as a nonlinear feature extraction function to improve the expression ability. Here, channel separation operation makes the upper and lower branches of the LLB only responsible for half of the features, and the weight coefficients calculated through the attention mechanism enable the upper and lower branches to communicate efficiently. Based on LLB, the feature enhancement block (FEB) is designed in a nested manner to obtain expressive features, where different layers are responsible for the features with different texture richness, and then features from different layers are sequentially fused from deep to shallow. Model parameters and multi-adds operations are used to evaluate network complexity, and extensive experiments on two remote-sensing and four SR benchmark test datasets show that our methods can achieve a good tradeoff between complexity and performance. Our code will be available at https://github.com/wangzheyuan-666/FeNet.
引用
收藏
页数:12
相关论文
共 45 条
[1]   Finding Tiny Faces in the Wild with Generative Adversarial Network [J].
Bai, Yancheng ;
Zhang, Yongqiang ;
Ding, Mingli ;
Ghanem, Bernard .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :21-30
[2]   Low-Complexity Single-Image Super-Resolution based on Nonnegative Neighbor Embedding [J].
Bevilacqua, Marco ;
Roumy, Aline ;
Guillemot, Christine ;
Morel, Marie-Line Alberi .
PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
[3]   SMALL OBJECT DETECTION FROM REMOTE SENSING IMAGES WITH THE HELP OF OBJECT-FOCUSED SUPER-RESOLUTION USING WASSERSTEIN GANS [J].
Courtrai, Luc ;
Pham, Minh-Tan ;
Friguet, Chloe ;
Lefevre, Sebastien .
IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, :260-263
[4]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[5]   Image Super-Resolution Using Deep Convolutional Networks [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (02) :295-307
[6]   Remote Sensing Image Super-Resolution Using Second-Order Multi-Scale Networks [J].
Dong, Xiaoyu ;
Wang, Longguang ;
Sun, Xu ;
Jia, Xiuping ;
Gao, Lianru ;
Zhang, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (04) :3473-3485
[7]   Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks [J].
Dong, Xiaoyu ;
Sun, Xu ;
Jia, Xiuping ;
Xi, Zhihong ;
Gao, Lianru ;
Zhang, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (02) :1618-1633
[8]   Super-Resolution Integrated Building Semantic Segmentation for Multi-Source Remote Sensing Imagery [J].
Guo, Zhiling ;
Wu, Guangming ;
Song, Xiaoya ;
Yuan, Wei ;
Chen, Qi ;
Zhang, Haoran ;
Shi, Xiaodan ;
Xu, Mingzhou ;
Xu, Yongwei ;
Shibasaki, Ryosuke ;
Shao, Xiaowei .
IEEE ACCESS, 2019, 7 :99381-99397
[9]  
Huang JB, 2015, PROC CVPR IEEE, P5197, DOI 10.1109/CVPR.2015.7299156
[10]   Lightweight Image Super-Resolution with Information Multi-distillation Network [J].
Hui, Zheng ;
Gao, Xinbo ;
Yang, Yunchu ;
Wang, Xiumei .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :2024-2032