Self-FuseNet: Data Free Unsupervised Remote Sensing Image Super-Resolution

被引:13
作者
Mishra, Divya [1 ]
Hadar, Ofer [1 ]
机构
[1] Ben Gur Univ Negev, Sch Elect & Comp Engn, Beer Sheva, Israel
关键词
Feature extraction; Superresolution; Satellites; Training; Image reconstruction; Spatial resolution; Deep learning; Blind image super-resolution (SR); data fusion; deep learning; self-fusion; unsupervised image super-resolution (SR); QUALITY ASSESSMENT; FUSION; GAN;
D O I
10.1109/JSTARS.2023.3239758
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Real-world degradations deviate from ideal degradations, as most deep learning-based scenarios involve the ideal synthesis of low-resolution (LR) counterpart images by popularly used bicubic interpolation. Moreover, supervised learning approaches rely on many high-resolution (HR) and LR image pairings to reconstruct missing information based on their association, developed by complex long hours of deep neural network training. Additionally, the trained model's generalizability on various image datasets with various distributions is not guaranteed. To overcome this challenge, we proposed our novel Self-FuseNet, particularly for extremely poor-resolution satellite images. Also, the network exhibits strong generalization performance on additional datasets (both "ideal " and "nonideal " scenarios). The network is especially for those image datasets suffering from the following two significant limitations: 1) nonavailability of ground truth HR images; 2) limitation of a large count of the unpaired dataset for deep neural network training. The benefit of the proposed model is threefold: 1) it does not require any significant extensive training data, either paired or unpaired but only a single LR image without prior knowledge of its distribution; 2) it is a simple and effective model for super-resolving very poor-resolution images, saving computational resources and time; 3) using UNet, the processing of data are accelerated by the network's wide skip connections, allowing image reconstruction with fewer parameters. Rather than using an inverse approach, as common in most deep learning scenarios, we introduced a forward approach to super-resolve exceptionally LR remote sensing images. This demonstrates its supremacy over recently proposed state-of-the-art methods for unsupervised single real-world image blind super-resolution.
引用
收藏
页码:1710 / 1727
页数:18
相关论文
共 65 条
[1]   Correction Filter for Single Image Super-Resolution: Robustifying Off-the-Shelf Deep Super-Resolvers [J].
Abu Hussein, Shady ;
Tirer, Tom ;
Giryes, Raja .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :1425-1434
[2]  
Ajitha E., 2022, 2022 6th International Conference on Computing Methodologies and Communication (ICCMC), P1665, DOI 10.1109/ICCMC53470.2022.9753689
[3]   TR-MISR: Multiimage Super-Resolution Based on Feature Fusion With Transformers [J].
An, Tai ;
Zhang, Xin ;
Huo, Chunlei ;
Xue, Bin ;
Wang, Lingfeng ;
Pan, Chunhong .
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 :1373-1388
[4]   Health Risk Behaviors after Disaster Exposure Among Older Adults [J].
Bell, Sue Anne ;
Choi, HwaJung ;
Langa, Kenneth M. ;
Iwashyna, Theodore J. .
PREHOSPITAL AND DISASTER MEDICINE, 2019, 34 (01) :95-97
[5]   Bidirectional Convolutional LSTM Neural Network for Remote Sensing Image Super-Resolution [J].
Chang, Yunpeng ;
Luo, Bin .
REMOTE SENSING, 2019, 11 (20)
[6]  
Chen SY, 2020, INT CONF ACOUST SPEE, P1464, DOI [10.1109/ICASSP40776.2020.9053765, 10.1109/icassp40776.2020.9053765]
[7]   Zero-Shot Image Super-Resolution with Depth Guided Internal Degradation Learning [J].
Cheng, Xi ;
Fu, Zhenyong ;
Yang, Jian .
COMPUTER VISION - ECCV 2020, PT XVII, 2020, 12362 :265-280
[8]  
Chu Duc Nguyen, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P376, DOI 10.1109/ICPR.2010.100
[9]  
DUCHON CE, 1979, J APPL METEOROL, V18, P1016, DOI 10.1175/1520-0450(1979)018<1016:LFIOAT>2.0.CO
[10]  
2