Remote Sensing Super-Resolution Reconstruction Based on Improved Deformable Convolution

被引:0
作者
Yao, Fulin [1 ]
Li, Hongli [2 ]
Huang, Xun [3 ]
Sun, Kaiming [2 ]
Yi, Zhiqi [2 ]
机构
[1] Wuhan Inst Technolog, Sch Comp Sci Engn, Wuhan, Peoples R China
[2] Wuhan Inst Technol, Sch Comp Sci & Engn, Wuhan, Peoples R China
[3] Wuhan Nat Resources & Planning Bur, Wuhang Land Arranging Storage Ctr, Wuhan, Peoples R China
来源
2023 INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE INNOVATION, ICAII 2023 | 2023年
基金
中国国家自然科学基金;
关键词
remote sensing images; video super-resolution reconstruction; deformable convolution; NETWORK;
D O I
10.1109/ICAII59460.2023.10497444
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a deformable convolutional alignment algorithm guided by optical flow for super-resolution reconstruction of remote sensing images. The accuracy of reconstruction in remote sensing image super-resolution heavily relies on the alignment process of multi-frame images. Deformable alignment, utilizing second-order grid propagation and flow guidance, has been proven effective in fully exploiting information from the entire input video. However, the long-distance propagation of the alignment structure can result in error accumulation and propagation. To address this issue, a multi-scale encoding module is introduced to mitigate error accumulation and transmission during optical flow alignment, thereby enhancing the model's performance in handling complex detailed textures. Furthermore, to address the blurring problem of small targets and complex textures in remote sensing images, a fully convolutional masked autoencoder is employed to improve feature extraction capabilities, increase the depth of feature extraction, reduce information loss, and ensure information integrity. Experimental results demonstrate the significant performance improvement of the proposed algorithm in the super-resolution reconstruction task for remote sensing images, highlighting its potential for practical applications. This study offers an effective solution for the super-resolution reconstruction task in the field of remote sensing image processing.
引用
收藏
页码:100 / 104
页数:5
相关论文
共 15 条
[1]   BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyond [J].
Chan, Kelvin C. K. ;
Wang, Xintao ;
Yu, Ke ;
Dong, Chao ;
Loy, Chen Change .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4945-4954
[2]  
Chan KCK, 2021, AAAI CONF ARTIF INTE, V35, P973
[3]   Deformable Convolutional Networks [J].
Dai, Jifeng ;
Qi, Haozhi ;
Xiong, Yuwen ;
Li, Yi ;
Zhang, Guodong ;
Hu, Han ;
Wei, Yichen .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :764-773
[4]  
Deudon M, 2020, Arxiv, DOI arXiv:2002.06460
[5]   Unified Blind Method for Multi-Image Super-Resolution and Single/Multi-Image Blur Deconvolution [J].
Faramarzi, Esmaeil ;
Rajan, Dinesh ;
Christensen, Marc P. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (06) :2101-2114
[6]   A Unified Network for Arbitrary Scale Super-Resolution of Video Satellite Images [J].
He, Zhi ;
He, Dan .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (10) :8812-8825
[7]   Edge-Enhanced GAN for Remote Sensing Image Superresolution [J].
Jiang, Kui ;
Wang, Zhongyuan ;
Yi, Peng ;
Wang, Guangcheng ;
Lu, Tao ;
Jiang, Junjun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2019, 57 (08) :5799-5812
[8]   A Progressively Enhanced Network for Video Satellite Imagery Superresolution [J].
Jiang, Kui ;
Wang, Zhongyuan ;
Yi, Peng ;
Jiang, Junjun .
IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (11) :1630-1634
[9]  
Lin J., 2021, arXiv
[10]   HRSiam: High-Resolution Siamese Network, Towards Space-Borne Satellite Video Tracking [J].
Shao, Jia ;
Du, Bo ;
Wu, Chen ;
Gong, Mingming ;
Liu, Tongliang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :3056-3068