Remote Sensing Image Super-Resolution via Dual-Resolution Network Based on Connected Attention Mechanism

被引:42
作者
Zhang, Xiangrong [1 ]
Li, Zhenyu [1 ]
Zhang, Tianyang [1 ]
Liu, Fengsheng [1 ]
Tang, Xu [1 ]
Chen, Puhua [1 ]
Jiao, Licheng [1 ]
机构
[1] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2022年 / 60卷
基金
中国国家自然科学基金;
关键词
Image reconstruction; Feature extraction; Hidden Markov models; Remote sensing; Interpolation; Superresolution; Degradation; Attention mechanism; convolutional neural networks (CNNs); dual-resolution branches; remote sensing images (RSIs); super-resolution (SR); CONVOLUTIONAL NETWORK; CLASSIFICATION;
D O I
10.1109/TGRS.2021.3106681
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Limited by hardware conditions and complex degradation processes, the obtained remote sensing images (RSIs) are often low-resolution (LR) data with insufficient high-frequency information. Image super-resolution (SR) aims to improve the spatial resolution of images and add reasonable detailed information. Although existing convolutional neural network (CNN)-based methods achieve good performance by adding residual structure and attention mechanism to the network, simply stacking the residual structure and embedding the attention module directly on the residual branch lead to localized use of features and information loss. To address the above problems, we propose a dual-resolution connected attention network (DRCAN). Specifically, a high-resolution (HR) learning branch is constructed to complement the mapping learning between LR images and HR images, and a connected attention module with residual learning is introduced to make full use of the different levels of intermediate layer features. Besides, we collect data at different resolutions from Google Earth to form a dataset named XD IPIU for RSIs SR. Extensive experiments demonstrate the effectiveness of the proposed model and DRCAN shows the state-of-the-art performance in terms of quantitative evaluation and visual quality.
引用
收藏
页数:13
相关论文
共 50 条
[1]   Limits on super-resolution and how to break them [J].
Baker, S ;
Kanade, T .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (09) :1167-1183
[2]   Satellite Image Classification via Two-Layer Sparse Coding With Biased Image Representation [J].
Dai, Dengxin ;
Yang, Wen .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2011, 8 (01) :173-176
[3]   Second-order Attention Network for Single Image Super-Resolution [J].
Dai, Tao ;
Cai, Jianrui ;
Zhang, Yongbing ;
Xia, Shu-Tao ;
Zhang, Lei .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :11057-11066
[4]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199
[5]   Remote Sensing Image Super-Resolution Using Novel Dense-Sampling Networks [J].
Dong, Xiaoyu ;
Sun, Xu ;
Jia, Xiuping ;
Xi, Zhihong ;
Gao, Lianru ;
Zhang, Bing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (02) :1618-1633
[6]   Single Space Object Image Denoising and Super-Resolution Reconstructing Using Deep Convolutional Networks [J].
Feng, Xubin ;
Su, Xiuqin ;
Shen, Junge ;
Jin, Humin .
REMOTE SENSING, 2019, 11 (16)
[7]   Example-based super-resolution [J].
Freeman, WT ;
Jones, TR ;
Pasztor, EC .
IEEE COMPUTER GRAPHICS AND APPLICATIONS, 2002, 22 (02) :56-65
[8]  
Goodman J.W., 2005, Introduction to Fourier optics
[9]   Recent advances in convolutional neural networks [J].
Gu, Jiuxiang ;
Wang, Zhenhua ;
Kuen, Jason ;
Ma, Lianyang ;
Shahroudy, Amir ;
Shuai, Bing ;
Liu, Ting ;
Wang, Xingxing ;
Wang, Gang ;
Cai, Jianfei ;
Chen, Tsuhan .
PATTERN RECOGNITION, 2018, 77 :354-377
[10]   DIFFRACTION + RESOLVING POWER [J].
HARRIS, JL .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA, 1964, 54 (07) :931-+