From Artifact Removal to Super-Resolution

被引:19
|
作者
Wang, Jiaming [1 ]
Shao, Zhenfeng [1 ]
Huang, Xiao [2 ]
Lu, Tao [3 ]
Zhang, Ruiqian [4 ]
Li, Yong [1 ]
机构
[1] Wuhan Univ, State Key Lab Informat Engn Surveying Mapping & R, Wuhan 430079, Peoples R China
[2] Univ Arkansas, Dept Geosci, Fayetteville, AR 72701 USA
[3] Wuhan Inst Technol, Sch Comp Sci & Engn, Wuhan 430205, Peoples R China
[4] Chinese Acad Surveying & Mapping, Inst Photogrammetry & Remote Sensing, Beijing 100036, Peoples R China
基金
中国国家自然科学基金;
关键词
Satellites; Image edge detection; Task analysis; Convolution; Superresolution; Image reconstruction; Generative adversarial networks; Artifact removal; difference convolution; remote sensing; super-resolution (SR); REMOTE-SENSING IMAGES; NET;
D O I
10.1109/TGRS.2022.3196709
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Deep-learning-based super-resolution (SR) methods have been extensively studied and have achieved significant performance with deep convolutional neural networks. However, the results still suffer from the ringing effect, especially in satellite image SR tasks, due to the loss of image details in the satellite degradation process. In this article, we build a novel satellite SR framework by decomposing a high-resolution image into three components, i.e., low-resolution (LR), artifact, and high-frequency information. Specifically, we propose an artifact removal network with a self-adaption difference convolution (SDC) to fully exploit the structure prior in the LR image and predict the artifact map. Considering that the artifact map and the high-frequency map share a similar pattern, we introduce the supervised structure correction (SSC) block that establishes a bridge between the high-frequency generation process and the artifact removal process. Experimental results on satellite images demonstrate that the proposed method owns an improved tradeoff between the performance and the computational cost compared to existing state-of-the-art satellite and natural SR methods. The source code is available at https://github.com/jiaming-wang/ARSRN.
引用
收藏
页数:15
相关论文
共 50 条
  • [1] Artifact suppression for multiframe super-resolution reconstruction
    Cheng, Yan
    Fang, Xiangzhong
    Yang, Ruijun
    Journal of Harbin Institute of Technology (New Series), 2007, 14 (SUPPL. 2) : 60 - 63
  • [2] HIGH QUALITY ARTIFACT-FREE SUPER-RESOLUTION
    Zhang, Wei
    Cham, Wai-Kuen
    2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, 2010, : 889 - 892
  • [3] SUPER-RESOLUTION SPRITE WITH FOREGROUND REMOVAL
    Lai, Jui-Hsin
    Kao, Chieh-Chi
    Chien, Shao-Yi
    ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 1306 - +
  • [4] Efficient Learning-based Image Enhancement: Application to Super-resolution and Compression Artifact Removal
    Kwon, Younghee
    Kim, Kwang In
    Kim, Jin Hyung
    Theobalt, Christian
    PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2012, 2012,
  • [5] An improved regularization method for artifact rejection in image super-resolution
    Hamed Bouzari
    Signal, Image and Video Processing, 2012, 6 : 125 - 140
  • [6] Gibbs artifact reduction for POCS super-resolution image reconstruction
    Xiao C.
    Yu J.
    Su K.
    Frontiers of Computer Science in China, 2008, 2 (01): : 87 - 93
  • [7] An improved regularization method for artifact rejection in image super-resolution
    Bouzari, Hamed
    SIGNAL IMAGE AND VIDEO PROCESSING, 2012, 6 (01) : 125 - 140
  • [8] Efficient Learning of Image Super-Resolution and Compression Artifact Removal with Semi-Local Gaussian Processes
    Kwon, Younghee
    Kim, Kwang In
    Tompkin, James
    Kim, Jin Hyung
    Theobalt, Christian
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (09) : 1792 - 1805
  • [9] Super-resolution from space
    不详
    ASTRONOMY & GEOPHYSICS, 2022, 63 (02)
  • [10] A method of Gibbs artifact reduction for POCS super-resolution image reconstruction
    Yu, Jing
    Xiao, Chuangbai
    Su, Kaina
    2006 8TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING, VOLS 1-4, 2006, : 1019 - +