Generalized Real-World Super-Resolution through Adversarial Robustness

被引:6
|
作者
Castillo, Angela [1 ]
Escobar, Maria [1 ]
Perez, Juan C. [1 ,2 ]
Romero, Andres [3 ]
Timofte, Radu [3 ]
Van Gool, Luc [3 ]
Arbelaez, Pablo [1 ]
机构
[1] Univ los Andes, Ctr Res & Format Artificial Intelligence, Bogota, Colombia
[2] King Abdullah Univ Sci & Technol KAUST, Thuwal, Saudi Arabia
[3] Swiss Fed Inst Technol, Comp Vis Lab, Zurich, Switzerland
关键词
IMAGE; INTERPOLATION;
D O I
10.1109/ICCVW54120.2021.00212
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Real-world Super-Resolution (SR) has been traditionally tackled by first learning a specific degradation model that resembles the noise and corruption artifacts in low-resolution imagery. Thus, current methods lack generalization and lose their accuracy when tested on unseen types of corruption. In contrast to the traditional proposal, we present Robust Super-Resolution (RSR), a method tha' leverages the generalization capability of adversarial attacks to tackle real-world SR. Our novel framework poses a paradigm shift in the development of real-world SR methods. Instead of learning a dataset-specific degradation, we employ adversarial attacks to create difficult examples that target the model's weaknesses. Afterward, we use these adversarial examples during training to improve our model's capacity to process noisy inputs. We perform extensive experimentation on synthetic and real-world images and empirically demonstrate that our RSR method generalizes well across datasets without re-training for specific noise priors. By using a single robust model, we outperform state-of-the-art specialized methods on real-world benchmarks.
引用
收藏
页码:1855 / 1865
页数:11
相关论文
共 50 条
  • [1] Multiscale generative adversarial network for real-world super-resolution
    Sun, Ying
    Yang, Zhiwen
    Tao, Bo
    Jiang, Guozhang
    Hao, Zhiqiang
    Chen, Baojia
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (21):
  • [2] Real-World Super-Resolution using Generative Adversarial Networks
    Ren, Haoyu
    Kheradmand, Amin
    El-Khamy, Mostafa
    Wang, Shuangquan
    Bai, Dongwoon
    Lee, Jungwon
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1760 - 1768
  • [3] Robust Real-World Image Super-Resolution against Adversarial Attacks
    Yue, Jiutao
    Li, Haofeng
    Wei, Pengxu
    Li, Guanbin
    Lin, Liang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 5148 - 5157
  • [4] Deep Generative Adversarial Residual Convolutional Networks for Real-World Super-Resolution
    Umer, Rao Muhammad
    Foresti, Gian Luca
    Micheloni, Christian
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 1769 - 1777
  • [5] Real-World Thermal Image Super-Resolution
    Allahham, Moaaz
    Aakerberg, Andreas
    Nasrollahi, Kamal
    Moeslund, Thomas B.
    ADVANCES IN VISUAL COMPUTING (ISVC 2021), PT I, 2021, 13017 : 3 - 14
  • [6] Unsupervised Learning for Real-World Super-Resolution
    Lugmayr, Andreas
    Danelljan, Martin
    Timofte, Radu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3408 - 3416
  • [7] Frequency Separation for Real-World Super-Resolution
    Fritsche, Manuel
    Gu, Shuhang
    Timofte, Radu
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3599 - 3608
  • [8] Real-World Super-Resolution with Residual Consistency
    Saritas, Erdi
    Ekenel, Hazim Kemal
    32ND IEEE SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU 2024, 2024,
  • [9] Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution
    Xu, Xiaoqian
    Wei, Pengxu
    Chen, Weikai
    Liu, Yang
    Mao, Mingzhi
    Lin, Liang
    Li, Guanbin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5657 - 5666
  • [10] Semi-Cycled Generative Adversarial Networks for Real-World Face Super-Resolution
    Hou, Hao
    Xu, Jun
    Hou, Yingkun
    Hu, Xiaotao
    Wei, Benzheng
    Shen, Dinggang
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 : 1184 - 1199