Universal Robustness via Median Randomized Smoothing for Real-World Super-Resolution

被引:3
作者
Chaouai, Zakariya [1 ]
Tamaazousti, Mohamed [1 ]
机构
[1] Univ Paris Saclay, CEA, List, F-91120 Palaiseau, France
来源
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2024年
关键词
D O I
10.1109/CVPR52733.2024.00865
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the recent literature on image Super-Resolution ( SR) can be classified into two main approaches. The first one involves learning a corruption model tailored to a specific dataset, aiming to mimic the noise and corruption in low-resolution images, such as sensor noise. However, this approach is data-specific, tends to lack adaptability, and its accuracy diminishes when faced with unseen types of image corruptions. A second and more recent approach, referred to as Robust Super-Resolution (RSR), proposes to improve real-world SR by harnessing the generalization capabilities of a model by making it robust to adversarial attacks. To delve further into this second approach, our paper explores the universality of various methods for enhancing the robustness of deep learning SR models. In other words, we inquire: "Which robustness method exhibits the highest degree of adaptability when dealing with a wide range of adversarial attacks ?". Our extensive experimentation on both synthetic and real-world images empirically demonstrates that median randomized smoothing (MRS) is more general in terms of robustness compared to adversarial learning techniques, which tend to focus on specific types of attacks. Furthermore, as expected, we also illustrate that the proposed universal robust method enables the SR model to handle standard corruptions more effectively, such as blur and Gaussian noise, and notably, corruptions naturally present in real-world images. These results support the significance of shifting the paradigm in the development of real-world SR methods towards RSR, especially via MRS.
引用
收藏
页码:9059 / 9068
页数:10
相关论文
共 38 条
[11]  
Ducournau A, 2016, IAPR WORKS PATTERN
[12]  
Fritsche Manuel, 2019, IEEE CVF INT C COMP
[13]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[14]   Simultaneous Super-Resolution and Cross-Modality Synthesis of 3D Medical Images using Weakly-Supervised Joint Convolutional Sparse Coding [J].
Huang, Yawen ;
Shao, Ling ;
Frangi, Alejandro F. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5787-5796
[15]   DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks [J].
Ignatov, Andrey ;
Kobyshev, Nikolay ;
Timofte, Radu ;
Vanhoey, Kenneth ;
Luc Van Gool .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3297-3305
[16]  
Ji Xiaozhong, 2020, P IEEE C COMP VIS PA
[17]   Perceptual Losses for Real-Time Style Transfer and Super-Resolution [J].
Johnson, Justin ;
Alahi, Alexandre ;
Li Fei-Fei .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :694-711
[18]  
Jolicoeur-Martineau Alexia., 2019, P INT C LEARN REPR
[19]   CUBIC CONVOLUTION INTERPOLATION FOR DIGITAL IMAGE-PROCESSING [J].
KEYS, RG .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1981, 29 (06) :1153-1160
[20]  
Kingsbury D, 2015, P1, DOI [DOI 10.1021/bk-2015-1214.ch001, DOI 10.48550/ARXIV.1412.6980]