Universal Robustness via Median Randomized Smoothing for Real-World Super-Resolution

被引:3
作者
Chaouai, Zakariya [1 ]
Tamaazousti, Mohamed [1 ]
机构
[1] Univ Paris Saclay, CEA, List, F-91120 Palaiseau, France
来源
2024 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR) | 2024年
关键词
D O I
10.1109/CVPR52733.2024.00865
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Most of the recent literature on image Super-Resolution ( SR) can be classified into two main approaches. The first one involves learning a corruption model tailored to a specific dataset, aiming to mimic the noise and corruption in low-resolution images, such as sensor noise. However, this approach is data-specific, tends to lack adaptability, and its accuracy diminishes when faced with unseen types of image corruptions. A second and more recent approach, referred to as Robust Super-Resolution (RSR), proposes to improve real-world SR by harnessing the generalization capabilities of a model by making it robust to adversarial attacks. To delve further into this second approach, our paper explores the universality of various methods for enhancing the robustness of deep learning SR models. In other words, we inquire: "Which robustness method exhibits the highest degree of adaptability when dealing with a wide range of adversarial attacks ?". Our extensive experimentation on both synthetic and real-world images empirically demonstrates that median randomized smoothing (MRS) is more general in terms of robustness compared to adversarial learning techniques, which tend to focus on specific types of attacks. Furthermore, as expected, we also illustrate that the proposed universal robust method enables the SR model to handle standard corruptions more effectively, such as blur and Gaussian noise, and notably, corruptions naturally present in real-world images. These results support the significance of shifting the paradigm in the development of real-world SR methods towards RSR, especially via MRS.
引用
收藏
页码:9059 / 9068
页数:10
相关论文
共 38 条
[1]   NTIRE 2017 Challenge on Single Image Super-Resolution: Dataset and Study [J].
Agustsson, Eirikur ;
Timofte, Radu .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :1122-1131
[2]  
Allebach J, 1996, INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL III, P707, DOI 10.1109/ICIP.1996.560768
[3]  
[Anonymous], P IEEE C COMP VIS PA
[4]  
[Anonymous], 2018, P EUR C COMP VIS ECC, DOI [DOI 10.1163/9789004385580_002, DOI 10.1163/9789004385580002]
[5]   Towards Evaluating the Robustness of Neural Networks [J].
Carlini, Nicholas ;
Wagner, David .
2017 IEEE SYMPOSIUM ON SECURITY AND PRIVACY (SP), 2017, :39-57
[6]   Generalized Real-World Super-Resolution through Adversarial Robustness [J].
Castillo, Angela ;
Escobar, Maria ;
Perez, Juan C. ;
Romero, Andres ;
Timofte, Radu ;
Van Gool, Luc ;
Arbelaez, Pablo .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :1855-1865
[7]  
Chiang P.-y., 2020, Adv. Neural Inf. Process. Syst., P1275
[8]  
Choi J, 2020, P AS C COMP VIS
[9]   Evaluating Robustness of Deep Image Super-Resolution Against Adversarial Attacks [J].
Choi, Jun-Ho ;
Zhang, Huan ;
Kim, Jun-Hyuk ;
Hsieh, Cho-Jui ;
Lee, Jong-Seok .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :303-311
[10]   Learning a Deep Convolutional Network for Image Super-Resolution [J].
Dong, Chao ;
Loy, Chen Change ;
He, Kaiming ;
Tang, Xiaoou .
COMPUTER VISION - ECCV 2014, PT IV, 2014, 8692 :184-199