Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution

被引:2
|
作者
Xu, Xiaoqian [1 ]
Wei, Pengxu [1 ]
Chen, Weikai [2 ]
Liu, Yang [1 ]
Mao, Mingzhi [1 ]
Lin, Liang [1 ]
Li, Guanbin [1 ]
机构
[1] Sun Yat Sen Univ, Guangzhou, Peoples R China
[2] Tencent Amer, Palo Alto, CA USA
来源
2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022) | 2022年
关键词
D O I
10.1109/CVPR52688.2022.00558
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to the sophisticated imaging process, an identical scene captured by different cameras could exhibit distinct imaging patterns, introducing distinct proficiency among the super-resolution (SR) models trained on images from different devices. In this paper, we investigate a novel and practical task coded cross-device SR, which strives to adapt a real-world SR model trained on the paired images captured by one camera to low-resolution (LR) images captured by arbitrary target devices. The proposed task is highly challenging due to the absence of paired data from various imaging devices. To address this issue, we propose an unsupervised domain adaptation mechanism for real-world SR, named Dual ADversarial Adaptation (DADA), which only requires LR images in the target domain with available real paired data from a source camera. DADA employs the Domain-Invariant Attention (DIA) module to establish the basis of target model training even without HR supervision. Furthermore, the dual framework of DADA facilitates an Inter-domain Adversarial Adaptation (InterAA) in one branch for two LR input images from two domains, and an Intra-domain Adversarial Adaptation (IntraAA) in two branches for an LR input image. InterAA and IntraAA together improve the model transferability from the source domain to the target. We empirically conduct experiments under six Real -> Real adaptation settings among three different cameras, and achieve superior performance compared with existing state-of-the-art approaches. We also evaluate the proposed DADA to address the adaptation to the video camera, which presents a promising research topic to promote the wide applications of real-world super-resolution. Our source code is publicly available at https://github.com/lonelyhope/DADA.
引用
收藏
页码:5657 / 5666
页数:10
相关论文
共 50 条
  • [41] AIM 2019 Challenge on Real-World Image Super-Resolution: Methods and Results
    Lugmayr, Andreas
    Danelljan, Martin
    Timofte, Radu
    Fritsche, Manuel
    Gu, Shuhang
    Purohit, Kuldeep
    Kandula, Praveen
    Suin, Maitreya
    Rajagopalan, A. N.
    Joon, Nam Hyung
    Won, Yu Seung
    Kim, Guisik
    Kwon, Dokyeong
    Hsu, Chih-Chung
    Lin, Chia-Hsiang
    Huang, Yuanfei
    Sun, Xiaopeng
    Lu, Wen
    Li, Jie
    Gao, Xinbo
    Bell-Kligler, Sefi
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, : 3575 - 3583
  • [42] NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Results
    Lugmayr, Andreas
    Danelljan, Martin
    Timofte, Radu
    Ahn, Namhyuk
    Bai, Dongwoon
    Cai, Jie
    Cao, Yun
    Chen, Junyang
    Cheng, Kaihua
    Chun, SeYoung
    Deng, Wei
    El-Khamy, Mostafa
    Ho, Chiu Man
    Ji, Xiaozhong
    Kheradmand, Amin
    Kim, Gwantae
    Ko, Hanseok
    Lee, Kanghyu
    Lee, Jungwon
    Li, Hao
    Liu, Ziluan
    Liu, Zhi-Song
    Liu, Shuai
    Lu, Yunhua
    Meng, Zibo
    Michelini, Pablo Navarrete
    Micheloni, Christian
    Prajapati, Kalpesh
    Ren, Haoyu
    Seo, Yong Hyeok
    Siu, Wan-Chi
    Sohn, Kyung-Ah
    Tai, Ying
    Umer, Rao Muhammad
    Wang, Shuangquan
    Wang, Huibing
    Wu, Timothy Haoning
    Wu, Haoning
    Yang, Biao
    Yang, Fuzhi
    Yoo, Jaejun
    Zhao, Tongtong
    Zhou, Yuanbo
    Zhuo, Haijie
    Zong, Ziyao
    Zou, Xueyi
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2058 - 2076
  • [43] Semantic Segmentation Guided Real-World Super-Resolution
    Aakerberg, Andreas
    Johansen, Anders S.
    Nasrollahi, Kamal
    Moeslund, Thomas B.
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 449 - 458
  • [44] StarSRGAN: Improving Real-World Blind Super-Resolution
    Vo K.D.
    Bui L.T.
    Computer Science Research Notes, 2023, 31 (1-2): : 62 - 72
  • [45] Investigating Tradeoffs in Real-World Video Super-Resolution
    Chan, Kelvin C. K.
    Zhou, Shangchen
    Xu, Xiangyu
    Loy, Chen Change
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5952 - 5961
  • [46] Learning Degradation for Real-World Face Super-Resolution
    Chen, Jin
    Chen, Jun
    Wang, Xiaofen
    Xu, Dongshu
    Liang, Chao
    Han, Zhen
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 120 - 131
  • [47] Real-infraredSR: real-world infrared image super-resolution via thermal imager
    Zhou, Yicheng
    Liu, Yuan
    Yuan, Liyin
    Chen, Qian
    Gu, Guohua
    Sui, Xiubao
    OPTICS EXPRESS, 2023, 31 (22) : 36171 - 36187
  • [48] Dual cross knowledge distillation for image super-resolution
    Fang, Hangxiang
    Long, Yongwen
    Hu, Xinyi
    Ou, Yangtao
    Huang, Yuanjia
    Hu, Haoji
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2023, 95
  • [49] FS-REAL: Towards Real-World Cross-Device Federated Learning
    Chen, Daoyuan
    Gao, Dawei
    Xie, Yuexiang
    Pan, Xuchen
    Li, Zitao
    Li, Yaliang
    Ding, Bolin
    Zhou, Jingren
    PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023, 2023, : 3829 - 3841
  • [50] FS-REAL: A Real-World Cross-Device Federated Learning Platform
    Gao, Dawei
    Chen, Daoyuan
    Li, Zitao
    Xie, Yuexiang
    Pan, Xuchen
    Li, Yaliang
    Ding, Bolin
    Zhou, Jingren
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2023, 16 (12): : 4046 - 4049