Structure and Texture Preserving Network for Real-World Image Super-Resolution

被引:2
|
作者
Zhou, Bijun [1 ,2 ]
Yan, Huibin [1 ,2 ]
Wang, Shuoyao [1 ,2 ]
机构
[1] Shenzhen Univ, Coll Elect & Informat Engn, Shenzhen 518060, Peoples R China
[2] Guangdong Prov Engn Lab Digital Creat Technol, Shenzhen 518060, Peoples R China
基金
中国国家自然科学基金;
关键词
Degradation; Tensors; Image reconstruction; Superresolution; Task analysis; Periodic structures; Image restoration; Real-world super-resolution; structure tensor; global-local discriminator; generative adversarial network;
D O I
10.1109/LSP.2022.3216116
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Real-world image super-resolution (Real-SR) is a challenging task due to the unknown complex image degradation. Recent research on Real-SR has achieved remarkable progress by degradation process modeling; however, there are still undesired structural distortions and over-smoothed textures in the recovered images. In this letter, we propose a structure and texture preserving network, towards reducing the structural distortions while refining the perceptual-pleasant textures. Specifically, we propose a structure tensor (ST) branch to guide the restoration of high-resolution images by extracting channel-aggregated structural information. To further adaptively optimize different local texture, we replace the global discriminator with a global-local discriminator. By "local," we mean that the discriminator loss, imposed on local areas randomly selected from the generated SR image, is minimized to generate textures with great visual perception in the selected local areas. Experimental results on five real-world datasets demonstrate the superiority of our methods in restoring structures, generating visually realistic SR images, as well as handling images of different degradation levels.
引用
收藏
页码:2173 / 2177
页数:5
相关论文
共 50 条
  • [41] NTIRE 2020 Challenge on Real-World Image Super-Resolution: Methods and Results
    Lugmayr, Andreas
    Danelljan, Martin
    Timofte, Radu
    Ahn, Namhyuk
    Bai, Dongwoon
    Cai, Jie
    Cao, Yun
    Chen, Junyang
    Cheng, Kaihua
    Chun, SeYoung
    Deng, Wei
    El-Khamy, Mostafa
    Ho, Chiu Man
    Ji, Xiaozhong
    Kheradmand, Amin
    Kim, Gwantae
    Ko, Hanseok
    Lee, Kanghyu
    Lee, Jungwon
    Li, Hao
    Liu, Ziluan
    Liu, Zhi-Song
    Liu, Shuai
    Lu, Yunhua
    Meng, Zibo
    Michelini, Pablo Navarrete
    Micheloni, Christian
    Prajapati, Kalpesh
    Ren, Haoyu
    Seo, Yong Hyeok
    Siu, Wan-Chi
    Sohn, Kyung-Ah
    Tai, Ying
    Umer, Rao Muhammad
    Wang, Shuangquan
    Wang, Huibing
    Wu, Timothy Haoning
    Wu, Haoning
    Yang, Biao
    Yang, Fuzhi
    Yoo, Jaejun
    Zhao, Tongtong
    Zhou, Yuanbo
    Zhuo, Haijie
    Zong, Ziyao
    Zou, Xueyi
    2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, : 2058 - 2076
  • [42] DDNSR: a dual-input degradation network for real-world super-resolution
    Li, Yizhi
    Chen, Haixin
    Li, Tao
    Liu, Binbing
    PATTERN ANALYSIS AND APPLICATIONS, 2023, 26 (03) : 875 - 888
  • [43] DDNSR: a dual-input degradation network for real-world super-resolution
    Yizhi Li
    Haixin Chen
    Tao Li
    Binbing Liu
    Pattern Analysis and Applications, 2023, 26 (3) : 875 - 888
  • [44] Semantic Segmentation Guided Real-World Super-Resolution
    Aakerberg, Andreas
    Johansen, Anders S.
    Nasrollahi, Kamal
    Moeslund, Thomas B.
    2022 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW 2022), 2022, : 449 - 458
  • [45] StarSRGAN: Improving Real-World Blind Super-Resolution
    Vo K.D.
    Bui L.T.
    Computer Science Research Notes, 2023, 31 (1-2): : 62 - 72
  • [46] Investigating Tradeoffs in Real-World Video Super-Resolution
    Chan, Kelvin C. K.
    Zhou, Shangchen
    Xu, Xiangyu
    Loy, Chen Change
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022, : 5952 - 5961
  • [47] Learning Degradation for Real-World Face Super-Resolution
    Chen, Jin
    Chen, Jun
    Wang, Xiaofen
    Xu, Dongshu
    Liang, Chao
    Han, Zhen
    ADVANCES IN COMPUTER GRAPHICS, CGI 2023, PT II, 2024, 14496 : 120 - 131
  • [48] Real-infraredSR: real-world infrared image super-resolution via thermal imager
    Zhou, Yicheng
    Liu, Yuan
    Yuan, Liyin
    Chen, Qian
    Gu, Guohua
    Sui, Xiubao
    OPTICS EXPRESS, 2023, 31 (22) : 36171 - 36187
  • [49] Texture and edge preserving multiframe super-resolution
    Turgay, Emre
    Akar, Gozde B.
    IET IMAGE PROCESSING, 2014, 8 (09) : 499 - 508
  • [50] SuperNet: An Efficient Image Super-Resolution Preserving Neural Network
    Jayachitra, V. P.
    Devi, P. Renuka
    Nandhini, S.
    Khan, S. Darvish
    2019 11TH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTING (ICOAC 2019), 2019, : 420 - 427