Stereoscopic image super-resolution with interactive memory learning

被引:13
|
作者
Zhu, Xiangyuan [1 ]
Guo, Kehua [1 ]
Qiu, Tian [1 ]
Fang, Hui [2 ]
Wu, Zheng [1 ]
Tan, Xuyang [1 ]
Liu, Chao [3 ]
机构
[1] Cent South Univ, Sch Comp Sci & Engn, South Rd Lushan, Changsha 410083, Hunan, Peoples R China
[2] Loughborough Univ, Comp Sci, Epinal Way, Loughborough LE11 3TU, Leics, England
[3] Acad Mil Sci, Inst Syst Engn, Peoples Liberat Army, Beijing 100000, Peoples R China
基金
美国国家科学基金会;
关键词
Image super-resolution; Stereo image; Interactive learning; Memory network; Feature refinement; PARALLAX ATTENTION; NETWORK;
D O I
10.1016/j.eswa.2023.120143
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Stereo image super-resolution aims to exploit the complementary information between image pairs and generate images with high resolution and rich details. However, existing methods explicitly calculate the similarity between image patches or pixels to build correspondence between different views. These hard -matching methods leave deep semantic information between image pairs unexplored. In this paper, a stereo image super-resolution method with interactive memory learning is designed to take advantage of the complementary information of different views in an implicit way. Specifically, we propose an interactive memory learning strategy to implicitly capture the semantic similarity between different views and design a feature dual-aggregation module for feature refinement. Extensive experiments on different datasets achieve state-of-the-art results, demonstrating that our method effectively boosts the quantitative and qualitative results of stereoscopic image pairs. Code can be found at: https://github.com/zhuxiangyuan1/IMLnet.
引用
收藏
页数:12
相关论文
共 50 条
  • [31] Learning-Based Quality Assessment for Image Super-Resolution
    Zhao, Tiesong
    Lin, Yuting
    Xu, Yiwen
    Chen, Weiling
    Wang, Zhou
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 24 : 3570 - 3581
  • [32] Learning hybrid dynamic transformers for underwater image super-resolution
    He, Xin
    Li, Junjie
    Jia, Tong
    FRONTIERS IN MARINE SCIENCE, 2024, 11
  • [33] Enhanced local distribution learning for real image super-resolution
    Sun, Yaoqi
    Chen, Quan
    Xu, Wen
    Huang, Aiai
    Yan, Chenggang
    Zheng, Bolun
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2024, 247
  • [34] Implicit Neural Representation Learning for Hyperspectral Image Super-Resolution
    Zhang, Kaiwei
    Zhu, Dandan
    Min, Xiongkuo
    Zhai, Guangtao
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [35] Deep Learning Based Approach Implemented to Image Super-Resolution
    Thuong Le-Tien
    Tuan Nguyen-Thanh
    Hanh-Phan Xuan
    Giang Nguyen-Truong
    Vinh Ta-Quoc
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2020, 11 (04) : 209 - 216
  • [36] Deep Learning Based Single Image Super-Resolution: A Survey
    Khanh Ha, Viet
    Ren, Jinchang
    Xu, Xinying
    Zhao, Sophia
    Xie, Gang
    Masero Vargas, Valentin
    ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2018, 2018, 10989 : 106 - 119
  • [37] Deep Learning Based Single Image Super-resolution: A Survey
    Viet Khanh Ha
    Ren, Jin-Chang
    Xu, Xin-Ying
    Zhao, Sophia
    Xie, Gang
    Masero, Valentin
    Hussain, Amir
    INTERNATIONAL JOURNAL OF AUTOMATION AND COMPUTING, 2019, 16 (04) : 413 - 426
  • [38] Image super-resolution reconstruction based on deep dictionary learning and A
    Huang, Yi
    Bian, Weixin
    Jie, Biao
    Zhu, Zhiqiang
    Li, Wenhu
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2629 - 2641
  • [39] Learning cascade regression for super-resolution image quality assessment
    Quan, Xing
    Zhang, Kaibing
    Zhu, Danni
    Fan, Dandan
    Hu, Yanting
    Chen, Jinguang
    APPLIED INTELLIGENCE, 2023, 53 (22) : 27304 - 27322
  • [40] Learning Dynamic Generative Attention for Single Image Super-Resolution
    Chen, Rui
    Zhang, Yan
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (12) : 8368 - 8382