MAFT: An Image Super-Resolution Method Based on Mixed Attention and Feature Transfer

被引:0
|
作者
Liu, Xin [1 ]
Li, Jing [1 ]
Cui, Yuanning [2 ]
Zhu, Wei [3 ]
Qian, Luhong [3 ]
机构
[1] Nanjing Univ Aeronaut & Astronaut, Coll Artificial Intelligence, Coll Comp Sci & Technol, Nanjing 211106, Peoples R China
[2] Nanjing Univ, Nanjing 210023, Peoples R China
[3] Kunshan Huaheng Welding Co Ltd, Suzhou 215300, Peoples R China
来源
关键词
Computer vision; Machine learning; Super-resolution; Attention mechanism;
D O I
10.1007/978-3-031-25198-6_39
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Reference-based image super-resolution methods, which enhance the restoration of a low-resolution (LR) images by introducing an additional high-resolution (HR) reference image, have made rapid and remarkable progress in the field of image super-resolution in recent years. Most of the existing methods use an implicit correspondence matching approach to transfer HR features from the reference image (Ref) to the LR image. However, these methods lack the further judgment and processing of the HR features from Ref, which limits them in challenging cases. In this paper, We propose an image super-resolution method based on mixed attention and feature transfer (MAFT). First, we obtain the deep features of the LR and Ref images through the encoder network, then extract the transferred features from Ref through the attention network, and perform adaptive optimization processing on the features, and finally fuse the transferred features with LR features to achieve a high-quality image reconstruction. The quantitative and qualitative experiments on these benchmarks, i.e., CUFED5, Urban100 and Manga109, show that MAFT outperforms the state-of-the-art baselines with significant improvements.
引用
收藏
页码:511 / 519
页数:9
相关论文
共 50 条
  • [31] Hyperspectral Image Super-Resolution Based on Feature Diversity Extraction
    Zhang, Jing
    Zheng, Renjie
    Wan, Zekang
    Geng, Ruijing
    Wang, Yi
    Yang, Yu
    Zhang, Xuepeng
    Li, Yunsong
    REMOTE SENSING, 2024, 16 (03)
  • [32] Image Super-Resolution Reconstruction Method Based on Self-Attention Deep Network
    Chen Zihan
    Wu Haobo
    Pei Haodong
    Chen Rong
    Hu Jiaxin
    Shi Hengtong
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (04)
  • [33] Feature Fusion Based on Sparse Block for Image Super-resolution
    Wang, Shengping
    Zhao, Li
    Jiang, Runhua
    Huang, Pengcheng
    Xu, Jiawei
    2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 3347 - 3354
  • [34] MadFormer: multi-attention-driven image super-resolution method based on Transformer
    Beibei Liu
    Jing Sun
    Bing Zhu
    Ting Li
    Fuming Sun
    Multimedia Systems, 2024, 30
  • [35] Parallax-based second-order mixed attention for stereo image super-resolution
    Duan, Chenyang
    Xiao, Nanfeng
    IET COMPUTER VISION, 2022, 16 (01) : 26 - 37
  • [36] MadFormer: multi-attention-driven image super-resolution method based on Transformer
    Liu, Beibei
    Sun, Jing
    Zhu, Bing
    Li, Ting
    Sun, Fuming
    MULTIMEDIA SYSTEMS, 2024, 30 (02)
  • [37] Adaptive Attention Network for Image Super-resolution
    Chen Y.-M.
    Zhou D.-W.
    Zidonghua Xuebao/Acta Automatica Sinica, 2022, 48 (08): : 1950 - 1960
  • [38] Face image super-resolution with an attention mechanism
    Chen X.
    Shen H.
    Bian Q.
    Wang Z.
    Tian X.
    Xi'an Dianzi Keji Daxue Xuebao/Journal of Xidian University, 2019, 46 (03): : 148 - 153
  • [39] REMA: A Rich Elastic Mixed Attention Module for Single Image Super-Resolution
    Gu, Xinjia
    Chen, Yimin
    Tong, Weiqin
    SENSORS, 2024, 24 (13)
  • [40] Local feature extraction for image super-resolution
    Baboulaz, Loic
    Dragotti, Pier Luigi
    2007 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, VOLS 1-7, 2007, : 2653 - 2656