LF-SAET: Cascaded Spatial-Angular-EPI Transformers for Light Field Image Super-Resolution

被引:0
|
作者
Zhang, Hao [1 ]
Yu, Junle [1 ]
Wu, Chenyu [1 ]
Meng, Jiahan [1 ]
Zhou, Wenhui [1 ]
机构
[1] Hangzhou Dianzi Univ, Hangzhou, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION, PT IX, PRCV 2024 | 2025年 / 15039卷
关键词
Light field; Super-resolution; Linear attention transformer; Adaptive receptive field;
D O I
10.1007/978-981-97-8692-3_37
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Light field (LF) image super-resolution has always been a challenging task due to the complex structure of light field image, where spatial and angular information is highly coupled with varying disparities. Recent studies tend to disentangle a 4D LF image into multiple 2D subspaces, and design domain-specific convolutions to extract LF features from spatial, angular, and epipolar plane image (EPI) subspaces, respectively. However, the limited receptive field range of the convolution operation restricts their ability to learn long-range dependencies of LF features. To this end, this paper proposes cascaded spatial-angular-EPI Transformers for light field image super-resolution (LF-SAET) by integrating the spatial, angular, and EPI Transformers. In addition, to ensure smooth feature transitions between the local and the global feature extraction modules, we introduce an adaptive receptive field (ARF) module. We also adopt a linear attention mechanism to alleviate the significant computational cost when learning spatial information within each sub-aperture image. Extensive experiments on public LF datasets demonstrate the superiority of our method over the state-of-the-art methods.
引用
收藏
页码:525 / 538
页数:14
相关论文
共 50 条
  • [1] Exploiting Spatial and Angular Correlations with Deep Efficient Transformers for Light Field Image Super-Resolution
    Cong, Ruixuan
    Sheng, Hao
    Yang, Da
    Cui, Zhenglong
    Chen, Rongshan
    IEEE Transactions on Multimedia, 2024, 26 : 1421 - 1435
  • [2] Exploiting Spatial and Angular Correlations With Deep Efficient Transformers for Light Field Image Super-Resolution
    Cong, Ruixuan
    Sheng, Hao
    Yang, Da
    Cui, Zhenglong
    Chen, Rongshan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1421 - 1435
  • [3] Light Field Image Super-Resolution With Transformers
    Liang, Zhengyu
    Wang, Yingqian
    Wang, Longguang
    Yang, Jungang
    Zhou, Shilin
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 563 - 567
  • [4] Joint Light Field Spatial and Angular Super-Resolution From a Single Image
    Ivan, Andre
    Williem
    Park, In Kyu
    IEEE ACCESS, 2020, 8 : 112562 - 112573
  • [5] Learning from EPI-Volume-Stack for Light Field image angular super-resolution
    Liu, Deyang
    Wu, Qiang
    Huang, Yan
    Huang, Xinpeng
    An, Ping
    SIGNAL PROCESSING-IMAGE COMMUNICATION, 2021, 97
  • [6] Hierarchical spatial-angular integration for lightweight light field image super-resolution
    Li, Meng
    Ma, Bo
    Wang, Shunzhou
    KNOWLEDGE-BASED SYSTEMS, 2025, 315
  • [7] Light Field Super-Resolution Based on Spatial and Angular Attention
    Li, Donglin
    Yang, Da
    Wang, Sizhe
    Sheng, Hao
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT I, 2021, 12937 : 314 - 325
  • [8] Spatial-angular-epipolar transformer for light field spatial and angular super-resolution
    Wang, Sizhe
    Sheng, Hao
    Chen, Rongshan
    Yang, Da
    Cui, Zhenglong
    Cong, Ruixuan
    Xiong, Zhang
    DISPLAYS, 2024, 85
  • [9] Light field image super-resolution based on raw data with transformers
    Guo, Xiao
    Sang, Xinzhu
    Yan, Binbin
    Chen, Duo
    Wang, Peng
    JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 2022, 39 (12) : 2131 - 2141
  • [10] Progressive spatial-angular feature enhancement network for light field image super-resolution
    Chen, Hongjie
    Shao, Feng
    Chai, Xiongli
    Chen, Hangwei
    DISPLAYS, 2023, 79