Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME | 2023年
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [21] A review of single image super-resolution reconstruction based on deep learning
    Ming Yu
    Jiecong Shi
    Cuihong Xue
    Xiaoke Hao
    Gang Yan
    Multimedia Tools and Applications, 2024, 83 : 55921 - 55962
  • [22] A Review of Single Image Super-Resolution Reconstruction Based on Deep Learning
    Wu J.
    Ye X.-J.
    Huang F.
    Chen L.-Q.
    Wang Z.-F.
    Liu W.-X.
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2022, 50 (09): : 2265 - 2294
  • [23] Deep Light Field Spatial Super-Resolution Using Heterogeneous Imaging
    Chen, Yeyao
    Jiang, Gangyi
    Yu, Mei
    Xu, Haiyong
    Ho, Yo-Sung
    IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2023, 29 (10) : 4183 - 4197
  • [24] Advances in Light Field Spatial Super-Resolution: A Comprehensive Literature Survey
    Lyu, Wenqi
    Sheng, Hao
    Ke, Wei
    Ma, Xiao
    IEEE ACCESS, 2025, 13 : 18470 - 18497
  • [25] Light Field Super-Resolution By Jointly Exploiting Internal and External Similarities
    Cheng, Zhen
    Xiong, Zhiwei
    Liu, Dong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (08) : 2604 - 2616
  • [26] Transformer and GAN-Based Super-Resolution Reconstruction Network for Medical Images
    Du, Weizhi
    Tian, Shihao
    TSINGHUA SCIENCE AND TECHNOLOGY, 2024, 29 (01): : 197 - 206
  • [27] A Transformer-Unet Generative Adversarial Network for the Super-Resolution Reconstruction of DEMs
    Zheng, Xin
    Xu, Zhaoqi
    Yin, Qian
    Bao, Zelun
    Chen, Zhirui
    Wang, Sizhu
    REMOTE SENSING, 2024, 16 (19)
  • [28] MULTI-GRANULARITY AGGREGATION TRANSFORMER FOR LIGHT FIELD IMAGE SUPER-RESOLUTION
    Wang, Zijian
    Lu, Yao
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 261 - 265
  • [29] CutMAA: Motion-Aware Data Augmentation for Light Field Super-Resolution
    Yun, Sojin
    Ahn, Namhyuk
    Kyu Park, In
    IEEE ACCESS, 2025, 13 : 27167 - 27177
  • [30] High Resolution Light Field Recovery with Fourier Disparity Layer Completion, Demosaicing, and Super-Resolution
    Le Pendu, Mikael
    Smolic, Aljosa
    2020 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY (ICCP), 2020,