Learning a Multilevel Cooperative View Reconstruction Network for Light Field Angular Super-Resolution

被引:4
|
作者
Liu, Deyang [1 ]
Mao, Yifan [2 ]
Zhou, Xiaofei [3 ]
An, Ping [4 ]
Fang, Yuming [5 ]
机构
[1] Jiangxi Univ Finance & Econ, Anhui Prov Key Lab Network & Informat Secur, Nanchang, Jiangxi, Peoples R China
[2] Anqing Normal Unviers, Sch Comp & Informat, Anqing, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou, Peoples R China
[4] Shanghai Univ, Sch Commun & Informat Engn, Shanghai, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang, Jiangxi, Peoples R China
来源
2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME | 2023年
基金
中国国家自然科学基金;
关键词
Light fields; angular reconstruction; debluring; transformer;
D O I
10.1109/ICME55011.2023.00221
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, many methods have been proposed to improve the angular resolution of sparsely-sampled Light Field (LF). However, the synthesized dense LF inevitably exhibits blurry edges and artifacts. This paper intents to model the global relations of LF views and quality degradation model by learning a multilevel cooperative view reconstruction network to further enhance LF angular Super-Resolution (SR) performance. The proposed LF angular SR network consists of three sub-networks including the Cooperative Angular Transformer Network (CAT-Net), the Deblurring Network (DBNet), and the Texture Repair Network (TRNet). The CATNet simultaneously captures global features of all LF views and local features within each view, which benefits in characterizing the inherent LF structure. The DBNet models a quality degradation model by estimating blur kernels to reduce the blurry edges and artifacts. The TRNet focuses on restoring fine-scale texture details. Experimental results over various LF datasets including large baseline LF images demonstrate the significant superiority of our method when compared with state-of-the-art ones.
引用
收藏
页码:1271 / 1276
页数:6
相关论文
共 50 条
  • [1] Geometry-assisted multi-representation view reconstruction network for Light Field image angular super-resolution
    Liu, Deyang
    Tong, Zaidong
    Huang, Yan
    Chen, Yilei
    Zuo, Yifan
    Fang, Yuming
    KNOWLEDGE-BASED SYSTEMS, 2023, 267
  • [2] Light field angular super-resolution by view-specific queries
    Wang, Shunzhou
    Lu, Yao
    Xia, Wang
    Xia, Peiqi
    Wang, Ziqi
    Gao, Wei
    VISUAL COMPUTER, 2024, : 3565 - 3580
  • [3] Light Field Angular Super-Resolution Network Based on Convolutional Transformer and Deep Deblurring
    Liu, Deyang
    Mao, Yifan
    Zuo, Yifan
    An, Ping
    Fang, Yuming
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2024, 10 : 1736 - 1748
  • [4] Light Field Image Super-Resolution Based on Multilevel Structures
    Park, Hwa-Jong
    Shin, Junho
    Kim, Hyunseop
    Koh, Yeong Jun
    IEEE ACCESS, 2022, 10 : 59135 - 59144
  • [5] Disparity Enhancement-Based Light Field Angular Super-Resolution
    Cai, Dongjun
    Chen, Yilei
    Huang, Xinpeng
    An, Ping
    IEEE SIGNAL PROCESSING LETTERS, 2025, 32 : 81 - 85
  • [6] Light Field Image Super-Resolution With Transformers
    Liang, Zhengyu
    Wang, Yingqian
    Wang, Longguang
    Yang, Jungang
    Zhou, Shilin
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 563 - 567
  • [7] Light Field Image Super-Resolution Network via Joint Spatial-Angular and Epipolar Information
    Duong, Vinh Van
    Huu, Thuc Nguyen
    Yim, Jonghoon
    Jeon, Byeungwoo
    IEEE TRANSACTIONS ON COMPUTATIONAL IMAGING, 2023, 9 : 350 - 366
  • [8] Joint Light Field Spatial and Angular Super-Resolution From a Single Image
    Ivan, Andre
    Williem
    Park, In Kyu
    IEEE ACCESS, 2020, 8 : 112562 - 112573
  • [9] Exploiting Spatial and Angular Correlations With Deep Efficient Transformers for Light Field Image Super-Resolution
    Cong, Ruixuan
    Sheng, Hao
    Yang, Da
    Cui, Zhenglong
    Chen, Rongshan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 1421 - 1435
  • [10] A survey for light field super-resolution
    Zhao, Mingyuan
    Sheng, Hao
    Yang, Da
    Wang, Sizhe
    Cong, Ruixuan
    Cui, Zhenglong
    Chen, Rongshan
    Wang, Tun
    Wang, Shuai
    Huang, Yang
    Shen, Jiahao
    HIGH-CONFIDENCE COMPUTING, 2024, 4 (01):