LIGHT FIELD STYLE TRANSFER WITH LOCAL ANGULAR CONSISTENCY

被引:4
|
作者
Egan, Donal [1 ]
Alain, Martin [1 ]
Smolic, Aljosa [1 ]
机构
[1] Trinity Coll Dublin, Sch Comp Sci & Stat, V SENSE Project, Dublin, Ireland
来源
2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) | 2021年
基金
爱尔兰科学基金会;
关键词
Light field; style transfer;
D O I
10.1109/ICASSP39728.2021.9414689
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Style transfer involves combining the style of one image with the content of another to form a new image. Unlike traditional two-dimensional images which only capture the spatial intensity of light rays, four-dimensional light fields also capture the angular direction of the light rays. Thus, applying style transfer to a light field requires to not only render convincing style transfer for each view, but also to preserve its angular structure. In this paper, we present a novel optimization-based method for light field style transfer which iteratively propagates the style from the centre view towards the outer views while enforcing local angular consistency. For this purpose, a new initialisation method and angular loss function is proposed for the optimization process. In addition, since style transfer for light field is an emerging topic, no clear evaluation procedure is available. Thus, we investigate the use of a recently proposed metric designed to evaluate light field angular consistency, as well as a proposed variant.
引用
收藏
页码:2300 / 2304
页数:5
相关论文
共 50 条
  • [1] Style Transfer for Light Field Photography
    Hart, David
    Greenland, Jessica
    Morse, Bryan
    2020 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV), 2020, : 99 - 108
  • [2] Arbitrary style transfer via content consistency and style consistency
    Xiaoming Yu
    Gan Zhou
    The Visual Computer, 2024, 40 : 1369 - 1382
  • [3] Arbitrary style transfer via content consistency and style consistency
    Yu, Xiaoming
    Zhou, Gan
    VISUAL COMPUTER, 2024, 40 (03): : 1369 - 1382
  • [4] Preserving Global and Local Temporal Consistency for Arbitrary Video Style Transfer
    Wu, Xinxiao
    Chen, Jialu
    MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, : 1791 - 1799
  • [5] Light Field alpha Matting Based on Spatial-Angular Consistency
    Liu Tianyi
    Qiu Jun
    He Di
    Liu Chang
    ACTA OPTICA SINICA, 2022, 42 (16)
  • [6] PHOTO STYLE TRANSFER WITH CONSISTENCY LOSSES
    Yao, Xu
    Puy, Gilles
    Perez, Patrick
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 2314 - 2318
  • [7] Light-field spectral decomposition with a spatial–angular consistency prior for disparity estimation
    Liu C.
    Qiu J.
    Wei F.
    Hao Z.
    Optik, 2023, 295
  • [8] Content Consistency Preserving Style Transfer Network
    Mao, Lin
    Wang, Meng
    Yang, Dawei
    Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics, 2022, 34 (06): : 892 - 900
  • [9] Coherent transfer of orbital angular momentum from an atomic system to a light field
    Akamatsu, D
    Kozuma, M
    PHYSICAL REVIEW A, 2003, 67 (02):
  • [10] Preserving Structural Consistency in Arbitrary Artist and Artwork Style Transfer
    Wu, Jingyu
    Hou, Lefan
    Li, Zejian
    Liao, Jun
    Liu, Li
    Sun, Lingyun
    THIRTY-SEVENTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 37 NO 3, 2023, : 2830 - 2838