Multi-exposure photomontage with hand-held cameras

被引:5
作者
Li, Ru [1 ]
Liu, Shuaicheng [1 ]
Liu, Guanghui [1 ]
Sun, Tiecheng [1 ]
Guo, Jishun [1 ]
机构
[1] Univ Elect Sci & Technol China, Sch Informat & Commun Engn, Chengdu, Sichuan, Peoples R China
基金
中国国家自然科学基金;
关键词
Multi-exposure image fusion; MRF; Rough registration; IMAGE FUSION;
D O I
10.1016/j.cviu.2020.102929
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The paper studies the image fusion from multiple images taken by hand-held cameras with different exposures. Existing methods often generate unsatisfactory results, such as blurring/ghosting artifacts due to the problematic handling of camera motions, dynamic contents, and inappropriately fusion of local regions (e.g., over or under exposed). In addition, they often require a high-quality image registration, which is hard to achieve in scenarios with large depth variations and dynamic textures, and is also time-consuming. In this paper, we propose to enable a rough registration by a single homography and combine the inputs seamlessly to hide any possible misalignment. Specifically, the method first uses a Markov Random Field (MRF) energy for the labeling of all pixels, which assigns different labels to different aligned input images. During the labeling, it chooses well-exposed regions and skips moving objects at the same time. Then, the proposed method combines a Laplacian image according to the labels and constructs the fusion result by solving the Poisson equation. Furthermore, it adds some internal constraints when solving the Poisson equation for balancing and improving fusion results. We present various challenging examples, including static/dynamic, indoor/outdoor and daytime/nighttime scenes, to demonstrate the effectiveness and practicability of the proposed method.
引用
收藏
页数:11
相关论文
共 64 条
  • [1] Towards an automatic correction of over-exposure in photographs: Application to tone-mapping
    Abebe, Mekides Assefa
    Booth, Alexandra
    Kervec, Jonathan
    Pouli, Tania
    Larabi, Mohamed-Chaker
    [J]. COMPUTER VISION AND IMAGE UNDERSTANDING, 2018, 168 : 3 - 20
  • [2] Interactive digital photomontage
    Agarwala, A
    Dontcheva, M
    Agrawala, M
    Drucker, S
    Colburn, A
    Curless, B
    Salesin, D
    Cohen, M
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2004, 23 (03): : 294 - 302
  • [3] [Anonymous], ERIK REINHARD
  • [4] Banterle F, 2011, ADVANCED HIGH DYNAMIC RANGE IMAGING: THEORY AND PRACTICE, P1
  • [5] Fast approximate energy minimization via graph cuts
    Boykov, Y
    Veksler, O
    Zabih, R
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (11) : 1222 - 1239
  • [6] Burt P. J., 1993, [1993] Proceedings Fourth International Conference on Computer Vision, P173, DOI 10.1109/ICCV.1993.378222
  • [7] Burt P.J., 1984, Multiresolution Image Processing and Analysis, P6, DOI [10.1007/978-3-642-51590-3_2, 10.1007/978-3-642-51590-32, DOI 10.1007/978-3-642-51590-3_2]
  • [8] THE LAPLACIAN PYRAMID AS A COMPACT IMAGE CODE
    BURT, PJ
    ADELSON, EH
    [J]. IEEE TRANSACTIONS ON COMMUNICATIONS, 1983, 31 (04) : 532 - 540
  • [9] Time Slice Video Synthesis by Robust Video Alignment
    Cui, Zhaopeng
    Wang, Oliver
    Tan, Ping
    Wang, Jue
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [10] Dannont A., 2012, HIGH DYNAMIC RANGE I