Selective Light Field Refocusing for Camera Arrays Using Bokeh Rendering and Superresolution

被引:113
作者
Wang, Yingqian [1 ]
Yang, Jungang [1 ]
Guo, Yulan [1 ,2 ]
Xiao, Chao [1 ]
An, Wei [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci, Changsha 410073, Hunan, Peoples R China
[2] Sun Yat Sen Univ, Sch Elect & Commun Engn, Guangzhou 510275, Guangdong, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金; 美国国家科学基金会;
关键词
Bokeh; camera array; depth of field (DoF); light field (LF); refocusing; superresolution (SR); APERTURE; DEPTH;
D O I
10.1109/LSP.2018.2885213
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Camera arrays provide spatial and angular information within a single snapshot. With refocusing methods, focal planes can be altered after exposure. In this letter, we propose a light field refocusing method to improve the imaging quality of camera arrays. In our method, the disparity is first estimated. Then, the unfocused region (bokeh) is rendered by using a depth-based anisotropic filter. Finally, the refocused image is produced by a reconstruction-based superresolution approach where the bokeh image is used as a regularization term. Our method can selectively refocus images with focused region being superresolved and bokeh being esthetically rendered. Our method also enables postadjustment of depth of field. We conduct experiments on both public and self-developed datasets. Our method achieves superior visual performance with acceptable computational cost as compared to the other state-of-the-art methods.
引用
收藏
页码:204 / 208
页数:5
相关论文
共 27 条
  • [1] [Anonymous], 2005, STANFORD U CSTR
  • [2] [Anonymous], 2013, ACM TOG
  • [3] Real-time, accurate depth of field using anisotropic diffusion and programmable graphics cards
    Bertalmío, M
    Fort, P
    Sánchez-Crespo, D
    [J]. 2ND INTERNATIONAL SYMPOSIUM ON 3D DATA PROCESSING, VISUALIZATION, AND TRANSMISSION, PROCEEDINGS, 2004, : 767 - 773
  • [4] Super Resolution of Light Field Images Using Linear Subspace Projection of Patch-Volumes
    Farrugia, Reuben A.
    Galea, Christian
    Guillemot, Christine
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (07) : 1058 - 1071
  • [5] Fast and robust multiframe super resolution
    Farsiu, S
    Robinson, MD
    Elad, M
    Milanfar, P
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2004, 13 (10) : 1327 - 1344
  • [6] Focused plenoptic camera and rendering
    Georgiev, Todor
    Lumsdaine, Andrew
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2010, 19 (02)
  • [7] Postcapture Focusing Using Regression Forest
    Kanojia, Gagan
    Raman, Shanmuganathan
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2017, 24 (06) : 751 - 755
  • [8] The HCI Benchmark Suite: Stereo And Flow Ground Truth With Uncertainties for Urban Autonomous Driving
    Kondermann, Daniel
    Nair, Rahul
    Honauer, Katrin
    Krispin, Karsten
    Andrulis, Jonas
    Brock, Alexander
    Guessefeld, Burkhard
    Rahimimoghaddam, Mohsen
    Hofmann, Sabine
    Brenner, Claus
    Jaehne, Bernd
    [J]. PROCEEDINGS OF 29TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, (CVPRW 2016), 2016, : 19 - 28
  • [9] Real-Time Depth-of-Field Rendering Using Anisotropically Filtered Mipmap Interpolation
    Lee, Sungkil
    Kim, Gerard Jounghyun
    Choi, Seungmoon
    [J]. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2009, 15 (03) : 453 - 464
  • [10] Real-Time Depth-of-Field Rendering Using Point Splatting on Per-Pixel Layers
    Lee, Sungkil
    Kim, Gerard Jounghyun
    Choi, Seungmoon
    [J]. COMPUTER GRAPHICS FORUM, 2008, 27 (07) : 1955 - 1962