Learning to Synthesize Motion Blur

被引:54
作者
Brooks, Tim [1 ]
Barron, Jonathan T. [1 ]
机构
[1] Google Res, Mountain View, CA 94043 USA
来源
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019) | 2019年
关键词
D O I
10.1109/CVPR.2019.00700
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a technique for synthesizing a motion blurred image from a pair of unblurred images captured in succession. To build this system we motivate and design a differentiable "line prediction" layer to be used as part of a neural network architecture, with which we can learn a system to regress from image pairs to motion blurred images that span the capture time of the input image pair. Training this model requires an abundance of data, and so we design and execute a strategy for using frame interpolation techniques to generate a large-scale synthetic dataset of motion blurred images and their respective inputs. We additionally capture a high quality test set of real motion blurred images, synthesized from slow motion videos, with which we evaluate our model against several baseline techniques that can be used to synthesize motion blur. Our model produces higher accuracy output than our baselines, and is several orders of magnitude faster than baselines with competitive accuracy.
引用
收藏
页码:6833 / 6841
页数:9
相关论文
共 34 条
  • [1] [Anonymous], 2018, CVPR
  • [2] [Anonymous], 2018, CVPR
  • [3] [Anonymous], 2015, ICCV
  • [4] [Anonymous], 2015, CVPR
  • [5] [Anonymous], 2016, 12 USENIX S OPERATIN
  • [6] [Anonymous], 2017, CVPR
  • [7] [Anonymous], 2013, P 30 INT C MACH LEAR
  • [8] [Anonymous], 2006, NIPS
  • [9] [Anonymous], 2015, CVPR
  • [10] [Anonymous], 2006, SIGGRAPH