Motion Deblurring of Faces

被引:22
作者
Chrysos, Grigorios G. [1 ]
Favaro, Paolo [2 ]
Zafeiriou, Stefanos [1 ]
机构
[1] Imperial Coll London, Dept Comp, 180 Queens Gate, London SW7 2AZ, England
[2] Univ Bern, Dept Informat, Neubruckstr 10, CH-3012 Bern, Switzerland
关键词
Learning motion deblurring; Face deblurring; Data-driven networks; IMAGE; IDENTIFICATION; RESTORATION;
D O I
10.1007/s11263-018-1138-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Face analysis lies at the heart of computer vision with remarkable progress in the past decades. Face recognition and tracking are tackled by building invariance to fundamental modes of variation such as illumination, 3D pose. A much less standing mode of variation is motion deblurring, which however presents substantial challenges in face analysis. Recent approaches either make oversimplifying assumptions, e.g. in cases of joint optimization with other tasks, or fail to preserve the highly structured shape/identity information. We introduce a two-step architecture tailored to the challenges of motion deblurring: the first step restores the low frequencies; the second restores the high frequencies, while ensuring that the outputs span the natural images manifold. Both steps are implemented with a supervised data-driven method; to train those we devise a method for creating realistic motion blur by averaging a variable number of frames. The averaged images originate from the 2MF2 dataset with 19 million facial frames, which we introduce for the task. Considering deblurring as an intermediate step, we conduct a thorough experimentation on high-level face analysis tasks, i.e. landmark localization and face verification, on blurred images. The experimental evaluation demonstrates the superiority of our method.
引用
收藏
页码:801 / 823
页数:23
相关论文
共 78 条
  • [1] [Anonymous], IEEE P INT C COMP VI
  • [2] [Anonymous], P BRIT MACH VIS C BM
  • [3] [Anonymous], IEEE P INT C COMP VI
  • [4] [Anonymous], IEEE P INT C COMP VI
  • [5] [Anonymous], IEEE P INT C COMP VI
  • [6] [Anonymous], INT C MACH LEARN WOR
  • [7] [Anonymous], 2017, IEEE C COMP VIS PATT
  • [8] [Anonymous], IEEE P INT C COMP VI
  • [9] [Anonymous], 2016, P AS C COMP VIS
  • [10] [Anonymous], IEEE P INT C COMP VI