Feature-based motion compensated interpolation for frame rate up-conversion

被引:10
作者
Guo, Dabo [1 ,4 ]
Shao, Ling [2 ,3 ]
Han, Jungong
机构
[1] Shanxi Univ, Coll Phys & Elect Engn, Taiyuan, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Coll Elect & Informat Engn, Nanjing, Jiangsu, Peoples R China
[3] Univ Sheffield, Dept Elect & Elect Engn, Sheffield S1 3JD, S Yorkshire, England
[4] Univ Sheffield, Sheffield S10 2TN, S Yorkshire, England
关键词
Motion-compensated frame interpolation (MCFI); Frame rate up-conversion (FRUC); Feature matching; Mesh-based motion estimation; ACTIVE MESH; SCHEME;
D O I
10.1016/j.neucom.2013.06.045
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose to use feature point matching and mesh-based motion estimation for frame rate up-conversion. Matched local feature points between successive frames in a video sequence are employed to constitute a discrete and sparse motion field. Afterwards, a proximity-constraint marking process regulates the raw correspondence set to a content/motion adaptive nodal set. These correspondences are organized by a Delaunay triangular mesh so as to generate a dense motion field through the affine transformation. The experimental results demonstrate that the proposed scheme outperforms three other popular methods in terms of both subjective and objective evaluations. They also suggest that the proposed method is more suitable for videos containing a complex motion field. (C) 2013 Elsevier B.V. All rights reserved.
引用
收藏
页码:390 / 397
页数:8
相关论文
共 19 条
  • [1] Occlusion-adaptive, content-based mesh design and forward tracking
    Altunbasak, Y
    Tekalp, AM
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 1997, 6 (09) : 1270 - 1280
  • [2] True-Motion Estimation with 3-D Recursive Search Block Matching
    de Haan, Gerard
    Biezen, Paul W. A. C.
    Huijgen, Henk
    Ojo, Olukayode A.
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 1993, 3 (05) : 368 - +
  • [3] Triangular active mesh for motion estimation
    Dudon, M
    Avaro, O
    Roux, C
    [J]. SIGNAL PROCESSING-IMAGE COMMUNICATION, 1997, 10 (1-3) : 21 - 41
  • [4] Guo DB, 2009, J SYST ENG ELECTRON, V20, P32
  • [5] Visible and infrared image registration in man-made environments employing hybrid visual features
    Han, Jungong
    Pauwels, Eric J.
    de Zeeuw, Paul
    [J]. PATTERN RECOGNITION LETTERS, 2013, 34 (01) : 42 - 51
  • [6] A multistage motion vector processing method for motion-compensated frame interpolation
    Huang, Ai-Mei
    Nguyen, Truong Q.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2008, 17 (05) : 694 - 708
  • [7] Correlation-Based Motion Vector Processing With Adaptive Interpolation Scheme for Motion-Compensated Frame Interpolation
    Huang, Ai-Mei
    Nguyen, Truong
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2009, 18 (04) : 740 - 752
  • [8] Khvedchenia I., 2011, COMARISON OPENCVS FE
  • [9] Koga T, 1981, P NTC 81 NEW ORL LA, V81
  • [10] Multiple Hypotheses Bayesian Frame Rate Up-Conversion by Adaptive Fusion of Motion-Compensated Interpolations
    Liu, Hongbin
    Xiong, Ruiqin
    Zhao, Debin
    Ma, Siwei
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2012, 22 (08) : 1188 - 1198