Digital video sequence stabilization based on 2.5D motion estimation and inertial motion filtering

This paper presents a novel approach to stabilize digital video sequences. A 2.5D inter-frame motion model is proposed so that the stabilization system can perform in the situations where significant depth changes are present and the camera has both rotation and translation. Inertial motion filtering is proposed in order to eliminate the vibration of the video sequences with enhanced perceptual properties. The implementation of this new approach integrates four modules: pyramid-based motion detection,2.5D motion parameter estimation, inertial motion filtering and affine-based motion compensation. The stabilization system can smooth unwanted vibrations or shakes of video sequences and achieves a real-time speed. © 2001 Academic Press.