Shot boundary detection based on SVM and TMRA

Video shot boundary detection (SBD) is an important step in many video applications. In this paper, previous temporal multi-resolution analysis (TMRA) framework was extended by first using SVM (Supported Vector Machines) classify the video frames within a sliding window into normal frames, gradual transition frames and CUT frames, then clustering the classified frames into different shot categories. The experimental result on ground truth, which has about 26 hours (13,344 shots) news video clips, shows that the new framework has relatively good accuracy for the detection of shot boundaries. It basically solves the difficulties of shot boundaries detection caused by sub-window technique in video. The framework also greatly improves the accuracy of gradual transitions.