Local directional coding-based scene change detection for frame rate up-conversion

被引:0
作者
Lee, Ho Sub [1 ]
Cho, Sung In [2 ]
机构
[1] Daegu Univ, Dept Elect & Elect Engn, Gyeonsan 38453, South Korea
[2] Dongguk Univ, Dept Multimedia Engn, Seoul 04620, South Korea
关键词
Frame rate up-conversion; Scene change detection; Local directional coding; Motion estimation; SCROLLING-TEXT DETECTION; MOTION ESTIMATION;
D O I
10.1016/j.dsp.2022.103501
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper proposes a new scene change detection method that uses local directional coding for frame rate up-conversion. The directional coding technique converts the luminance value of the edge direction response for given frames to bit codes and calculates the bit code difference between the previous and current frames. Existing scene change detection methods usually calculate the difference between the histogram shapes or the luminance values between the previous and current frames to detect scene changes. Thus, they erroneously detect scene changes in a scene with moving objects or camera motion. The existing automatic thresholding-based method uses iterative operations to calculate the optimal threshold and determine the scene change using the difference between the calculated threshold values, and it therefore has a high computational cost. To solve these problems, the proposed method uses the difference between the bit codes from the eight edge response values between the previous and current frames to detect the initial scene change regions. In addition, the proposed method uses a refinement process on the detected initial scene change regions to enhance the scene change detection accuracy. The experimental results showed that the proposed method enhanced average F1 score to 0.5235 (a 126.36 % improvement) as compared with the benchmark methods. The average computation time per pixel of the proposed method also reduced to 13.3668 mu s (an 87.39 % reduction) compared with the benchmark methods.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页数:13
相关论文
共 34 条
[1]  
[Anonymous], 2002, D LIB MAG
[2]  
[Anonymous], 2001, TREC VIDEO RETRIEVAL
[3]  
Bae G. J., 2017, J REAL-TIME IMAGE PR, V13, P1
[4]   A survey on the automatic indexing of video data [J].
Brunelli, R ;
Mich, O ;
Modena, CM .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 1999, 10 (02) :78-112
[5]   Histogram Shape-Based Scene-Change Detection Algorithm [J].
Cho, Sung In ;
Kang, Suk-Ju .
IEEE ACCESS, 2019, 7 :27662-27667
[6]   Frame rate up-conversion using perspective transform [J].
Choi, Byeong-Doo ;
Han, Jong-Woo ;
Kim, Chang-Su ;
Ko, Sung-Jea .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2006, 52 (03) :975-982
[7]   Adaptive group-of-pictures and scene change detection methods based on existing H.264 advanced video coding information [J].
Ding, J. -R. ;
Yang, J. -F .
IET IMAGE PROCESSING, 2008, 2 (02) :85-94
[8]  
Fukuchi K, 2009, IEEE INT CON MULTI, P638, DOI 10.1109/ICME.2009.5202577
[9]  
Greisen P., 2012, PROC EUROGRAPHICS C, P57
[10]   Efficient Hierarchical Graph-Based Video Segmentation [J].
Grundmann, Matthias ;
Kwatra, Vivek ;
Han, Mei ;
Essa, Irfan .
2010 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2010, :2141-2148