Fast Temporal Video Segmentation Based on Krawtchouk-Tchebichef Moments

被引:33
作者
Abdulhussain, Sadiq H. [1 ]
Al-Haddad, Syed Abdul Rahman [2 ]
Saripan, M. Iqbal [2 ]
Mahmmod, Basheera M. [1 ]
Hussien, Aseel [3 ]
机构
[1] Univ Baghdad, Dept Comp Engn, Baghdad 10071, Iraq
[2] Univ Putra Malaysia, Dept Comp & Commun Syst Engn, Selangorm 43400, Malaysia
[3] Liverpool John Moores Univ, Dept Comp Sci, Liverpool L3 3AF, Merseyside, England
关键词
TV; Feature extraction; Cameras; Histograms; Transforms; Semantics; Image edge detection; Temporal video segmentation; shot boundary detection; orthogonal polynomials; orthogonal moments; SHOT-BOUNDARY DETECTION; SCHEME; POLYNOMIALS; FEATURES; VECTOR; SIGNAL; SVD;
D O I
10.1109/ACCESS.2020.2987870
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing growth of multimedia data, the current real-world video sharing websites are being huge in repository size, more specifically video databases. This growth necessitates to look for superior techniques in processing video because video contains a lot of useful information. Temporal video segmentation (TVS) is considered essential stage in content-based video indexing and retrieval system. TVS aims to detect boundaries between successive video shots. TVS algorithm design is still challenging because most of the recent methods are unable to achieve fast and robust detection. In this regard, this paper proposes a TVS algorithm with high precision and recall values, and low computation cost for detecting different types of video transitions. The proposed algorithm is based on orthogonal moments which are considered as features to detect transitions. To increase the speed of the TVS algorithm as well as the accuracy, fast block processing and embedded orthogonal polynomial algorithms are utilized to extract features. This utilization will lead to extract multiple local features with low computational cost. Support vector machine (SVM) classifier is used to detect transitions. Specifically, the hard transitions are detected by the trained SVM model. The proposed algorithm has been evaluated on four datasets. In addition, the performance of the proposed algorithm is compared to several state-of-the-art TVS algorithms. Experimental results demonstrated that the proposed algorithm performance improvements in terms of recall, precision, and F1-score are within the ranges (1.31 - 2.58), (1.53 - 4.28), and (1.41 - 3.03), respectively. Moreover, the proposed method shows low computation cost which is 2 & x0025; of real-time.
引用
收藏
页码:72347 / 72359
页数:13
相关论文
共 59 条
[1]   A Fast Feature Extraction Algorithm for Image and Video Processing [J].
Abdulhussain, Sadiq H. ;
Ramli, Abd Rahman ;
Mahmmod, Basheera M. ;
Saripan, M. Iqbal ;
Al-Haddad, S. A. R. ;
Baker, Thar ;
Flayyih, Wameedh N. ;
Jassim, Wissam A. .
2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
[2]   Orthogonal Polynomial Embedded Image kernel [J].
Abdulhussain, Sadiq H. ;
Ramli, Abd Rahman ;
Hussain, Abir Jaafar ;
Mahmmod, Basheera M. ;
Jassim, Wissam A. .
INTERNATIONAL CONFERENCE OF INFORMATION AND COMMUNICATION TECHNOLOGY (ICICT 2019), 2019, :215-221
[3]   Shot boundary detection based on orthogonal polynomial [J].
Abdulhussain, Sadiq H. ;
Ramli, Abd Rahman ;
Mahmmod, Basheera M. ;
Saripan, M. Iqbal ;
Al-Haddad, S. A. R. ;
Jassim, Wissam A. .
MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (14) :20361-20382
[4]   A New Hybrid form of Krawtchouk and Tchebichef Polynomials: Design and Application [J].
Abdulhussain, Sadiq H. ;
Ramli, Abd Rahman ;
Mahmmod, Basheera M. ;
Saripan, M. Iqbal ;
Al-Haddad, S. A. R. ;
Jassim, Wissam A. .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2019, 61 (04) :555-570
[5]   Methods and Challenges in Shot Boundary Detection: A Review [J].
Abdulhussain, Sadiq H. ;
Ramli, Abd Rahman ;
Saripan, M. Iqbal ;
Mahmmod, Basheera M. ;
Al-Haddad, Syed Abdul Rahman ;
Jassim, Wissam A. .
ENTROPY, 2018, 20 (04)
[6]   Fast Recursive Computation of Krawtchouk Polynomials [J].
Abdulhussain, Sadiq H. ;
Ramli, Abd Rahman ;
Al-Haddad, Syed Abdul Rahman ;
Mahmmod, Basheera M. ;
Jassim, Wissam A. .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2018, 60 (03) :285-303
[7]   On Computational Aspects of Tchebichef Polynomials for Higher Polynomial Order [J].
Abdulhussan, Sadiz H. ;
Ramli, Abd Rahman ;
Al-Haddad, Syed Abdul Rahman ;
Mahmmod, Basheera M. ;
Jassim, Wissam A. .
IEEE ACCESS, 2017, 5 :2470-2478
[8]   Video Shot Boundary Detection Using QR-Decomposition and Gaussian Transition Detection [J].
Amiri, Ali ;
Fathy, Mahmood .
EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2009,
[9]  
[Anonymous], 2006, INT WORKSH MULT INF
[10]  
[Anonymous], BAGHDAD SCI J