Fast Temporal Video Segmentation Based on Krawtchouk-Tchebichef Moments

被引:33
作者
Abdulhussain, Sadiq H. [1 ]
Al-Haddad, Syed Abdul Rahman [2 ]
Saripan, M. Iqbal [2 ]
Mahmmod, Basheera M. [1 ]
Hussien, Aseel [3 ]
机构
[1] Univ Baghdad, Dept Comp Engn, Baghdad 10071, Iraq
[2] Univ Putra Malaysia, Dept Comp & Commun Syst Engn, Selangorm 43400, Malaysia
[3] Liverpool John Moores Univ, Dept Comp Sci, Liverpool L3 3AF, Merseyside, England
关键词
TV; Feature extraction; Cameras; Histograms; Transforms; Semantics; Image edge detection; Temporal video segmentation; shot boundary detection; orthogonal polynomials; orthogonal moments; SHOT-BOUNDARY DETECTION; SCHEME; POLYNOMIALS; FEATURES; VECTOR; SIGNAL; SVD;
D O I
10.1109/ACCESS.2020.2987870
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increasing growth of multimedia data, the current real-world video sharing websites are being huge in repository size, more specifically video databases. This growth necessitates to look for superior techniques in processing video because video contains a lot of useful information. Temporal video segmentation (TVS) is considered essential stage in content-based video indexing and retrieval system. TVS aims to detect boundaries between successive video shots. TVS algorithm design is still challenging because most of the recent methods are unable to achieve fast and robust detection. In this regard, this paper proposes a TVS algorithm with high precision and recall values, and low computation cost for detecting different types of video transitions. The proposed algorithm is based on orthogonal moments which are considered as features to detect transitions. To increase the speed of the TVS algorithm as well as the accuracy, fast block processing and embedded orthogonal polynomial algorithms are utilized to extract features. This utilization will lead to extract multiple local features with low computational cost. Support vector machine (SVM) classifier is used to detect transitions. Specifically, the hard transitions are detected by the trained SVM model. The proposed algorithm has been evaluated on four datasets. In addition, the performance of the proposed algorithm is compared to several state-of-the-art TVS algorithms. Experimental results demonstrated that the proposed algorithm performance improvements in terms of recall, precision, and F1-score are within the ranges (1.31 - 2.58), (1.53 - 4.28), and (1.41 - 3.03), respectively. Moreover, the proposed method shows low computation cost which is 2 & x0025; of real-time.
引用
收藏
页码:72347 / 72359
页数:13
相关论文
共 59 条
  • [1] A Fast Feature Extraction Algorithm for Image and Video Processing
    Abdulhussain, Sadiq H.
    Ramli, Abd Rahman
    Mahmmod, Basheera M.
    Saripan, M. Iqbal
    Al-Haddad, S. A. R.
    Baker, Thar
    Flayyih, Wameedh N.
    Jassim, Wissam A.
    [J]. 2019 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2019,
  • [2] Orthogonal Polynomial Embedded Image kernel
    Abdulhussain, Sadiq H.
    Ramli, Abd Rahman
    Hussain, Abir Jaafar
    Mahmmod, Basheera M.
    Jassim, Wissam A.
    [J]. INTERNATIONAL CONFERENCE OF INFORMATION AND COMMUNICATION TECHNOLOGY (ICICT 2019), 2019, : 215 - 221
  • [3] Shot boundary detection based on orthogonal polynomial
    Abdulhussain, Sadiq H.
    Ramli, Abd Rahman
    Mahmmod, Basheera M.
    Saripan, M. Iqbal
    Al-Haddad, S. A. R.
    Jassim, Wissam A.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2019, 78 (14) : 20361 - 20382
  • [4] A New Hybrid form of Krawtchouk and Tchebichef Polynomials: Design and Application
    Abdulhussain, Sadiq H.
    Ramli, Abd Rahman
    Mahmmod, Basheera M.
    Saripan, M. Iqbal
    Al-Haddad, S. A. R.
    Jassim, Wissam A.
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2019, 61 (04) : 555 - 570
  • [5] Methods and Challenges in Shot Boundary Detection: A Review
    Abdulhussain, Sadiq H.
    Ramli, Abd Rahman
    Saripan, M. Iqbal
    Mahmmod, Basheera M.
    Al-Haddad, Syed Abdul Rahman
    Jassim, Wissam A.
    [J]. ENTROPY, 2018, 20 (04)
  • [6] Fast Recursive Computation of Krawtchouk Polynomials
    Abdulhussain, Sadiq H.
    Ramli, Abd Rahman
    Al-Haddad, Syed Abdul Rahman
    Mahmmod, Basheera M.
    Jassim, Wissam A.
    [J]. JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2018, 60 (03) : 285 - 303
  • [7] On Computational Aspects of Tchebichef Polynomials for Higher Polynomial Order
    Abdulhussan, Sadiz H.
    Ramli, Abd Rahman
    Al-Haddad, Syed Abdul Rahman
    Mahmmod, Basheera M.
    Jassim, Wissam A.
    [J]. IEEE ACCESS, 2017, 5 : 2470 - 2478
  • [8] Video Shot Boundary Detection Using QR-Decomposition and Gaussian Transition Detection
    Amiri, Ali
    Fathy, Mahmood
    [J]. EURASIP JOURNAL ON ADVANCES IN SIGNAL PROCESSING, 2009,
  • [9] [Anonymous], 2006, INT WORKSH MULT INF
  • [10] [Anonymous], BAGHDAD SCI J