An automated approach to retrieve lecture videos using context based semantic features and deep learning

被引:9
作者
POORNIMA, N. [1 ,2 ]
SALEENA, B. [1 ]
机构
[1] Vellore Inst Technol, Sch Comp Sci & Engn, Chennai, Tamil Nadu, India
[2] SRM Inst Sci & Technol, Sch Comp, Chennai, Tamil Nadu, India
来源
SADHANA-ACADEMY PROCEEDINGS IN ENGINEERING SCIENCES | 2020年 / 45卷 / 01期
关键词
Video retrieval; keyframes; clustering; deep learning; VECTOR; IMAGE;
D O I
10.1007/s12046-020-01494-z
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Video digitization is one of the emerging technologies holding significant importance over years in applications like video recording and video compression. There are different techniques available in the literature for the effective retrieval of videos. This research work presents a video retrieval scheme based on a deep learning strategy. Initially, the video archive is subjected to the keyframe extraction, for extracting useful keyframes from the video. The features extracted from the keyframes are stored in the feature database. The features are clustered using the Fuzzy C Means (FCM) algorithm. These clustered features have been provided to the deep learner for finding the optimal centroid for the incoming user query. For experimentation, the research has considered videos from different categories, and both the text query and the video query have been used for the retrieval. The experimental results demonstrate the efficiency of the proposed deep learning strategy in video retrieval and its achievement of improved values of 0.9620, 0.9682, and 0.9652 respectively for recall, precision, and F-measure.
引用
收藏
页数:11
相关论文
共 31 条
[1]   Large-Scale Video Retrieval Using Image Queries [J].
Araujo, Andre ;
Girod, Bernd .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (06) :1406-1420
[2]  
Baidya E, 2014, INT CONF CONTEMP, P37, DOI 10.1109/IC3.2014.6897144
[3]   A multimodal approach for extracting content descriptive metadata from lecture videos [J].
Balasubramanian, Vidhya ;
Doraisamy, Sooryanarayan Gobu ;
Kanakarajan, Navaneeth Kumar .
JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2016, 46 (01) :121-145
[4]   FCM - THE FUZZY C-MEANS CLUSTERING-ALGORITHM [J].
BEZDEK, JC ;
EHRLICH, R ;
FULL, W .
COMPUTERS & GEOSCIENCES, 1984, 10 (2-3) :191-203
[5]   LOOP Descriptor: Local Optimal-Oriented Pattern [J].
Chakraborti, Tapabrata ;
McCane, Brendan ;
Mills, Steven ;
Pal, Umapada .
IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (05) :635-639
[6]  
Chivadshatti P, 2015, 2015 IEEE INTERNATIONAL CONFERENCE ON INFORMATION PROCESSING (ICIP), P170, DOI 10.1109/INFOP.2015.7489372
[7]   Pattern-Based Near-Duplicate Video Retrieval and Localization on Web-Scale Videos [J].
Chou, Chien-Li ;
Chen, Hua-Tsung ;
Lee, Suh-Yin .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (03) :382-395
[8]   Latent topics-based relevance feedback for video retrieval [J].
Fernandez-Beltran, Ruben ;
Pla, Filiberto .
PATTERN RECOGNITION, 2016, 51 :72-84
[9]   Incremental probabilistic Latent Semantic Analysis for video retrieval [J].
Fernandez-Beltran, Ruben ;
Pla, Filiberto .
IMAGE AND VISION COMPUTING, 2015, 38 :1-12
[10]   On introducing timed tag-clouds in video lectures indexing [J].
Furini, Marco .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (01) :967-984