A Novel Video Annotation Framework Based on Video Object

被引:2
|
作者
Li, Yang [1 ]
Lu, Jianjiang [1 ]
Zhang, Yafei [1 ]
Li, Ran [1 ]
Zhou, Bo [1 ]
机构
[1] PLA Univ Sci & Technol, Inst Command Automat, Nanjing 210007, Peoples R China
关键词
video annotation; video object; video analysis; active learning; IMAGE RETRIEVAL;
D O I
10.1109/JCAI.2009.32
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video annotation is very important for video management, such as video retrieval. Despite continuous efforts in inventing new annotation algorithms, the annotation performance is usually unsatisfactory, and the annotation vocabulary is still limited due to the use of a small scale training set. In this paper, a novel video annotation framework based on the video object is presented, named Object-Based Video Annotation. By dividing video into three types, we deal with different kind of video in different way. The first kind of video was annotated by human base on the e-Annotation architecture. The second kind of video was automatically annotated by the web mining methods. The third kind of vi eo annotated by video analysis model which detect the video object and label them at the same time. Then active learning model implement active learning method in the video database, which can add new labels and video in the database. We also present an application system based on annotations: video retrieval. At the same time we add relevance feedback in our framework to optimize the result. The system designed base on a real-world situation by including video gathered from the Internet and is designed for exploratory video retrieval system based on the internet.
引用
收藏
页码:572 / 575
页数:4
相关论文
共 50 条
  • [1] Object tracking for video annotation
    Zhang, SQ
    APPLICATIONS OF DIGITAL IMAGE PROCESSING XXVII, PTS 1AND 2, 2004, 5558 : 804 - 814
  • [2] A novel framework for robust annotation and retrieval in video sequences
    Anjulan, Arasanathan
    Canagarajah, Nishan
    IMAGE AND VIDEO RETRIEVAL, PROCEEDINGS, 2006, 4071 : 183 - 192
  • [3] Colour-based object recognition for video annotation
    Koubaroulis, D
    Matas, J
    Kittler, J
    16TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL II, PROCEEDINGS, 2002, : 1069 - 1072
  • [4] A Flexible Object-of-Interest Annotation Framework for Online Video Portals
    Sorschag, Robert
    FUTURE INTERNET, 2012, 4 (01): : 179 - 215
  • [5] Video Object Annotation, Navigation, and Composition
    Goldman, Dan B.
    Gonterman, Chris
    Curless, Brian
    Salesin, David
    Seitz, Steven M.
    UIST 2008: PROCEEDINGS OF THE 21ST ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, 2008, : 3 - 12
  • [6] Interactive Video Object Mask Annotation
    Trung-Nghia Le
    Nguyen, Tam, V
    Quoc-Cuong Tran
    Lam Nguyen
    Trung-Hieu Hoang
    Minh-Quan Le
    Minh-Triet Tran
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 16067 - 16070
  • [7] A novel framework for object-based video multiple creatorship protection
    Zhang, YQ
    Emmanuel, S
    ISPA 2005: PROCEEDINGS OF THE 4TH INTERNATIONAL SYMPOSIUM ON IMAGE AND SIGNAL PROCESSING AND ANALYSIS, 2005, : 227 - 232
  • [8] Towards a Scene-based Video Annotation Framework
    Getahun, Fekade
    Birara, Mekuanent
    2015 11TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS (SITIS), 2015, : 306 - 313
  • [9] A novel framework for semantic annotation and personalized retrieval of sports video
    Xu, Changsheng
    Wang, Jinjun
    Lu, Hanqing
    Zhang, Yifan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2008, 10 (03) : 421 - 436
  • [10] An object behavior based indexing framework for video
    Guler, S
    Rizkalla, M
    Vetter, MF
    MULTIMEDIA SYSTEMS AND APPLICATIONS II, 1999, 3845 : 438 - 445