Virtual Reality Scene Construction Based on Multimodal Video Scene Segmentation Algorithm

被引:0
|
作者
Wang, Rui [1 ]
Jiang, Li [1 ]
Yuan, Jing [1 ]
Xu, Xinping [1 ]
Wang, Wendong [1 ]
机构
[1] Chongqing Acad Metrol & Qual Inspect, Chongqing 401120, Peoples R China
来源
PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019) | 2019年
关键词
Scene segmentation; virtual reality; ant colony algorithm; similarity fusion; multimodal;
D O I
10.1109/itaic.2019.8785474
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video scene segmentation has become one of the research hotspots in the video field because of its important role in improving retrieval accuracy, and plays a very important role in the construction of virtual scenes. In order to realize fast and accurate video scene segmentation, this paper proposes a multi-modal video scene segmentation algorithm based on ant colony algorithm. The algorithm extracts the physical features of different modes in key frames based on the idea of multi-modal feature fusion. The similarity between the same modal data and the correlation of different modal data are combined, and the similarity between different lenses is calculated. The lens similarity matrix is constructed and the ant colony algorithm is used to segment the video scene. The experimental data proves that the algorithm has a good segmentation effect on the video scene.
引用
收藏
页码:1817 / 1820
页数:4
相关论文
共 50 条
  • [1] Multimodal data fusion for video scene segmentation
    Parshin, V
    Paradzinets, A
    Chen, LM
    VISUAL INFORMATION AND INFORMATION SYSTEMS, 2006, 3736 : 279 - 289
  • [2] Multimodal Modeling System in Virtual Reality Scene
    Li, Chunxi
    Hou, Wenjun
    Cheng, Yiting
    ADVANCES IN MACHINERY, MATERIALS SCIENCE AND ENGINEERING APPLICATION, 2022, 24 : 375 - 386
  • [3] Construction of Virtual Turning Scene Based on Local Ray Tracing Algorithm
    王国锋
    王子良
    王太勇School of Mechanical Engineering
    Tianjin University
    Transactions of Tianjin University, 2003, (02) : 119 - 122
  • [4] Game scene construction for lower limb rehabilitation robot based on virtual reality
    Feng, Yongfei
    Jin, Di
    Shao, Qianjun
    Vladareanu, Luige
    Niu, Jianye
    Wang, Hongbo
    2020 5TH INTERNATIONAL CONFERENCE ON ELECTROMECHANICAL CONTROL TECHNOLOGY AND TRANSPORTATION (ICECTT 2020), 2020, : 74 - 78
  • [5] Scene Consistency Representation Learning for Video Scene Segmentation
    Wu, Haoqian
    Chen, Keyu
    Luo, Yanan
    Qiao, Ruizhi
    Ren, Bo
    Liu, Haozhe
    Xie, Weicheng
    Shen, Linlin
    2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2022, : 14001 - 14010
  • [6] A new multimodal deep-learning model to video scene segmentation
    Trojahn, Tiago H.
    Kishi, Rodrigo M.
    Goularte, Rudinei
    WEBMEDIA'18: PROCEEDINGS OF THE 24TH BRAZILIAN SYMPOSIUM ON MULTIMEDIA AND THE WEB, 2018, : 205 - 212
  • [7] Multimodal early fusion operators for temporal video scene segmentation tasks
    Antonio A. R. Beserra
    Rudinei Goularte
    Multimedia Tools and Applications, 2023, 82 : 31539 - 31556
  • [8] OPTIMIZED VIDEO SCENE SEGMENTATION
    Wang, Jingdong
    Tian, Xinmei
    Yang, Linjun
    Zha, Zheng-Jun
    Hua, Xian-Sheng
    2008 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-4, 2008, : 301 - +
  • [9] Multimodal early fusion operators for temporal video scene segmentation tasks
    Beserra, Antonio A. R.
    Goularte, Rudinei
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (20) : 31539 - 31556
  • [10] Hierarchical Video Data Modeling and Indexing for Virtual Scene Construction
    Wang, Huiyu
    Tong, Ruofeng
    2009 SECOND INTERNATIONAL CONFERENCE ON MACHINE VISION, PROCEEDINGS, ( ICMV 2009), 2009, : 69 - +