Virtual Reality Scene Construction Based on Multimodal Video Scene Segmentation Algorithm

被引:0
|
作者
Wang, Rui [1 ]
Jiang, Li [1 ]
Yuan, Jing [1 ]
Xu, Xinping [1 ]
Wang, Wendong [1 ]
机构
[1] Chongqing Acad Metrol & Qual Inspect, Chongqing 401120, Peoples R China
来源
PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019) | 2019年
关键词
Scene segmentation; virtual reality; ant colony algorithm; similarity fusion; multimodal;
D O I
10.1109/itaic.2019.8785474
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video scene segmentation has become one of the research hotspots in the video field because of its important role in improving retrieval accuracy, and plays a very important role in the construction of virtual scenes. In order to realize fast and accurate video scene segmentation, this paper proposes a multi-modal video scene segmentation algorithm based on ant colony algorithm. The algorithm extracts the physical features of different modes in key frames based on the idea of multi-modal feature fusion. The similarity between the same modal data and the correlation of different modal data are combined, and the similarity between different lenses is calculated. The lens similarity matrix is constructed and the ant colony algorithm is used to segment the video scene. The experimental data proves that the algorithm has a good segmentation effect on the video scene.
引用
收藏
页码:1817 / 1820
页数:4
相关论文
共 50 条
  • [41] Applying virtual reality in forensics - a virtual scene walkthrough
    Sieberth, Till
    Dobay, Akos
    Affolter, Raffael
    Ebert, Lars C.
    FORENSIC SCIENCE MEDICINE AND PATHOLOGY, 2019, 15 (01) : 41 - 47
  • [42] Real-scene-constrained virtual scene layout synthesis for mixed reality
    Fan, Runze
    Wang, Lili
    Liu, Xinda
    Im, Sio Kei
    Lam, Chan Tong
    VISUAL COMPUTER, 2024, 40 (09): : 6319 - 6339
  • [43] Normalized Cut Based Coherence Measure Construction for Scene Segmentation
    Zhang, Xiaoqin
    Zeng, Xianglin
    Hu, Weiming
    Li, Wanqing
    ADVANCES IN MULTIMEDIA INFORMATION PROCESSING - PCM 2009, 2009, 5879 : 1099 - 1105
  • [44] MFVC: Urban Traffic Scene Video Caption Based on Multimodal Fusion
    Li, Mingxing
    Zhang, Hao
    Xu, Cheng
    Yan, Chenyang
    Liu, Hongzhe
    Li, Xuewei
    ELECTRONICS, 2022, 11 (19)
  • [45] A general framework for temporal video scene segmentation
    Zhai, Y
    Shah, M
    TENTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS 1 AND 2, PROCEEDINGS, 2005, : 1111 - 1116
  • [46] Multi-Modality Video Scene Segmentation Algorithm with Shot Force Competition
    Xiang, Yun-zhu
    APPLIED SCIENCE, MATERIALS SCIENCE AND INFORMATION TECHNOLOGIES IN INDUSTRY, 2014, 513-517 : 514 - 517
  • [47] A Simulation System for Scene Synthesis in Virtual Reality
    Liu, Jingyu
    Mantel, Claire
    Schweiger, Florian
    Forchhammer, Soren
    VIRTUAL REALITY AND MIXED REALITY, 2021, 13105 : 67 - 84
  • [48] Audio scene segmentation for video with generic content
    Niu, Feng
    Goela, Naveen
    Divakaran, Ajay
    Abdel-Mottaleb, Mohamed
    MULTIMEDIA CONTENT ACCESS: ALGORITHMS AND SYSTEMS II, 2008, 6820
  • [49] Virtual reality puts jury in crime scene
    Hamzelou, Jessica
    NEW SCIENTIST, 2015, 225 (3003) : 12 - 12
  • [50] Scene construction of nano particle system based on virtual technology
    Yang, Han
    Jia, Chongzhong
    Xie, Jifeng
    Wang, Kun
    Hao, Xiaoling
    CONCURRENT ENGINEERING-RESEARCH AND APPLICATIONS, 2022, 30 (02): : 135 - 147