Virtual Reality Scene Construction Based on Multimodal Video Scene Segmentation Algorithm

被引:0
作者
Wang, Rui [1 ]
Jiang, Li [1 ]
Yuan, Jing [1 ]
Xu, Xinping [1 ]
Wang, Wendong [1 ]
机构
[1] Chongqing Acad Metrol & Qual Inspect, Chongqing 401120, Peoples R China
来源
PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019) | 2019年
关键词
Scene segmentation; virtual reality; ant colony algorithm; similarity fusion; multimodal;
D O I
10.1109/itaic.2019.8785474
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video scene segmentation has become one of the research hotspots in the video field because of its important role in improving retrieval accuracy, and plays a very important role in the construction of virtual scenes. In order to realize fast and accurate video scene segmentation, this paper proposes a multi-modal video scene segmentation algorithm based on ant colony algorithm. The algorithm extracts the physical features of different modes in key frames based on the idea of multi-modal feature fusion. The similarity between the same modal data and the correlation of different modal data are combined, and the similarity between different lenses is calculated. The lens similarity matrix is constructed and the ant colony algorithm is used to segment the video scene. The experimental data proves that the algorithm has a good segmentation effect on the video scene.
引用
收藏
页码:1817 / 1820
页数:4
相关论文
共 50 条
[41]   TRANSFORMER BASED MULTIMODAL SCENE RECOGNITION IN SOCCER VIDEOS [J].
Gan, Yaozong ;
Togo, Ren ;
Ogawa, Takahiro ;
Haseyama, Miki .
2022 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (IEEE ICMEW 2022), 2022,
[42]   Classification of Emotional and Immersive Outcomes in the Context of Virtual Reality Scene Interactions [J].
Dasdemir, Yasar .
DIAGNOSTICS, 2023, 13 (22)
[43]   A virtual reality paradigm with dynamic scene stimuli for use in memory research [J].
Okada, Noah S. ;
McNeely-White, Katherine L. ;
Cleary, Anne M. ;
Carlaw, Brooke N. ;
Drane, Daniel L. ;
Parsons, Thomas D. ;
McMahan, Timothy ;
Neisser, Joseph ;
Pedersen, Nigel P. .
BEHAVIOR RESEARCH METHODS, 2024, 56 (07) :6440-6463
[44]   EntangleVR: A Visual Programming Interface for Virtual Reality Interactive Scene Generation [J].
Chen, Mengyu ;
Peljhan, Marko ;
Sra, Misha .
PROCEEDINGS OF 27TH ACM SYMPOSIUM ON VIRTUAL REALITY SOFTWARE AND TECHNOLOGY, VRST 2021, 2021,
[45]   Optimizing Scene Transitions for Sustained Narrative Immersion in Virtual Reality Films [J].
Yoon, Haein ;
Park, Jin Wan .
TEHNICKI GLASNIK-TECHNICAL JOURNAL, 2025, 19 (03) :375-381
[46]   Spherical Panoramic Photo Shooting and Virtual Reality Demonstration of a Crime Scene [J].
Bulgakov, Vladimir ;
Trushchenkov, Igor ;
Bulgakova, Elena .
CREATIVITY IN INTELLIGENT TECHNOLOGIES AND DATA SCIENCE, PT II, 2019, 1084 :217-225
[47]   Immersive animation scene design in animation language under virtual reality [J].
Xu, Chao .
SN APPLIED SCIENCES, 2023, 5 (01)
[48]   Scene Transitions and Teleportation in Virtual Reality and the Implications for Spatial Awareness and Sickness [J].
Moghadam, Kasra ;
Banigan, Colin ;
Ragan, Eric D. .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2020, 26 (06) :2273-2287
[49]   Moka: Designing a Simple Scene Graph Library for Cluster-Based Virtual Reality Systems [J].
Salvadori, Andrea ;
Brogni, Andrea ;
Mancini, Giordano ;
Barone, Vincenzo .
AUGMENTED AND VIRTUAL REALITY, AVR 2014, 2014, 8853 :333-350
[50]   A Virtual, 3D Multimodal Approach to Victim and Crime Scene Reconstruction [J].
Villa, Chiara ;
Lynnerup, Niels ;
Jacobsen, Christina .
DIAGNOSTICS, 2023, 13 (17)