Virtual Reality Scene Construction Based on Multimodal Video Scene Segmentation Algorithm

被引:0
作者
Wang, Rui [1 ]
Jiang, Li [1 ]
Yuan, Jing [1 ]
Xu, Xinping [1 ]
Wang, Wendong [1 ]
机构
[1] Chongqing Acad Metrol & Qual Inspect, Chongqing 401120, Peoples R China
来源
PROCEEDINGS OF 2019 IEEE 8TH JOINT INTERNATIONAL INFORMATION TECHNOLOGY AND ARTIFICIAL INTELLIGENCE CONFERENCE (ITAIC 2019) | 2019年
关键词
Scene segmentation; virtual reality; ant colony algorithm; similarity fusion; multimodal;
D O I
10.1109/itaic.2019.8785474
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video scene segmentation has become one of the research hotspots in the video field because of its important role in improving retrieval accuracy, and plays a very important role in the construction of virtual scenes. In order to realize fast and accurate video scene segmentation, this paper proposes a multi-modal video scene segmentation algorithm based on ant colony algorithm. The algorithm extracts the physical features of different modes in key frames based on the idea of multi-modal feature fusion. The similarity between the same modal data and the correlation of different modal data are combined, and the similarity between different lenses is calculated. The lens similarity matrix is constructed and the ant colony algorithm is used to segment the video scene. The experimental data proves that the algorithm has a good segmentation effect on the video scene.
引用
收藏
页码:1817 / 1820
页数:4
相关论文
共 50 条
[31]   A scene segmentation algorithm combining the body and the edge of the object [J].
Ou, Xianfeng ;
Wang, Hanpu ;
Li, Wujing ;
Zhang, Guoyun ;
Chen, Siyuan .
INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (02)
[32]   A toolbox for the rapid prototyping of crime scene reconstructions in virtual reality [J].
Sieberth, Till ;
Dobay, Akos ;
Affolter, Raffael ;
Ebert, Lars .
FORENSIC SCIENCE INTERNATIONAL, 2019, 305
[33]   Virtual Reality as a Collaborative Tool for Digitalised Crime Scene Examination [J].
Rinaldi, Vincenzo ;
Hackman, Lucina ;
NicDaeid, Niamh .
EXTENDED REALITY, XR SALENTO 2022, PT I, 2022, 13445 :154-161
[34]   Forensic Science Education by Crime Scene Investigation in Virtual Reality [J].
Chen, Yen-Ru ;
Chang-Liao, You-Qi ;
Lin, Cheng-yu ;
Tsai, Deng-Ruei ;
Lim, Jia-He ;
Hong, Ruo-Huai ;
Chang, Ai-Ru .
2021 4TH IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND VIRTUAL REALITY (AIVR 2021), 2021, :205-206
[35]   Three-dimensional scene capturing for the virtual reality display [J].
Dong, Jingsheng ;
Sang, Xinzhu ;
Guo, Nan ;
Chen, Duo ;
Yan, Binbin ;
Wang, Kuiru ;
Dou, Wenhua ;
Xiao, Liquan .
HOLOGRAPHY, DIFFRACTIVE OPTICS, AND APPLICATIONS VII, 2017, 10022
[36]   Synthesizing Scene-Aware Virtual Reality Teleport Graphs [J].
Li, Changyang ;
Huang, Haikun ;
Lien, Jyh-Ming ;
Yu, Lap-Fai .
ACM TRANSACTIONS ON GRAPHICS, 2021, 40 (06)
[37]   Improving Multimodal Movie Scene Segmentation Using Mixture of Acoustic Experts [J].
Lin, Meng-Han ;
Li, Jeng-Lin ;
Lee, Chi-Chun .
2022 30TH EUROPEAN SIGNAL PROCESSING CONFERENCE (EUSIPCO 2022), 2022, :6-10
[38]   Scene segmentation based on IPCA for visual surveillance [J].
Yuan, Yuan ;
Pang, Yanwei ;
Pan, Jing ;
Li, Xuelong .
NEUROCOMPUTING, 2009, 72 (10-12) :2450-2454
[39]   Research on Rehabilitation Training Strategies Using Multimodal Virtual Scene Stimulation [J].
Xie, Ping ;
Wang, Zihao ;
Li, Zengyong ;
Wang, Ying ;
Wang, Nianwen ;
Liang, Zhenhu ;
Wang, Juan ;
Chen, Xiaoling .
FRONTIERS IN AGING NEUROSCIENCE, 2022, 14
[40]   Impact of Visual Virtual Scene and Localization Task on Auditory Distance Perception in Virtual Reality [J].
Robkopf, Sarah ;
Muehlberger, Andreas ;
Staerz, Felix ;
van de Par, Steven ;
Blau, Matthias ;
Kroczek, Leon O. H. .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2025, 31 (05) :2464-2474