Multimodal data visualization method for digital twin campus construction

被引:1
作者
Xie, Yakun [1 ]
Zhan, Ni [1 ]
Zhu, Qing [1 ]
Zhan, Junjie [1 ]
Guo, Zhihao [1 ]
Qiao, Changjian [2 ]
Zhu, Jun [1 ]
Xu, Bingli [3 ]
机构
[1] Southwest Jiaotong Univ, Fac Geosci & Engn, Chengdu, Peoples R China
[2] Henan Univ Econ & Law, Sch Resources & Environm, Zhengzhou, Peoples R China
[3] Army Acad Armored Forces, Dept Informat & Commun, Beijing 100072, Peoples R China
基金
中国博士后科学基金; 中国国家自然科学基金;
关键词
Digital twin; smart campus; multimodal data; visualization; real-scene 3D model; video fusion; DECISION-MAKING; INTERNET;
D O I
10.1080/17538947.2024.2431624
中图分类号
P9 [自然地理学];
学科分类号
0705 ; 070501 ;
摘要
University campuses, as distinctive yet commonplace urban environments, face similar challenges of high population density and efficient management. Integrating digital twins into smart campus construction is essential for optimizing campus management. Multimodal data integration and visualization are key to building a digital twin campus. Traditional visualization methods often lack effective inter-data relationships, limiting their capacity to support robust multimodal data integration and create a multidimensional, real-time, comprehensive management view. Therefore, this paper proposes a tailored approach for multimodal data integration and visualization in digital twin campus construction. First, a comprehensive analysis of multimodal campus data identifies spatiotemporal associations among datasets. Subsequently, visualization strategies are developed based on these data characteristics and associations, enabling the multidimensional integration of 3D models, video surveillance, and wireless sensor data. Finally, a prototype system is implemented and evaluated through a case study. The results demonstrate that the proposed method efficiently integrates 2D maps, surveillance videos, and sensor data to create a dynamic, interactive, and panoramic campus view, achieving rendering efficiency exceeding 60 frames per second. Moreover, this adaptable framework can be applied to various campus or geographic contexts, offering critical technical support for multimodal visualization in IoT and big data environments.
引用
收藏
页数:23
相关论文
共 66 条
[1]   Rendering 3D City for Smart City Digital Twin [J].
Adreani, Lorenzo ;
Colombo, Carlo ;
Fanfani, Marco ;
Nesi, Paolo ;
Pantaleo, Gianni ;
Pisanu, Riccardo .
2022 IEEE INTERNATIONAL CONFERENCE ON SMART COMPUTING (SMARTCOMP 2022), 2022, :183-185
[2]   Toward an Intelligent Campus: IoT Platform for Remote Monitoring and Control of Smart Buildings [J].
Ahmed, Mohamed A. ;
Chavez, Sebastian A. ;
Eltamaly, Ali M. ;
Garces, Hugo O. ;
Rojas, Alejandro J. ;
Kim, Young-Chon .
SENSORS, 2022, 22 (23)
[3]   Digital earth: yesterday, today, and tomorrow [J].
Annoni, Alessandro ;
Nativi, Stefano ;
Coltekin, Arzu ;
Desha, Cheryl ;
Eremchenko, Eugene ;
Gevaert, Caroline M. ;
Giuliani, Gregory ;
Chen, Min ;
Perez-Mora, Luis ;
Strobl, Joseph ;
Tumampos, Stephanie .
INTERNATIONAL JOURNAL OF DIGITAL EARTH, 2023, 16 (01) :1022-1072
[4]   Digital Twin Smart Cities for Disaster Risk Management: A Review of Evolving Concepts [J].
Ariyachandra, M. R. Mahendrini Fernando ;
Wedawatta, Gayan .
SUSTAINABILITY, 2023, 15 (15)
[5]   Efficient Procedure of Building University Campus Models for Digital Twin Simulation [J].
Azfar, Talha ;
Weidner, Jeffrey ;
Raheem, Adeeba ;
Ke, Ruimin ;
Cheu, Ruey Long .
IEEE JOURNAL OF RADIO FREQUENCY IDENTIFICATION, 2022, 6 :769-773
[6]   A unified theory of urban living [J].
Bettencourt, Luis ;
West, Geoffrey .
NATURE, 2010, 467 (7318) :912-913
[7]   What can scatterplots teach us about doing data science better? [J].
Bin Goh, Wilson Wen ;
Foo, Reuben Jyong Kiat ;
Wong, Limsoon .
INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2024, 17 (01) :111-125
[8]   Data visualization literacy: Definitions, conceptual frameworks, exercises, and assessments [J].
Boerner, Katy ;
Bueckle, Andreas ;
Ginda, Michael .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2019, 116 (06) :1857-1864
[9]   Assessment of the Ecological Footprint of Eskisehir Technical University-Iki Eylul Campus [J].
Cetin, Mehmet ;
Agacsapan, Balca ;
Cabuk, Saye Nihan ;
Senyel Kurkcuoglu, Muzeyyen Anil ;
Isik Pekkan, Ozge ;
Baran Argun, Ebru ;
Dabanli, Ahmet ;
Kucukpehlivan, Tuncay ;
Yilmazel, Burcu ;
Cabuk, Alper .
JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2021, 49 (10) :2311-2327
[10]   Visualization of Environmental Sensing Data in the Lake-Oriented Digital Twin World: Poyang Lake as an Example [J].
Chen, Hao ;
Fang, Chaoyang ;
Xiao, Xin .
REMOTE SENSING, 2023, 15 (05)