A Multimodal Data Model for Simulation-Based Learning with Va.Si.Li-Lab

被引：7

作者：

Mehler, Alexander ^{[1
]}

Bagci, Mevlut ^{[1
]}

Henlein, Alexander ^{[1
]}

Abrami, Giuseppe ^{[1
]}

Spiekermann, Christian ^{[1
]}

Schrottenbacher, Patrick ^{[1
]}

Konca, Maxim ^{[1
]}

Luecking, Andy ^{[1
]}

Engel, Juliane ^{[1
]}

Quintino, Marc ^{[1
]}

Schreiber, Jakob ^{[1
]}

Saukel, Kevin ^{[1
]}

Zlatkin-Troitschanskaia, Olga ^{[2
]}

机构：

[1] Goethe Univ Frankfurt M, Frankfurt, Germany

[2] Johannes Gutenberg Univ Mainz, Mainz, Germany

来源：

DIGITAL HUMAN MODELING AND APPLICATIONS IN HEALTH, SAFETY, ERGONOMICS AND RISK MANAGEMENT, DHM 2023, PT I | 2023年 / 14028卷

关键词：

multimodal learning; simulation-based learning; distributed multiple documents; critical online reasoning; visual communication; Va.Si.Li-Lab; DIRECTED HYPERGRAPHS; EDUCATION; ALIGNMENT;

D O I：

10.1007/978-3-031-35741-1_39

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

Simulation-based learning is a method in which learners learn to master real-life scenarios and tasks from simulated application contexts. It is particularly suitable for the use of VR technologies, as these allow immersive experiences of the targeted scenarios. VR methods are also relevant for studies on online learning, especially in groups, as they provide access to a variety of multimodal learning and interaction data. However, VR leads to a trade-off between technological conditions of the observability of such data and the openness of learner behavior. We present Va.Si.Li-Lab, a VR-Lab for Simulation-based Learning developed to address this trade-off. Va.Si.Li-Lab uses a graph-theoretical model based on hypergraphs to represent the data diversity of multimodal learning and interaction. We develop this data model in relation to mono- and multimodal, intra- and interpersonal data and interleave it with ISO-Space to describe distributed multiple documents from the perspective of their interactive generation. The paper adds three use cases to motivate the broad applicability of Va.Si.Li-Lab and its data model.

引用

页码：539 / 565

页数：27

共 89 条

[1]

Abrami Giuseppe, 2020, HT '20: Proceedings of the 31st ACM Conference on Hypertext and Social Media, P177, DOI 10.1145/3372923.3404791

[2] Hypernetwork science via high-order hypergraph walks [J].

Aksoy, Sinan G. ;

Joslyn, Cliff ;

Marrero, Carlos Ortiz ;

Praggastis, Brenda ;

Purvine, Emilie .

EPJ DATA SCIENCE, 2020, 9 (01)

[3] NO MORE CASEBOOKS: USING SIMULATION-BASED LEARNING TO EDUCATE FUTURE FAMILY LAW PRACTITIONERS [J].

Apel, Susan B. .

FAMILY COURT REVIEW, 2011, 49 (04) :700-710

[4]

Atkinson R. C., 1968, Psychology of learning and motivation, V2, P89, DOI [10.1016/S0079-7421(08)60422-3, 10.1016/S0079-7421, DOI 10.1016/S0079-7421, DOI 10.1016/S0079-7421(08)60422-3]

[5] Directed hypergraphs: Introduction and fundamental algorithms-A survey [J].