Exploring User Engagement in Museum Scenario with EEG-A Case Study in MAV Craftsmanship Museum in Valle d'Aosta Region, Italy

被引:5
作者
Castiblanco Jimenez, Ivonne Angelica [1 ]
Nonis, Francesca [1 ]
Olivetti, Elena Carlotta [1 ]
Ulrich, Luca [1 ]
Moos, Sandro [1 ]
Monaci, Maria Grazia [2 ]
Marcolin, Federica [1 ]
Vezzetti, Enrico [1 ]
机构
[1] Politecn Torino, Dept Management & Prod Engn, I-10129 Turin, Italy
[2] Univ Valle Aosta, Dept Social Sci, I-11100 Aosta, Italy
关键词
Virtual Reality; EEG; user engagement; XGBoost; cultural heritage; craftsmanship; ADAPTIVE AUTOMATION SYSTEM; VIRTUAL-REALITY; TASK ENGAGEMENT; EMOTION; MEMORY; THETA; RECOGNITION; ATTENTION; INDEXES;
D O I
10.3390/electronics12183810
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the last decade, museums and exhibitions have benefited from the advances in Virtual Reality technologies to create complementary virtual elements to the traditional visit. The aim is to make the collections more engaging, interactive, comprehensible and accessible. Also, the studies regarding users' and visitors' engagement suggest that the real affective state cannot be fully assessed with self-assessment techniques and that other physiological techniques, such as EEG, should be adopted to gain a more unbiased and mature understanding of their feelings. With the aim of contributing to bridging this knowledge gap, this work proposes to adopt literature EEG-based indicators (valence, arousal, engagement) to analyze the affective state of 95 visitors interacting physically or virtually (in a VR environment) with five handicraft objects belonging to the permanent collection of the Museo dell'Artigianato Valdostano di Tradizione, which is a traditional craftsmanship museum in the Valle d'Aosta region. Extreme Gradient Boosting (XGBoost) was adopted to classify the obtained engagement measures, which were labeled according to questionnaire replies. EEG analysis played a fundamental role in understanding the cognitive and emotional processes underlying immersive experiences, highlighting the potential of VR technologies in enhancing participants' cognitive engagement. The results indicate that EEG-based indicators have common trends with self-assessment, suggesting that their use as 'the ground truth of emotion' is a viable option.
引用
收藏
页数:27
相关论文
共 91 条
[1]  
Abbattista F., 2018, P AVI CH 2018 WORKSH
[2]  
Abdelrahman Y., 2015, Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct - MobileHCI'15, P838, DOI [DOI 10.1145/2786567.2793709, 10.1145/2786567.2793709]
[3]   Emotion and memory: A recognition advantage for positive and negative words independent of arousal [J].
Adelman, James S. ;
Estes, Zachary .
COGNITION, 2013, 129 (03) :530-535
[4]   Human anterior and frontal midline theta and lower alpha reflect emotionally positive state and internalized attention: high-resolution EEG investigation of meditation [J].
Aftanas, LI ;
Golocheikine, SA .
NEUROSCIENCE LETTERS, 2001, 310 (01) :57-60
[5]   Emotions Recognition Using EEG Signals: A Survey [J].
Alarcao, Soraia M. ;
Fonseca, Manuel J. .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2019, 10 (03) :374-393
[6]   Music induced emotion using wavelet packet decomposition-An EEG study [J].
Balasubramanian, Geethanjali ;
Kanagasabai, Adalarasu ;
Mohan, Jagannath ;
Seshadri, N. P. Guhan .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2018, 42 :115-128
[7]   Immersion and emotion:: Their impact on the sense of presence [J].
Baños, RM ;
Botella, C ;
Alcañiz, M ;
Liaño, V ;
Guerrero, B ;
Rey, B .
CYBERPSYCHOLOGY & BEHAVIOR, 2004, 7 (06) :734-741
[8]   An Emotional Roller Coaster: Electrophysiological Evidence of Emotional Engagement during a Roller-Coaster Ride with Virtual Reality Add-On [J].
Bastiaansen, Marcel ;
Oosterholt, Monique ;
Mitas, Ondrej ;
Han, Danny ;
Lub, Xander .
JOURNAL OF HOSPITALITY & TOURISM RESEARCH, 2022, 46 (01) :29-54
[9]   Emotion Recognition Based on High-Resolution EEG Recordings and Reconstructed Brain Sources [J].
Becker, Hanna ;
Fleureau, Julien ;
Guillotel, Philippe ;
Wendling, Fabrice ;
Merlet, Isabelle ;
Albera, Laurent .
IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2020, 11 (02) :244-257
[10]   Human brain EEG indices of emotions: Delineating responses to affective vocalizations by measuring frontal theta event-related synchronization [J].
Bekkedal, Marni Y. V. ;
Rossi, John, III ;
Panksepp, Jaak .
NEUROSCIENCE AND BIOBEHAVIORAL REVIEWS, 2011, 35 (09) :1959-1970