Total VREcall: Using Biosignals to Recognize Emotional Autobiographical Memory in Virtual Reality

被引:6
作者
Gupta, Kunal [1 ]
Chan, Sam W. T. [1 ]
Pai, Yun Suen [2 ]
Strachan, Nicholas [1 ]
Su, John [1 ]
Sumich, Alexander [3 ]
Nanayakkara, Suranga [4 ]
Billinghurst, Mark [1 ]
机构
[1] Univ Auckland, 70 Symonds St, Auckland 1011, New Zealand
[2] Keio Univ, Grad Sch Media Design, Kohoku Ward, 4 Chome 1-1 Hiyoshi, Yokohama, Kanagawa, Japan
[3] Nottingham Trent Univ, Nottingham, England
[4] Natl Univ Singapore, 21 Lower Kent Ridge Rd, Singapore, Singapore
来源
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT | 2022年 / 6卷 / 02期
关键词
Autobiographical Memory; Virtual Reality; Physiological Signals; Eye-tracking; Electrodermal Activity; Biosignals; Emotion; Memory; PHENOMENAL CHARACTERISTICS; PHENOMENOLOGICAL CHARACTERISTICS; EVENTS; RETRIEVAL; VALENCE; AROUSAL; YOUNGER; RECALL; STATE; OLDER;
D O I
10.1145/3534615
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Our memories and past experiences contribute to guiding our perception and action of future affective experiences. Virtual Reality (VR) experiences are more vividly memorized and recalled than non-VR ones, but there is little research on how to detect this recall in VR. We investigate the feasibility of recognizing autobiographical memory (AM) recall in VR using physiological cues: skin conductance, heart-rate variability, eye gaze, and pupillary response. We devised a methodology replicating an existing AM Test in VR. We conducted a user study with 20 participants recalling AM using three valence categories cue words: positive, negative, and neutral. We found a significant effect of AM recalls on EDA peak, and eye blink rate, with a generalized recognition accuracy of 77.1% and person dependent accuracy of up to 95.1%. This shows a promising approach for detecting AM recall in VR and we discuss the implications for VR experience design.
引用
收藏
页数:21
相关论文
共 88 条
[1]   Auditory Cues Increase the Hippocampal Response to Unimodal Virtual Reality [J].
Andreano, Joseph ;
Liang, Kevin ;
Kong, Lingjun ;
Hubbard, David ;
Wiederhold, Brenda K. ;
Wiederhold, Mark D. .
CYBERPSYCHOLOGY & BEHAVIOR, 2009, 12 (03) :309-313
[2]   Tunnel memories for autobiographical events: Central details are remembered more frequently from shocking than from happy experiences [J].
Berntsen, D .
MEMORY & COGNITION, 2002, 30 (07) :1010-1020
[3]   A Review, Current Challenges, and Future Possibilities on Emotion Recognition Using Machine Learning and Physiological Signals [J].
Bota, Patricia J. ;
Wang, Chen ;
Fred, Ana L. N. ;
da Silva, Hugo Placido .
IEEE ACCESS, 2019, 7 :140990-141020
[4]   MEASURING EMOTION - THE SELF-ASSESSMENT MANNEQUIN AND THE SEMANTIC DIFFERENTIAL [J].
BRADLEY, MM ;
LANG, PJ .
JOURNAL OF BEHAVIOR THERAPY AND EXPERIMENTAL PSYCHIATRY, 1994, 25 (01) :49-59
[5]   Improving autobiographical memory in Alzheimer's disease by transcranial alternating current stimulation [J].
Brechet, Lucie ;
Michel, Christoph M. ;
Schacter, Daniel L. ;
Pascual-Leone, Alvaro .
CURRENT OPINION IN BEHAVIORAL SCIENCES, 2021, 40 :64-71
[6]  
BREWER WF, 1994, AUTOBIOGRAPHICAL MEMORY AND THE VALIDITY OF RETROSPECTIVE REPORTS, P11
[7]   Brain activity during episodic retrieval of autobiographical and laboratory events: An fMRI study using a novel photo paradigm [J].
Cabeza, R ;
Prince, SE ;
Daselaar, SM ;
Greenberg, DL ;
Budde, M ;
Dolcos, F ;
LaBar, KS ;
Rubin, DC .
JOURNAL OF COGNITIVE NEUROSCIENCE, 2004, 16 (09) :1583-1594
[8]   Functional neuroimaging of autobiographical memory [J].
Cabeza, Roberto ;
St Jacques, Peggy .
TRENDS IN COGNITIVE SCIENCES, 2007, 11 (05) :219-227
[9]   A novel demonstration of enhanced memory associated with emotional arousal [J].
Cahill, L ;
McGaugh, JL .
CONSCIOUSNESS AND COGNITION, 1995, 4 (04) :410-421
[10]  
Chan S. W. T., 2022, THESIS U AUCKLAND AU