Neurophysiological methods for monitoring brain activity in serious games and virtual environments: a review

被引:29
作者
Ninaus, Manuel [1 ]
Kober, Silvia Erika [1 ]
Friedrich, Elisabeth V. C. [1 ]
Dunwell, Ian [2 ]
de Freitas, Sara [2 ]
Arnab, Sylvester [2 ]
Ott, Michela [3 ]
Kravick, Milos [4 ]
Lim, Theodore [5 ]
Louchart, Sandy [6 ]
Bellotti, Francesco [7 ]
Hannemann, Anna [4 ]
Thin, Alasdair G. [8 ]
Berta, Riccardo [7 ]
Wood, Guilherme [1 ]
Neuper, Christa [1 ]
机构
[1] Karl Franzens Univ Graz, Dept Psychol, Sect Neuropsychol, Univ Pl 2-3, A-8010 Graz, Austria
[2] Coventry Univ, Serious Games Inst, Coventry CV1 2TL, W Midlands, England
[3] CNR, ITD, I-16149 Genoa, Italy
[4] Rhein Westfal TH Aachen, Informat Informat Syst 5, D-52056 Aachen, Germany
[5] Heriot Watt Univ, Sch Engn & Phys Sci, Dept Mech Engn, Edinburgh EH14 4AS, Midlothian, Scotland
[6] Heriot Watt Univ, Sch Math & Comp Sci, Dept Comp Sci, Edinburgh EH14 4AS, Midlothian, Scotland
[7] Univ Genoa, ELIOS Lab, Dept Naval Elect Elect & Telecommun Engn DITEN, I-16145 Genoa, Italy
[8] Heriot Watt Univ, Sch Life Sci, Edinburgh EH14 4AS, Midlothian, Scotland
关键词
neurophysiological methods; brain; serious games; games; virtual environments; virtual reality; NIRS; near infrared spectroscopy; EEG; electroencephalography; fMRI; functional magnetic resonance imaging; neuroscience; learning; game-based learning;
D O I
10.1504/IJTEL.2014.060022
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
The use of serious games and virtual environments for learning is increasing worldwide. These technologies have the potential to collect live data from users through game play and can be combined with neuroscientific methods such as EEG, fNIRS and fMRI. The several learning processes triggered by serious games are associated with specific patterns of activation that distributed in time and space over different neural networks. This paper explores the opportunities offered and challenges posed by neuroscientific methods when capturing user feedback and using the data to create greater user adaptivity in game. Existing neuroscientific studies examining cortical correlates of game-based learning do not form a common or homogenous field. In contrast, they often have disparate research questions and are represented through a broad range of study designs and game genres. In this paper, the range of studies and applications of neuroscientific methods in game-based learning are reviewed.
引用
收藏
页码:78 / 103
页数:26
相关论文
共 102 条
[1]   Workload assessment of computer gaming using a single-stimulus event-related potential paradigm [J].
Allison, Brendan Z. ;
Polich, John .
BIOLOGICAL PSYCHOLOGY, 2008, 77 (03) :277-283
[2]  
Arnab S., 2010, IADIS INT C WEB VIRT
[3]   Can Training in a Real-Time Strategy Video Game Attenuate Cognitive Decline in Older Adults? [J].
Basak, Chandramallika ;
Boot, Walter R. ;
Voss, Michelle W. ;
Kramer, Arthur F. .
PSYCHOLOGY AND AGING, 2008, 23 (04) :765-777
[4]   Neural correlate of spatial presence in an arousing and noninteractive virtual reality:: An EEG and psychophysiology study [J].
Baumgartner, T ;
Valko, L ;
Esslen, M ;
Jäncke, L .
CYBERPSYCHOLOGY & BEHAVIOR, 2006, 9 (01) :30-45
[5]   Feeling present in arousing virtual reality worlds: prefrontal brain regions differentially orchestrate presence experience in adults and children [J].
Baumgartner, Thomas ;
Speck, Dominique ;
Wettstein, Denise ;
Masnari, Ornella ;
Beeli, Gian ;
Jancke, Lutz .
FRONTIERS IN HUMAN NEUROSCIENCE, 2008, 2
[6]   Designing Effective Serious Games: Opportunities and Challenges for Research [J].
Bellotti, F. ;
Berta, R. ;
De Gloria, A. .
INTERNATIONAL JOURNAL OF EMERGING TECHNOLOGIES IN LEARNING, 2010, 5 :22-35
[7]   Listening to rhythms activates motor and premotor cortices [J].
Bengtsson, Sara L. ;
Ullen, Fredrik ;
Ehrsson, H. Henrik ;
Hashimoto, Toshihiro ;
Kito, Tomonori ;
Naito, Eiichi ;
Forssberg, Hans ;
Sadato, Norihiro .
CORTEX, 2009, 45 (01) :62-71
[8]   Electroencephalogram and Physiological Signal Analysis for Assessing Flow in Games [J].
Berta, Riccardo ;
Bellotti, Francesco ;
De Gloria, Alessandro ;
Pranantha, Danu ;
Schatten, Carlotta .
IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES, 2013, 5 (02) :164-175
[9]   The effects of video game playing on attention, memory, and executive control [J].
Boot, Walter R. ;
Kramer, Arthur F. ;
Simons, Daniel J. ;
Fabiani, Monica ;
Gratton, Gabriele .
ACTA PSYCHOLOGICA, 2008, 129 (03) :387-398
[10]   How to see what you are looking for in fMRI and PET - or the crucial baseline condition [J].
Brandt, T .
JOURNAL OF NEUROLOGY, 2006, 253 (05) :551-555