Detection of Stroke-Induced Visual Neglect and Target Response Prediction Using Augmented Reality and Electroencephalography

被引:6
作者
Mak, Jennifer [1 ]
Kocanaogullari, Deniz [2 ]
Huang, Xiaofei [3 ]
Kersey, Jessica [4 ]
Shih, Minmei [5 ]
Grattan, Emily S. [5 ]
Skidmore, Elizabeth R. [5 ]
Wittenberg, George F. [6 ]
Ostadabbas, Sarah [3 ]
Akcakaya, Murat [2 ]
机构
[1] Univ Pittsburgh, Dept Bioengn, Rehab Neural Engn Labs, Pittsburgh, PA 15213 USA
[2] Univ Pittsburgh, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[3] Northeastern Univ, Dept Elect & Comp Engn, Boston, MA 02115 USA
[4] Univ Illinois, Dept Occupat Therapy, Chicago, IL 60612 USA
[5] Univ Pittsburgh, Dept Occupat Therapy, Pittsburgh, PA 15219 USA
[6] Univ Pittsburgh, Dept Neurol, Rehab Neural Engn Labs, Pittsburgh, PA 15213 USA
基金
美国国家科学基金会;
关键词
Electroencephalography; Visualization; Stroke (medical condition); Feature extraction; Delays; Wireless sensor networks; Wireless communication; Spatial neglect; stroke; augmented reality; EEG; machine learning; BRAIN-COMPUTER-INTERFACE; SPATIAL NEGLECT; HEMISPATIAL NEGLECT; COGNITIVE DEFICITS; UNILATERAL NEGLECT; ATTENTION; EEG; HEMISPHERE; POWER; NETWORKS;
D O I
10.1109/TNSRE.2022.3188184
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
We aim to build a system incorporating electroencephalography (EEG) and augmented reality (AR) that is capable of identifying the presence of visual spatial neglect (SN) and mapping the estimated neglected visual field. An EEG-based brain-computer interface (BCI) was used to identify those spatiospectral features that best detect participants with SN among stroke survivors using their EEG responses to ipsilesional and contralesional visual stimuli. Frontal-central delta and alpha, frontal-parietal theta, Fp1 beta, and left frontal gamma were found to be important features for neglect detection. Additionally, temporal analysis of the responses shows that the proposed model is accurate in detecting potentially neglected targets. These targets were predicted using common spatial patterns as the feature extraction algorithm and regularized discriminant analysis combined with kernel density estimation for classification. With our preliminary results, our system shows promise for reliably detecting the presence of SN and predicting visual target responses in stroke patients with SN.
引用
收藏
页码:1840 / 1850
页数:11
相关论文
共 5 条
  • [1] Concealed Target Detection Using Augmented Reality with SIRE Radar
    Saponaro, Philip
    Kambhamettu, Chandra
    Ranney, Kenneth
    Sullivan, Anders
    RADAR SENSOR TECHNOLOGY XVII, 2013, 8714
  • [2] Measuring workload effects of augmented reality head-up displays using detection response task
    Maag, Christian
    Schoemig, Nadja
    Naujoks, Frederik
    Karl, Ines
    Keinath, Andreas
    Neukum, Alexandra
    TRANSPORTATION RESEARCH PART F-TRAFFIC PSYCHOLOGY AND BEHAVIOUR, 2023, 92 : 201 - 219
  • [3] Exploring the Visual Space to Improve Depth Perception in Robot Teleoperation Using Augmented Reality: The Role of Distance and Target's Pose in Time, Success, and Certainty
    Arboleda, Stephanie Arevalo
    Dierks, Tim
    Ruecker, Franziska
    Gerken, Jens
    HUMAN-COMPUTER INTERACTION, INTERACT 2021, PT I, 2021, 12932 : 522 - 543
  • [4] Inclusive Adaptation of Existing Board Games for Gamers with and without Visual Impairments using a Spatial Augmented Reality Framework for Touch Detection and Audio Feedback
    Thevin D.-I.L.
    Rodier N.
    Oriola B.
    Hachet M.
    Jouffrais C.
    Brock A.M.
    Proceedings of the ACM on Human-Computer Interaction, 2021, 5 (ISS)
  • [5] Prediction and detection of virtual reality induced cybersickness: a spiking neural network approach using spatiotemporal EEG brain data and heart rate variability
    Yang, Alexander Hui Xiang
    Kasabov, Nikola Kirilov
    Cakmak, Yusuf Ozgur
    BRAIN INFORMATICS, 2023, 10 (01)