Self-Supervised Learning for Electroencephalography

被引:175
|
作者
Rafiei, Mohammad H. [1 ]
Gauthier, Lynne V. [2 ]
Adeli, Hojjat [3 ,4 ]
Takabi, Daniel [1 ]
机构
[1] Georgia State Univ, Dept Comp Sci, Atlanta, GA 30303 USA
[2] Univ Massachusetts Lowell, Dept Phys Therapy & Kinesiol, Lowell, MA 01854 USA
[3] Ohio State Univ, Dept Biomed Informat, Columbus, OH 43210 USA
[4] Ohio State Univ, Dept Neurosci, Columbus, OH 43210 USA
关键词
Electroencephalography; Brain modeling; Data models; Task analysis; Machine learning; Training; Heuristic algorithms; Electroencephalography (EEG); machine learning; self-supervised learning (SSL); BRAIN-COMPUTER INTERFACE; EMOTION RECOGNITION; NEURAL-NETWORK; EEG; SYSTEM; CLASSIFICATION; SLEEP; FEATURES; FRAMEWORK; ALGORITHM;
D O I
10.1109/TNNLS.2022.3190448
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decades of research have shown machine learning superiority in discovering highly nonlinear patterns embedded in electroencephalography (EEG) records compared with conventional statistical techniques. However, even the most advanced machine learning techniques require relatively large, labeled EEG repositories. EEG data collection and labeling are costly. Moreover, combining available datasets to achieve a large data volume is usually infeasible due to inconsistent experimental paradigms across trials. Self-supervised learning (SSL) solves these challenges because it enables learning from EEG records across trials with variable experimental paradigms, even when the trials explore different phenomena. It aggregates multiple EEG repositories to increase accuracy, reduce bias, and mitigate overfitting in machine learning training. In addition, SSL could be employed in situations where there is limited labeled training data, and manual labeling is costly. This article: 1) provides a brief introduction to SSL; 2) describes some SSL techniques employed in recent studies, including EEG; 3) proposes current and potential SSL techniques for future investigations in EEG studies; 4) discusses the cons and pros of different SSL techniques; and 5) proposes holistic implementation tips and potential future directions for EEG SSL practices.
引用
收藏
页码:1457 / 1471
页数:15
相关论文
共 50 条
  • [21] GMAEEG: A Self-Supervised Graph Masked Autoencoder for EEG Representation Learning
    Fu, Zanhao
    Zhu, Huaiyu
    Zhao, Yisheng
    Huan, Ruohong
    Zhang, Yi
    Chen, Shuohui
    Pan, Yun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (11) : 6486 - 6497
  • [22] Self-Supervised Contrastive Learning for Medical Time Series: A Systematic Review
    Liu, Ziyu
    Alavi, Azadeh
    Li, Minyi
    Zhang, Xiang
    SENSORS, 2023, 23 (09)
  • [23] Self-Supervised Graphs for Audio Representation Learning With Limited Labeled Data
    Shirian, Amir
    Somandepalli, Krishna
    Guha, Tanaya
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (06) : 1391 - 1401
  • [24] ProtTrans: Toward Understanding the Language of Life Through Self-Supervised Learning
    Elnaggar, Ahmed
    Heinzinger, Michael
    Dallago, Christian
    Rehawi, Ghalia
    Wang, Yu
    Jones, Llion
    Gibbs, Tom
    Feher, Tamas
    Angerer, Christoph
    Steinegger, Martin
    Bhowmik, Debsindhu
    Rost, Burkhard
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (10) : 7112 - 7127
  • [25] Self-supervised Learning: A Succinct Review
    Rani, Veenu
    Nabi, Syed Tufael
    Kumar, Munish
    Mittal, Ajay
    Kumar, Krishan
    ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2023, 30 (04) : 2761 - 2775
  • [26] Self-supervised learning for outlier detection
    Diers, Jan
    Pigorsch, Christian
    STAT, 2021, 10 (01):
  • [27] Self-supervised Learning: A Succinct Review
    Veenu Rani
    Syed Tufael Nabi
    Munish Kumar
    Ajay Mittal
    Krishan Kumar
    Archives of Computational Methods in Engineering, 2023, 30 : 2761 - 2775
  • [28] Nonequilibrium thermodynamics of self-supervised learning
    Salazar, Domingos S. P.
    PHYSICS LETTERS A, 2021, 419
  • [29] Self-supervised ensembled learning for autism spectrum classification
    Gaur, Manu
    Chaturvedi, Kunal
    Vishwakarma, Dinesh Kumar
    Ramasamy, Savitha
    Prasad, Mukesh
    RESEARCH IN AUTISM SPECTRUM DISORDERS, 2023, 107
  • [30] A Self-Supervised Learning Based Channel Attention MLP-Mixer Network for Motor Imagery Decoding
    He, Yanbin
    Lu, Zhiyang
    Wang, Jun
    Ying, Shihui
    Shi, Jun
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2022, 30 : 2406 - 2417