CareSleepNet: A Hybrid Deep Learning Network for Automatic Sleep Staging

被引:1
|
作者
Wang, Jiquan [1 ,2 ]
Zhao, Sha [1 ,2 ]
Jiang, Haiteng [1 ,3 ,4 ,5 ]
Zhou, Yangxuan [1 ]
Yu, Zhenghe [4 ,6 ]
Li, Tao [1 ,3 ,4 ,5 ]
Li, Shijian [1 ]
Pan, Gang [1 ,2 ,5 ]
机构
[1] Zhejiang Univ, State Key Lab Brain Machine Intelligence, Hangzhou 311121, Peoples R China
[2] Zhejiang Univ, Coll Comp Sci & Technol, Hangzhou 310013, Peoples R China
[3] Zhejiang Univ, Affiliated Mental Hlth Ctr, Dept Neurobiol, Sch Med, Hangzhou 310063, Peoples R China
[4] Zhejiang Univ, Hangzhou Peoples Hosp 7, Sch Med, Hangzhou 310063, Peoples R China
[5] MOE Frontier Sci Ctr Brain Sci & Brain Machine Int, Hangzhou 310063, Peoples R China
[6] Zhejiang Univ, Affiliated Mental Hlth Ctr, Dept Sleep Med, Sch Med, Hangzhou 310063, Peoples R China
关键词
Sleep; Electrooculography; Electroencephalography; Brain modeling; Context modeling; Deep learning; Transformers; Sleep staging; PSG recordings; cross-modality; deep learning; SIGNALS; CLASSIFICATION; PERFORMANCE; MODEL;
D O I
10.1109/JBHI.2024.3426939
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Sleep staging is essential for sleep assessment and plays an important role in disease diagnosis, which refers to the classification of sleep epochs into different sleep stages. Polysomnography (PSG), consisting of many different physiological signals, e.g. electroencephalogram (EEG) and electrooculogram (EOG), is a gold standard for sleep staging. Although existing studies have achieved high performance on automatic sleep staging from PSG, there are still some limitations: 1) they focus on local features but ignore global features within each sleep epoch, and 2) they ignore cross-modality context relationship between EEG and EOG. In this paper, we propose CareSleepNet, a novel hybrid deep learning network for automatic sleep staging from PSG recordings. Specifically, we first design a multi-scale Convolutional-Transformer Epoch Encoder to encode both local salient wave features and global features within each sleep epoch. Then, we devise a Cross-Modality Context Encoder based on co-attention mechanism to model cross-modality context relationship between different modalities. Next, we use a Transformer-based Sequence Encoder to capture the sequential relationship among sleep epochs. Finally, the learned feature representations are fed into an epoch-level classifier to determine the sleep stages. We collected a private sleep dataset, SSND, and use two public datasets, Sleep-EDF-153 and ISRUC to evaluate the performance of CareSleepNet. The experiment results show that our CareSleepNet achieves the state-of-the-art performance on the three datasets. Moreover, we conduct ablation studies and attention visualizations to prove the effectiveness of each module and to analyze the influence of each modality.
引用
收藏
页码:7392 / 7405
页数:14
相关论文
共 50 条
  • [21] DEEP NEURAL NETWORK FOR AUTOMATIC AND CAUSAL SLEEP STAGING BASED ON A SINGLE EEG CHANNEL RECORDED AT HOME
    Bresch, E.
    Grossekathofer, U.
    Garcia-Molina, G.
    SLEEP, 2018, 41 : A405 - A405
  • [22] Review of Deep Learning Methods for Automated Sleep Staging
    Malekzadeh, Masoud
    Hajibabaee, Parisa
    Heidari, Maryam
    Berlin, Brett
    2022 IEEE 12TH ANNUAL COMPUTING AND COMMUNICATION WORKSHOP AND CONFERENCE (CCWC), 2022, : 80 - 86
  • [23] A Deep Learning Strategy for Automatic Sleep Staging Based on Two-Channel EEG Headband Data
    Casciola, Amelia A.
    Carlucci, Sebastiano K.
    Kent, Brianne A.
    Punch, Amanda M.
    Muszynski, Michael A.
    Zhou, Daniel
    Kazemi, Alireza
    Mirian, Maryam S.
    Valerio, Jason
    McKeown, Martin J.
    Nygaard, Haakon B.
    SENSORS, 2021, 21 (10)
  • [24] END-TO-END DEEP LEARNING MODEL FOR AUTOMATIC SLEEP STAGING USING RAW PSG WAVEFORMS
    Olesen, A. N.
    Peppard, P. E.
    Sorensen, H. B.
    Jennum, P. J.
    Mignot, E.
    SLEEP, 2018, 41 : A121 - A121
  • [25] A deep learning algorithm based on 1D CNN-LSTM for automatic sleep staging
    Zhao, Dechun
    Jiang, Renpin
    Feng, Mingyang
    Yang, Jiaxin
    Wang, Yi
    Hou, Xiaorong
    Wang, Xing
    TECHNOLOGY AND HEALTH CARE, 2022, 30 (02) : 323 - 336
  • [26] Sleep staging from electrocardiography and respiration with deep learning
    Sun, Haoqi
    Ganglberger, Wolfgang
    Panneerselvam, Ezhil
    Leone, Michael J.
    Quadri, Syed A.
    Goparaju, Balaji
    Tesh, Ryan A.
    Akeju, Oluwaseun
    Thomas, Robert J.
    Westover, M. Brandon
    SLEEP, 2020, 43 (07)
  • [27] BrainSleepNet: Learning Multivariate EEG Representation for Automatic Sleep Staging
    Cai, Xiyang
    Jia, Ziyu
    Tang, Minfang
    Zheng, Gaoxing
    2020 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE, 2020, : 976 - 979
  • [28] MFASleepNet: Multi-view fusion attention-based deep neural network for automatic sleep staging
    Hou, Zhoujie
    Pan, Jiahui
    Li, Yuanqing
    2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
  • [29] Designing an Automatic Sleep Staging System Using Deep Convolutional Neural Network Fed by Nonlinear Dynamic Transformation
    Ali Erfani Sholeyan
    Fereidoun Nowshiravan Rahatabad
    Seyed Kamaledin Setarehdan
    Journal of Medical and Biological Engineering, 2023, 43 : 11 - 21
  • [30] Designing an Automatic Sleep Staging System Using Deep Convolutional Neural Network Fed by Nonlinear Dynamic Transformation
    Sholeyan, Ali Erfani
    Rahatabad, Fereidoun Nowshiravan
    Setarehdan, Seyed Kamaledin
    JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2023, 43 (01) : 11 - 21