Self-Supervised Representation Learning and Temporal-Spectral Feature Fusion for Bed Occupancy Detection

被引:0
作者
Song, Yingjian [1 ]
Pitafi, Zaid Farooq [1 ]
Dou, Fei [1 ]
Sun, Jin [1 ]
Zhang, Xiang [2 ]
Phillips, Bradley G. [1 ]
Song, Wenzhan [1 ]
机构
[1] Univ Georgia, Athens, GA 30602 USA
[2] Univ North Carolina, Athens, GA USA
来源
PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT | 2024年 / 8卷 / 03期
关键词
Bed Occupancy; Self-Supervised Learning; Spectrum-temporal feature fusion;
D O I
10.1145/3678514
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In automated sleep monitoring systems, bed occupancy detection is the foundation or the first step before other downstream tasks, such as inferring sleep activities and vital signs. The existing methods do not generalize well to real-world environments due to single environment settings and rely on threshold-based approaches. Manually selecting thresholds requires observing a large amount of data and may not yield optimal results. In contrast, acquiring extensive labeled sensory data poses significant challenges regarding cost and time. Hence, developing models capable of generalizing across diverse environments with limited data is imperative. This paper introduces SeismoDot, which consists of a self-supervised learning module and a spectral-temporal feature fusion module for bed occupancy detection. Unlike conventional methods that require separate pre-training and fine-tuning, our self-supervised learning module is co-optimized with the primary target task, which directs learned representations toward a task-relevant embedding space while expanding the feature space. The proposed feature fusion module enables the simultaneous exploitation of temporal and spectral features, enhancing the diversity of information from both domains. By combining these techniques, SeismoDot expands the diversity of embedding space for both the temporal and spectral domains to enhance its generalizability across different environments. SeismoDot not only achieves high accuracy (98.49%) and F1 scores (98.08%) across 13 diverse environments, but it also maintains high performance (97.01% accuracy and 96.54% F1 score) even when trained with just 20% (4 days) of the total data. This demonstrates its exceptional ability to generalize across various environmental settings, even with limited data availability.
引用
收藏
页数:25
相关论文
共 40 条
  • [1] Investigating Low-Cost Wireless Occupancy Sensors for Beds
    Braun, Andreas
    Majewski, Martin
    Wichert, Reiner
    Kuijper, Arjan
    [J]. DISTRIBUTED, AMBIENT AND PERVASIVE INTERACTIONS, (DAPI 2016), 2016, 9749 : 26 - 34
  • [2] Capacitive proximity sensing in smart environments
    Braun, Andreas
    Wichert, Reiner
    Kuijper, Arjan
    Fellner, Dieter W.
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND SMART ENVIRONMENTS, 2015, 7 (04) : 483 - 510
  • [3] Beyond respiration: Contactless sleep sound-activity recognition using RF signals
    Liu, Chen
    Xiong, Jie
    Cai, Lin
    Feng, Lin
    Chen, Xiaojiang
    Fang, Dingyi
    [J]. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 2019, 3 (03)
  • [4] Helena: Real-time Contact-free Monitoring of Sleep Activities and Events around the Bed
    Clemente, Jose
    Valero, Maria
    Li, Fangyu
    Wang, Chengliang
    Song, WenZhan
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS (PERCOM 2020), 2020,
  • [5] COCOA: Cross Modality Contrastive Learning for Sensor Data
    Deldari, Shohreh
    Xue, Hao
    Saeed, Aaqib
    Smith, Daniel V.
    Salim, Flora D.
    [J]. PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (03):
  • [6] Self-Supervised Contrastive Representation Learning for Semi-Supervised Time-Series Classification
    Eldele, Emadeldeen
    Ragab, Mohamed
    Chen, Zhenghua
    Wu, Min
    Kwoh, Chee-Keong
    Li, Xiaoli
    Guan, Cuntai
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (12) : 15604 - 15618
  • [7] Fan H., 2020, arXiv
  • [8] Gretton Arthur, 2007, Advances in Neural Information Processing Systems, P513, DOI DOI 10.7551/MITPRESS/7503.003.0069
  • [9] Deep Residual Learning for Image Recognition
    He, Kaiming
    Zhang, Xiangyu
    Ren, Shaoqing
    Sun, Jian
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 770 - 778
  • [10] ColloSSL: Collaborative Self-Supervised Learning for Human Activity Recognition
    Jain, Yash
    Tang, Chi Ian
    Min, Chulhong
    Kawsar, Fahim
    Mathur, Akhil
    [J]. PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (01):