A Smart Home Digital Twin to Support the Recognition of Activities of Daily Living

被引:7
作者
Bouchabou, Damien [1 ,2 ]
Grosset, Juliette [1 ,3 ]
Nguyen, Sao Mai [1 ,3 ]
Lohr, Christophe [1 ]
Puig, Xavier [4 ]
机构
[1] IMT Atlantique, F-44300 Nantes, France
[2] ENSTA Paris, U2IS, F-91120 Palaiseau, France
[3] ECAM Rennes, F-35170 Bruz, France
[4] FAIR, Menlo Pk, CA 94025 USA
关键词
smart home; machine learning; home automation; simulator; database; digital twin; transfer learning; SIMULATION;
D O I
10.3390/s23177586
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
One of the challenges in the field of human activity recognition in smart homes based on IoT sensors is the variability in the recorded data. This variability arises from differences in home configurations, sensor network setups, and the number and habits of inhabitants, resulting in a lack of data that accurately represent the application environment. Although simulators have been proposed in the literature to generate data, they fail to bridge the gap between training and field data or produce diverse datasets. In this article, we propose a solution to address this issue by leveraging the concept of digital twins to reduce the disparity between training and real-world data and generate more varied datasets. We introduce the Virtual Smart Home, a simulator specifically designed for modeling daily life activities in smart homes, which is adapted from the Virtual Home simulator. To assess its realism, we compare a set of activity data recorded in a real-life smart apartment with its replication in the VirtualSmartHome simulator. Additionally, we demonstrate that an activity recognition algorithm trained on the data generated by the VirtualSmartHome simulator can be successfully validated using real-life field data.
引用
收藏
页数:27
相关论文
共 59 条
  • [41] Roberts M, 2021, Arxiv, DOI arXiv:2011.02523
  • [42] Roitberg A, 2021, Arxiv, DOI arXiv:2107.05617
  • [43] Sammut C., 2011, ENCY MACHINE LEARNIN, P600, DOI [DOI 10.1007/978-0-387-30164-8_469, DOI 10.1007/978-0-387-30164-8469, 10.1007/978-0-387-30164-8_469]
  • [44] Savva M, 2019, Arxiv, DOI arXiv:1904.01201
  • [45] Savva M, 2017, Arxiv, DOI arXiv:1712.03931
  • [46] SEDKY M., 2018, Int. J. Inf. Syst. Comput. Sci., V12, P48
  • [47] ALFRED A Benchmark for Interpreting Grounded Instructions for Everyday Tasks
    Shridhar, Mohit
    Thomason, Jesse
    Gordon, Daniel
    Bisk, Yonatan
    Han, Winson
    Mottaghi, Roozbeh
    Zettlemoyer, Luke
    Fox, Dieter
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2020), 2020, : 10737 - 10746
  • [48] Convolutional and Recurrent Neural Networks for Activity Recognition in Smart Environment
    Singh, Deepika
    Merdivan, Erinc
    Hanke, Sten
    Kropf, Johannes
    Geist, Matthieu
    Holzinger, Andreas
    [J]. TOWARDS INTEGRATIVE MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2017, 10344 : 194 - 205
  • [49] Human Activity Recognition Using Recurrent Neural Networks
    Singh, Deepika
    Merdivan, Erinc
    Psychoula, Ismini
    Kropf, Johannes
    Hanke, Sten
    Geist, Matthieu
    Holzinger, Andreas
    [J]. MACHINE LEARNING AND KNOWLEDGE EXTRACTION, CD-MAKE 2017, 2017, 10410 : 267 - 274
  • [50] Srivastava S., 2021, arXiv