Optimal Sensor Placement and Multimodal Fusion for Human Activity Recognition in Agricultural Tasks

被引:2
|
作者
Benos, Lefteris [1 ]
Tsaopoulos, Dimitrios [1 ]
Tagarakis, Aristotelis C. [1 ]
Kateris, Dimitrios [1 ]
Bochtis, Dionysis [1 ,2 ]
机构
[1] Ctr Res & Technol Hellas CERTH, Inst Bioecon & Agritechnol IBO, GR-57001 Thessaloniki, Greece
[2] FarmB Digital Agr, Doiraniis 17, Thessaloniki GR-54639, Greece
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 18期
关键词
Long Short-Term Memory (LSTM) networks; wearable sensors; multi-sensor information fusion; human-robot collaboration; human factors; cost-optimal system configuration; ROBOTS; SPINE;
D O I
10.3390/app14188520
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
This study examines the impact of sensor placement and multimodal sensor fusion on the performance of a Long Short-Term Memory (LSTM)-based model for human activity classification taking place in an agricultural harvesting scenario involving human-robot collaboration. Data were collected from twenty participants performing six distinct activities using five wearable inertial measurement units placed at various anatomical locations. The signals collected from the sensors were first processed to eliminate noise and then input into an LSTM neural network for recognizing features in sequential time-dependent data. Results indicated that the chest-mounted sensor provided the highest F1-score of 0.939, representing superior performance over other placements and combinations of them. Moreover, the magnetometer surpassed the accelerometer and gyroscope, highlighting its superior ability to capture crucial orientation and motion data related to the investigated activities. However, multimodal fusion of accelerometer, gyroscope, and magnetometer data showed the benefit of integrating data from different sensor types to improve classification accuracy. The study emphasizes the effectiveness of strategic sensor placement and fusion in optimizing human activity recognition, thus minimizing data requirements and computational expenses, and resulting in a cost-optimal system configuration. Overall, this research contributes to the development of more intelligent, safe, cost-effective adaptive synergistic systems that can be integrated into a variety of applications.
引用
收藏
页数:16
相关论文
共 50 条
  • [21] A review of multimodal human activity recognition with special emphasis on classification, applications, challenges and future directions
    Yadav, Santosh Kumar
    Tiwari, Kamlesh
    Pandey, Hari Mohan
    Akbar, Shaik Ali
    KNOWLEDGE-BASED SYSTEMS, 2021, 223
  • [22] WiWeHAR: Multimodal Human Activity Recognition Using Wi-Fi and Wearable Sensing Modalities
    Muaaz, Muhammad
    Chelli, Ali
    Abdelgawwad, Ahmed Abdelmonem
    Mallofre, Andreu Catala
    Patzold, Matthias
    IEEE ACCESS, 2020, 8 : 164453 - 164470
  • [23] A Comparison of Wearable Sensor Configuration Methods for Human Activity Recognition Using CNN
    Tong, Lina
    Lin, Qianzhi
    Qin, Chuanlei
    Peng, Liang
    PROCEEDINGS OF THE 2021 IEEE INTERNATIONAL CONFERENCE ON PROGRESS IN INFORMATICS AND COMPUTING (PIC), 2021, : 288 - 292
  • [24] Few-Shot Human Activity Recognition on Noisy Wearable Sensor Data
    Deng, Shizhuo
    Hua, Wen
    Wang, Botao
    Wang, Guoren
    Zhou, Xiaofang
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT II, 2020, 12113 : 54 - 72
  • [25] A survey on wearable sensor modality centred human activity recognition in health care
    Wang, Yan
    Cang, Shuang
    Yu, Hongnian
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 137 : 167 - 190
  • [26] Determining the optimal number of body-worn sensors for human activity recognition
    Ömer Faruk Ertuǧrul
    Yılmaz Kaya
    Soft Computing, 2017, 21 : 5053 - 5060
  • [27] Determining the optimal number of body-worn sensors for human activity recognition
    Ertugrul, Omer Faruk
    Kaya, Yilmaz
    SOFT COMPUTING, 2017, 21 (17) : 5053 - 5060
  • [28] Automatic Labeling Framework for Wearable Sensor-based Human Activity Recognition
    Liang, Guanhao
    Luo, Qingsheng
    Jia, Yan
    SENSORS AND MATERIALS, 2018, 30 (09) : 2049 - 2071
  • [29] Multi-Criteria Analysis of Sensor Reliability for Wearable Human Activity Recognition
    Dong, Yilin
    Li, Xinde
    Dezert, Jean
    Zhou, Rigui
    Zhu, Changming
    Ge, Shuzhi Sam
    IEEE SENSORS JOURNAL, 2021, 21 (17) : 19144 - 19156
  • [30] Multi-Framework Evidential Association Rule Fusion for Wearable Human Activity Recognition
    Geng, Xiaojiao
    Chen, Xinhuan
    Ma, Zongfang
    Song, Lin
    IEEE SENSORS JOURNAL, 2024, 24 (07) : 11805 - 11816