BodyFlow: An Open-Source Library for Multimodal Human Activity Recognition

被引:0
|
作者
del-Hoyo-Alonso, Rafael [1 ]
Hernandez-Ruiz, Ana Caren [1 ]
Maranes-Nueno, Carlos [1 ]
Lopez-Bosque, Irene [1 ]
Aznar-Gimeno, Rocio [1 ]
Salvo-Ibanez, Pilar [1 ]
Perez-Lazaro, Pablo [1 ]
Abadia-Gallego, David [1 ]
Rodrigalvarez-Chamarro, Maria de la Vega [1 ]
机构
[1] Inst Tecnol Aragon ITA, Dept Big Data & Cognit Syst, Maria Luna 7-8, Zaragoza 50018, Spain
关键词
multimodal human activity recognition; human pose estimation; deep learning; sensors; HEALTH-CARE; FUSION;
D O I
10.3390/s24206729
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human activity recognition is a critical task for various applications across healthcare, sports, security, gaming, and other fields. This paper presents BodyFlow, a comprehensive library that seamlessly integrates human pose estimation and multiple-person estimation and tracking, along with activity recognition modules. BodyFlow enables users to effortlessly identify common activities and 2D/3D body joints from input sources such as videos, image sets, or webcams. Additionally, the library can simultaneously process inertial sensor data, offering users the flexibility to choose their preferred input, thus facilitating multimodal human activity recognition. BodyFlow incorporates state-of-the-art algorithms for 2D and 3D pose estimation and three distinct models for human activity recognition.
引用
收藏
页数:21
相关论文
共 50 条
  • [41] A multimodal fusion enabled ensemble approach for human activity recognition in smart homes
    Ding, Weimin
    Wu, Shengli
    Nugent, Chris
    HEALTH INFORMATICS JOURNAL, 2023, 29 (02)
  • [42] pyEDA: An Open-Source Python']Python Toolkit for Pre-processing and Feature Extraction of Electrodermal Activity
    Aqajari, Seyed Amir Hossein
    Naeini, Emad Kasaeyan
    Mehrabadi, Milad Asgari
    Labbaf, Sina
    Dutt, Nikil
    Rahmani, Amir M.
    12TH INTERNATIONAL CONFERENCE ON AMBIENT SYSTEMS, NETWORKS AND TECHNOLOGIES (ANT) / THE 4TH INTERNATIONAL CONFERENCE ON EMERGING DATA AND INDUSTRY 4.0 (EDI40) / AFFILIATED WORKSHOPS, 2021, 184 : 99 - 106
  • [43] From CNNs to Transformers in Multimodal Human Action Recognition: A Survey
    Shaikh, Muhammad bilal
    Chai, Douglas
    Islam, Syed Muhammad Shamsul
    Akhtar, Naveed
    ACM TRANSACTIONS ON MULTIMEDIA COMPUTING COMMUNICATIONS AND APPLICATIONS, 2024, 20 (08)
  • [44] An Open-Source Benchmark of Deep Learning Models for Audio-Visual Apparent and Self-Reported Personality Recognition
    Liao, Rongfan
    Song, Siyang
    Gunes, Hatice
    IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2024, 15 (03) : 1590 - 1607
  • [45] Flukebook: an open-source AI platform for cetacean photo identification
    Blount, Drew
    Gero, Shane
    Van Oast, Jon
    Parham, Jason
    Kingen, Colin
    Scheiner, Ben
    Stere, Tanya
    Fisher, Mark
    Minton, Gianna
    Khan, Christin
    Dulau, Violaine
    Thompson, Jaime
    Moskvyak, Olga
    Berger-Wolf, Tanya
    Stewart, Charles, V
    Holmberg, Jason
    Levenson, J. Jacob
    MAMMALIAN BIOLOGY, 2022, 102 (03) : 1005 - 1023
  • [46] NeuroAssist: Open-Source Automatic Event Detection in Scalp EEG
    Alqarni, Mohammad Ali
    Masood, Hira
    Qureshi, Adil Jowad
    Alvi, Muiz
    Arbab, Haziq
    Khan, Hassan Aqeel
    Kamboh, Awais Mehmood
    Shafait, Saima
    Shafait, Faisal
    IEEE ACCESS, 2024, 12 : 170321 - 170334
  • [47] DeepPlayer: An open-source SignalPlant plugin for deep learning inference
    Plesinger, Filip
    Nejedly, Petr
    Koscova, Zuzana
    Rohr, Maurice
    Viscor, Ivo
    Smisek, Radovan
    Ivora, Adam
    Leinveber, Pavel
    Curila, Karol
    Antink, Christoph Hoog
    SOFTWARE-PRACTICE & EXPERIENCE, 2023, 53 (02) : 455 - 464
  • [48] Flukebook: an open-source AI platform for cetacean photo identification
    Drew Blount
    Shane Gero
    Jon Van Oast
    Jason Parham
    Colin Kingen
    Ben Scheiner
    Tanya Stere
    Mark Fisher
    Gianna Minton
    Christin Khan
    Violaine Dulau
    Jaime Thompson
    Olga Moskvyak
    Tanya Berger-Wolf
    Charles V. Stewart
    Jason Holmberg
    J. Jacob Levenson
    Mammalian Biology, 2022, 102 : 1005 - 1023
  • [49] Accuracy and Efficiency Comparison of Object Detection Open-Source Models
    Jabir, Brahim
    Falih, Noureddine
    Rahmani, Khalid
    INTERNATIONAL JOURNAL OF ONLINE AND BIOMEDICAL ENGINEERING, 2021, 17 (05) : 165 - 184
  • [50] Low-cost open-source platform for irrigation automation
    Campos, Hugo de Moura
    de Oliveira, Henrique Fonseca E.
    Mesquita, Marcio
    Vieira de Castro, Lucas Eduardo
    Ferrarezi, Rhuanito Soranz
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2021, 190