BodyFlow: An Open-Source Library for Multimodal Human Activity Recognition

被引:0
|
作者
del-Hoyo-Alonso, Rafael [1 ]
Hernandez-Ruiz, Ana Caren [1 ]
Maranes-Nueno, Carlos [1 ]
Lopez-Bosque, Irene [1 ]
Aznar-Gimeno, Rocio [1 ]
Salvo-Ibanez, Pilar [1 ]
Perez-Lazaro, Pablo [1 ]
Abadia-Gallego, David [1 ]
Rodrigalvarez-Chamarro, Maria de la Vega [1 ]
机构
[1] Inst Tecnol Aragon ITA, Dept Big Data & Cognit Syst, Maria Luna 7-8, Zaragoza 50018, Spain
关键词
multimodal human activity recognition; human pose estimation; deep learning; sensors; HEALTH-CARE; FUSION;
D O I
10.3390/s24206729
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human activity recognition is a critical task for various applications across healthcare, sports, security, gaming, and other fields. This paper presents BodyFlow, a comprehensive library that seamlessly integrates human pose estimation and multiple-person estimation and tracking, along with activity recognition modules. BodyFlow enables users to effortlessly identify common activities and 2D/3D body joints from input sources such as videos, image sets, or webcams. Additionally, the library can simultaneously process inertial sensor data, offering users the flexibility to choose their preferred input, thus facilitating multimodal human activity recognition. BodyFlow incorporates state-of-the-art algorithms for 2D and 3D pose estimation and three distinct models for human activity recognition.
引用
收藏
页数:21
相关论文
共 50 条
  • [31] Distributed manufacturing of an open-source tourniquet testing system
    Liu, Dawei
    Kulkarni, Apoorv
    Jaqua, Victoria F.
    Cole, Christina A.
    Pearce, Joshua M.
    HARDWAREX, 2023, 15
  • [32] MMFashion: An Open-Source Toolbox forVisual Fashion Analysis
    Liu, Xin
    Li, Jiancheng
    Wang, Jiaqi
    Liu, Ziwei
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 3755 - 3758
  • [33] Lumos: An Open-Source Device forWearable Spectroscopy Research
    Watson, Amanda
    Kendell, Claire
    Lingamoorthy, Anush
    Lee, Insup
    Weimer, James
    PROCEEDINGS OF THE ACM ON INTERACTIVE MOBILE WEARABLE AND UBIQUITOUS TECHNOLOGIES-IMWUT, 2022, 6 (04):
  • [34] Open Datasets in Human Activity Recognition ResearchuIssues and Challenges: A Review
    Alam, Gulzar
    McChesney, Ian
    Nicholl, Peter
    Rafferty, Joseph
    IEEE SENSORS JOURNAL, 2023, 23 (22) : 26952 - 26980
  • [35] Pollen recognition through an open-source web-based system: automated particle counting for aerobiological analysis
    Chaves, Antonio Jesus
    Martin, Cristian
    Torres, Luis Llopis
    Diaz, Manuel
    Ruiz-Mata, Rocio
    de Galvez-Montanez, Enrique
    Recio, Marta
    Trigo, M. Mar
    Picornell, Antonio
    EARTH SCIENCE INFORMATICS, 2024, 17 (01) : 699 - 710
  • [36] Open-Source Potentiostat for Wireless Electrochemical Detection with Smartphones
    Ainla, Alar
    Mousavi, Maral P. S.
    Tsaloglou, Maria-Nefeli
    Redston, Julia
    Bell, Jeffrey G.
    Teresa Fernandez-Abedul, M.
    Whitesides, George M.
    ANALYTICAL CHEMISTRY, 2018, 90 (10) : 6240 - 6246
  • [37] DeepNeuro: an open-source deep learning toolbox for neuroimaging
    Andrew Beers
    James Brown
    Ken Chang
    Katharina Hoebel
    Jay Patel
    K. Ina Ly
    Sara M. Tolaney
    Priscilla Brastianos
    Bruce Rosen
    Elizabeth R. Gerstner
    Jayashree Kalpathy-Cramer
    Neuroinformatics, 2021, 19 : 127 - 140
  • [38] Pollen recognition through an open-source web-based system: automated particle counting for aerobiological analysis
    Antonio Jesús Chaves
    Cristian Martín
    Luis Llopis Torres
    Manuel Díaz
    Rocío Ruiz-Mata
    Enrique de Gálvez-Montañez
    Marta Recio
    M. Mar Trigo
    Antonio Picornell
    Earth Science Informatics, 2024, 17 : 699 - 710
  • [39] A Multimodal Data Processing System for LiDAR-Based Human Activity Recognition
    Roche, Jamie
    De-Silva, Varuna
    Hook, Joosep
    Moencks, Mirco
    Kondoz, Ahmet
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) : 10027 - 10040
  • [40] CNN-based Sensor Fusion Techniques for Multimodal Human Activity Recognition
    Muenzner, Sebastian
    Schmidt, Philip
    Reiss, Attila
    Hanselmann, Michael
    Stiefelhagen, Rainer
    Duerichen, Robert
    PROCEEDINGS OF THE 2017 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS (ISWC 17), 2017, : 158 - 165