BodyFlow: An Open-Source Library for Multimodal Human Activity Recognition

被引:0
|
作者
del-Hoyo-Alonso, Rafael [1 ]
Hernandez-Ruiz, Ana Caren [1 ]
Maranes-Nueno, Carlos [1 ]
Lopez-Bosque, Irene [1 ]
Aznar-Gimeno, Rocio [1 ]
Salvo-Ibanez, Pilar [1 ]
Perez-Lazaro, Pablo [1 ]
Abadia-Gallego, David [1 ]
Rodrigalvarez-Chamarro, Maria de la Vega [1 ]
机构
[1] Inst Tecnol Aragon ITA, Dept Big Data & Cognit Syst, Maria Luna 7-8, Zaragoza 50018, Spain
关键词
multimodal human activity recognition; human pose estimation; deep learning; sensors; HEALTH-CARE; FUSION;
D O I
10.3390/s24206729
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Human activity recognition is a critical task for various applications across healthcare, sports, security, gaming, and other fields. This paper presents BodyFlow, a comprehensive library that seamlessly integrates human pose estimation and multiple-person estimation and tracking, along with activity recognition modules. BodyFlow enables users to effortlessly identify common activities and 2D/3D body joints from input sources such as videos, image sets, or webcams. Additionally, the library can simultaneously process inertial sensor data, offering users the flexibility to choose their preferred input, thus facilitating multimodal human activity recognition. BodyFlow incorporates state-of-the-art algorithms for 2D and 3D pose estimation and three distinct models for human activity recognition.
引用
收藏
页数:21
相关论文
共 50 条
  • [21] Human Activity Recognition: Review, Taxonomy and Open Challenges
    Arshad, Muhammad Haseeb
    Bilal, Muhammad
    Gani, Abdullah
    SENSORS, 2022, 22 (17)
  • [22] A review of multimodal human activity recognition with special emphasis on classification, applications, challenges and future directions
    Yadav, Santosh Kumar
    Tiwari, Kamlesh
    Pandey, Hari Mohan
    Akbar, Shaik Ali
    KNOWLEDGE-BASED SYSTEMS, 2021, 223
  • [23] SpeechBrain-MOABB: An open-source Python library for benchmarking deep neural networks applied to EEG signals
    Borra, Davide
    Paissan, Francesco
    Ravanelli, Mirco
    Computers in Biology and Medicine, 2024, 182
  • [24] OpenDMC: An Open-Source Library and Performance Evaluation for Deep-learning-based Multi-frame Compression
    Gao, Wei
    Sun, Shangkun
    Zheng, Huiming
    Wu, Yuyang
    Ye, Hua
    Zhang, Yongchi
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 9685 - 9688
  • [25] PollenDetect: An Open-Source Pollen Viability Status Recognition System Based on Deep Learning Neural Networks
    Tan, Zhihao
    Yang, Jing
    Li, Qingyuan
    Su, Fengxiang
    Yang, Tianxu
    Wang, Weiran
    Aierxi, Alifu
    Zhang, Xianlong
    Yang, Wanneng
    Kong, Jie
    Min, Ling
    INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES, 2022, 23 (21)
  • [26] A Systematic Literature Review on Human Activity Recognition
    Ravuri, Ananda
    Shankar, S. Siva
    Devan, D. P.
    Padhi, Manoj Kumar
    Ragavan, V. K. Senthil
    Maurya, Mahesh
    Ravi, A.
    JOURNAL OF ELECTRICAL SYSTEMS, 2024, 20 (06) : 1175 - 1191
  • [27] Survey of Open-Source Software Defect Prediction Method
    Tian X.
    Chang J.
    Zhang C.
    Rong J.
    Wang Z.
    Zhang G.
    Wang H.
    Wu G.
    Hu J.
    Zhang Y.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2023, 60 (07): : 1467 - 1488
  • [28] Autonomous Vehicles: Open-Source Technologies, Considerations, and Development
    Saoudi, Oussama
    Singh, Ishwar
    Mahyar, Hamidreza
    ADVANCES IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING, 2023, 3 (01): : 669 - 692
  • [29] SpheroidJ: An Open-Source Set of Tools for Spheroid Segmentation
    Lacalle, David
    Castro-Abril, Hector Alfonso
    Randelovic, Teodora
    Dominguez, Cesar
    Heras, Jonathan
    Mata, Eloy
    Mata, Gadea
    Mendez, Yolanda
    Pascual, Vico
    Ochoa, Ignacio
    COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE, 2021, 200
  • [30] DeepNeuro: an open-source deep learning toolbox for neuroimaging
    Beers, Andrew
    Brown, James
    Chang, Ken
    Hoebel, Katharina
    Patel, Jay
    Ly, K. Ina
    Tolaney, Sara M.
    Brastianos, Priscilla
    Rosen, Bruce
    Gerstner, Elizabeth R.
    Kalpathy-Cramer, Jayashree
    NEUROINFORMATICS, 2021, 19 (01) : 127 - 140