Learning Human Activity From Visual Data Using Deep Learning

被引:5
作者
Alhersh, Taha [1 ]
Stuckenschmidt, Heiner [1 ]
Rehman, Atiq Ur [2 ]
Belhaouari, Samir Brahim [2 ]
机构
[1] Univ Mannheim, Data & Web Sci Grp, D-68131 Mannheim, Germany
[2] Hamad Bin Khalifa Univ, Coll Sci & Engn, ICT Div, Doha, Qatar
关键词
Sensors; Visualization; Activity recognition; Feature extraction; Cameras; Optical sensors; Optical network units; Human activity recognition; deep learning; first-person vision; HUMAN ACTIVITY RECOGNITION;
D O I
10.1109/ACCESS.2021.3099567
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Advances in wearable technologies have the ability to revolutionize and improve people's lives. The gains go beyond the personal sphere, encompassing business and, by extension, the global economy. The technologies are incorporated in electronic devices that collect data from consumers' bodies and their immediate environment. Human activities recognition, which involves the use of various body sensors and modalities either separately or simultaneously, is one of the most important areas of wearable technology development. In real-life scenarios, the number of sensors deployed is dictated by practical and financial considerations. In the research for this article, we reviewed our earlier efforts and have accordingly reduced the number of required sensors, limiting ourselves to first-person vision data for activities recognition. Nonetheless, our results beat state of the art by more than 4% of F1 score.
引用
收藏
页码:106245 / 106253
页数:9
相关论文
共 39 条
[1]   Inertial-Vision: cross-domain knowledge transfer for wearable sensors [J].
Abebe, Girmaw ;
Cavallaro, Andrea .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2017), 2017, :1392-1400
[2]  
Alhersh T., 2021, TECH REP
[3]   Action Recognition Using Local Visual Descriptors and Inertial Data [J].
Alhersh, Taha ;
Belhaouari, Samir Brahim ;
Stuckenschmidt, Heiner .
AMBIENT INTELLIGENCE (AMI 2019), 2019, 11912 :123-138
[4]  
Alhersh T, 2019, INT CONF PERVAS COMP, P17, DOI [10.1109/PERCOMW.2019.8730743, 10.1109/percomw.2019.8730743]
[5]  
Ali Arabac M., 2018, ARXIV180700612
[6]  
[Anonymous], 2014, P INT C IM PROC COMP
[7]  
[Anonymous], 2017, P GERM C PATT REC
[8]  
Ashry S., 2018, P 15 INT C INFORMATI, V1, P494
[9]   Physical Human Activity Recognition Using Wearable Sensors [J].
Attal, Ferhat ;
Mohammed, Samer ;
Dedabrishvili, Mariam ;
Chamroukhi, Faicel ;
Oukhellou, Latifa ;
Amirat, Yacine .
SENSORS, 2015, 15 (12) :31314-31338
[10]  
Bevilacqua A., 2018, MACHINE LEARNING KNO, P541