Building Lightweight Deep learning Models with TensorFlow Lite for Human Activity Recognition on Mobile Devices

被引:2
作者
Bursa, Sevda Ozge [1 ]
Incel, Ozlem Durmaz [2 ]
Alptekin, Gulfem Isiklar [1 ]
机构
[1] Galatasaray Univ, Dept Comp Engn, TR-34349 Istanbul, Turkiye
[2] Bogazici Univ, Dept Comp Engn, TR-34342 Istanbul, Turkiye
关键词
Human activity recognition (HAR); Deep learning (DL); Resource-constrained devices; Wearable sensors; Energy consumption; OF-THE-ART;
D O I
10.1007/s12243-023-00962-x
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
Human activity recognition (HAR) is a research domain that enables continuous monitoring of human behaviors for various purposes, from assisted living to surveillance in smart home environments. These applications generally work with a rich collection of sensor data generated using smartphones and other low-power wearable devices. The amount of collected data can quickly become immense, necessitating time and resource-consuming computations. Deep learning (DL) has recently become a promising trend in HAR. However, it is challenging to train and run DL algorithms on mobile devices due to their limited battery power, memory, and computation units. In this paper, we evaluate and compare the performance of four different deep architectures trained on three datasets from the HAR literature (WISDM, MobiAct, OpenHAR). We use the TensorFlow Lite platform with quantization techniques to convert the models into lighter versions for deployment on mobile devices. We compare the performance of the original models in terms of accuracy, size, and resource usage with their optimized versions. The experiments reveal that the model size and resource consumption can significantly be reduced when optimized with TensorFlow Lite without sacrificing the accuracy of the models.
引用
收藏
页码:687 / 702
页数:16
相关论文
共 27 条
  • [1] A Lightweight Deep Learning Model for Human Activity Recognition on Edge Devices
    Agarwal, Preeti
    Alam, Mansaf
    [J]. INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND DATA SCIENCE, 2020, 167 : 2364 - 2373
  • [2] Resource Characterisation of Personal-Scale Sensing Models on Edge Accelerators
    Antonini, Mattia
    Vu, Tran Huy
    Min, Chulhong
    Montanari, Alessandro
    Mathur, Akhil
    Kawsar, Fahim
    [J]. PROCEEDINGS OF THE 2019 INTERNATIONAL WORKSHOP ON CHALLENGES IN ARTIFICIAL INTELLIGENCE AND MACHINE LEARNING FOR INTERNET OF THINGS (AICHALLENGEIOT '19), 2019, : 49 - 55
  • [3] Cao Qingqing., 2017, P 1 INT WORKSH DEEP, P1
  • [4] Deep Learning on Computational-Resource-Limited Platforms: A Survey
    Chen, Chunlei
    Zhang, Peng
    Zhang, Huixiang
    Dai, Jiangyan
    Yi, Yugen
    Zhang, Huihui
    Zhang, Yonghui
    [J]. MOBILE INFORMATION SYSTEMS, 2020, 2020 (2020)
  • [5] The State of the Art in Implementing Machine Learning for Mobile Apps: A Survey
    Dai, Xiangfeng
    Spasic, Irena
    Chapman, Samuel
    Meyer, Bradley
    [J]. IEEE SOUTHEASTCON 2020, 2020,
  • [6] Estimation of energy consumption in machine learning
    Garcia-Martin, Eva
    Rodrigues, Crefeda Faviola
    Riley, Graham
    Grahn, Hakan
    [J]. JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2019, 134 : 75 - 88
  • [7] Lightweight and Standalone IoT based WiFi Sensing for Active Repositioning and Mobility
    Hernandez, Steven M.
    Bulut, Eyuphan
    [J]. 2020 21ST IEEE INTERNATIONAL SYMPOSIUM ON A WORLD OF WIRELESS, MOBILE AND MULTIMEDIA NETWORKS (IEEE WOWMOM 2020), 2020, : 277 - 286
  • [8] Hosseininoorbin S, 2021, 2021 IEEE INTERNATIONAL CONFERENCE ON PERVASIVE COMPUTING AND COMMUNICATIONS WORKSHOPS AND OTHER AFFILIATED EVENTS (PERCOM WORKSHOPS), P572, DOI [10.1109/PERCOMWORKSHOPS51409.2021.9431041, 10.1109/PerComWorkshops51409.2021.9431041]
  • [9] Real-time human activity recognition from accelerometer data using Convolutional Neural Networks
    Ignatov, Andrey
    [J]. APPLIED SOFT COMPUTING, 2018, 62 : 915 - 922
  • [10] A Survey of Deep Learning Based Models for Human Activity Recognition
    Khan, Nida Saddaf
    Ghani, Muhammad Sayeed
    [J]. WIRELESS PERSONAL COMMUNICATIONS, 2021, 120 (02) : 1593 - 1635