BeAware: Convolutional neural network(CNN) based user behavior understanding through WiFi channel state information

In modern informatics society, human beings are becoming more and more attached to the computer. Therefore, understanding user behavior is critical to various application fields like sedentary analysis, human-computer interaction, and affective computing. Current sensor-based and vision-based user behavior understanding approaches are either contact or obtrusive to user s, jeopardizing their availability and practicality. To this end, we present BeAware, a contactless Radio Frequency (RF) based user behavior understanding system leveraging the WiFi Channel State Information (CSI). The key idea is to visualize the channel data affected by human movements into time-series heat-map images, which are processed by a Convolutional Neural Network (CNN) to understand the corresponding user behaviors. We prototype BeAware on commodity low-cost WiFi devices and evaluate its performance in real-world environments. Experimental results have verified its effectiveness in recognizing user behaviors. (C) 2020 Elsevier B.V. All rights reserved.