EyeShopper: Estimating Shoppers' Gaze using CCTV Cameras

被引:16
作者
Bermejo, Carlos [1 ]
Chatzopoulos, Dimitris [1 ]
Hui, Pan [1 ,2 ]
机构
[1] HKUST, Hong Kong, Peoples R China
[2] Univ Helsinki, Helsinki, Finland
来源
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA | 2020年
基金
芬兰科学院;
关键词
Retail Stores; Indoor Location; Camera; Gaze Estimator; Convolutional Neural Networks; TRACKING;
D O I
10.1145/3394171.3413683
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recent advances in machine and deep learning allow for enhanced retail analytics by applying object detection techniques. However, existing approaches either require laborious installation processes to function or lack precision when the customers turn their back in the installed cameras. In this paper, we present EyeShopper, an innovative system that tracks the gaze of shoppers when facing away from the camera and provides insights about their behavior in physical stores. EyeShopper is readily deployable in existing surveillance systems and robust against low-resolution video inputs. At the same time, its accuracy is comparable to state-of-the-art gaze estimation frameworks that require high-resolution and continuous video inputs to function. Furthermore, EyeShopper is more robust than state-of-the-art gaze tracking techniques for back head images. Extensive evaluation with different real video datasets and a synthetic dataset we produced shows that EyeShopper estimates with high accuracy the gaze of customers.
引用
收藏
页码:2765 / 2774
页数:10
相关论文
共 57 条
[1]  
Amazon, 2019, AM GO
[2]  
[Anonymous], 2019, CNBC
[3]  
[Anonymous], 2017, CNBC
[4]  
[Anonymous], 2008, AUT FAC GEST REC 200
[5]  
[Anonymous], 2016, COMM SYST NETW COMSN, DOI DOI 10.5772/62602
[6]   Face recognition from face profile using dynamic time warping [J].
Bhanu, B ;
Zhou, XL .
PROCEEDINGS OF THE 17TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION, VOL 4, 2004, :499-502
[7]  
Caputo A., 2014, DIGITAL VIDEO SURVEI, V2nd
[8]   Hyperion: A Wearable Augmented Reality System for Text Extraction and Manipulation in the Air [J].
Chatzopoulos, Dimitris ;
Bermejo, Carlos ;
Huang, Zhanpeng ;
Butabayeva, Arailym ;
Zheng, Rui ;
Golkarifard, Morteza ;
Hui, Pan .
PROCEEDINGS OF THE 8TH ACM MULTIMEDIA SYSTEMS CONFERENCE (MMSYS'17), 2017, :284-295
[9]   ReadMe: A Real-Time Recommendation System for Mobile Augmented Reality Ecosystems [J].
Chatzopoulos, Dimitris ;
Hui, Pan .
MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, :312-316
[10]  
Conti M., 2018, INTERNET THINGS SECU