CanalSense: Face-Related Movement Recognition System based on Sensing Air Pressure in Ear Canals

被引:56
作者
Ando, Toshiyuki [1 ]
Kubo, Yuki [1 ]
Shizuki, Buntarou [1 ]
Takahashi, Shin [1 ]
机构
[1] Univ Tsukuba, Tennodai 1-1-1, Tsukuba, Ibaraki 3058573, Japan
来源
UIST'17: PROCEEDINGS OF THE 30TH ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY | 2017年
关键词
Jaw movement; mouth movement; facial movement; head movement; barometer; hands-free; eyes-free; earphones; outer ear interface; wearable computing;
D O I
10.1145/3126594.3126649
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We present a jaw, face, or head movement (face-related movement) recognition system called Canal:Sense. 11 recognizes face-related movements using barometers embedded in earphones. We find that face-related movements change air pressure inside the ear canals, which shows characteristic changes depending on the type and degree of the movement. We also find that such characteristic changes can be used to recognize face-related movements. We conduct an experiment to measure the accuracy of recognition. As a result, random forest shows per-user recognition accuracies of 87,6% for eleven face-related movements and 87.5% for four Open Month levels.
引用
收藏
页码:679 / 689
页数:11
相关论文
共 38 条
[1]  
[Anonymous], 2009, P 11 INT C HUM COMP, DOI DOI 10.1145/1613858.1613866
[2]  
[Anonymous], 2006, CHI 06 EXTENDED ABST, DOI DOI 10.1145/1125451.1125655
[3]  
Aoki Ken, 2010, Patent No. [JP-2010154985-A, 2010154985]
[4]  
Apple Inc, 2016, AIRPODS
[5]   Bitey: An Exploration of Tooth Click Gestures for Hands-Free User Interface Control [J].
Ashbrook, Daniel ;
Tejada, Carlos ;
Mehta, Dhwanit ;
Jiminez, Anthony ;
Muralitharam, Goudam ;
Gajendra, Sangeeta ;
Tallents, Ross .
PROCEEDINGS OF THE 18TH INTERNATIONAL CONFERENCE ON HUMAN-COMPUTER INTERACTION WITH MOBILE DEVICES AND SERVICES (MOBILEHCI'16), 2016, :158-169
[6]  
Bedri A., 2015, Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers, P1333, DOI DOI 10.1145/2800835
[7]   Detecting Mastication - A Wearable Approach [J].
Bedri, Abdelkareem ;
Verlekar, Apoorva ;
Thomaz, Edison ;
Avva, Valerie ;
Starner, Thad .
ICMI'15: PROCEEDINGS OF THE 2015 ACM INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2015, :247-250
[8]   Toward Silent-Speech Control of Consumer Wearables [J].
Bedri, Abdelkareem ;
Sahni, Himanshu ;
Thukral, Pavleen ;
Starner, Thad ;
Byrd, David ;
Presti, Peter ;
Reyes, Gabriel ;
Ghovanloo, Maysam ;
Guo, Zehua .
COMPUTER, 2015, 48 (10) :54-+
[9]   CONDYLAR DISPLACEMENT RECORDINGS AS AN ANALOG OF MANDIBULAR MOVEMENTS [J].
BRENMAN, HS ;
MACKOWIAK, RC ;
FRIEDMAN, MH .
JOURNAL OF DENTAL RESEARCH, 1968, 47 (04) :599-+
[10]   It's in Your Eyes - Towards Context-Awareness and Mobile HCI Using Wearable EOG Goggles [J].
Bulling, Andreas ;
Roggen, Daniel ;
Troester, Gerhard .
PROCEEDINGS OF THE 10TH INTERNATIONAL CONFERENCE ON UBIQUITOUS COMPUTING (UBICOMP 2008), 2008, :84-93