Lending A Hand: Detecting Hands and Recognizing Activities in Complex Egocentric Interactions

被引:276
作者
Bambach, Sven [1 ]
Lee, Stefan [1 ]
Crandall, David J. [1 ]
Yu, Chen [2 ]
机构
[1] Indiana Univ, Sch Informat & Comp, Bloomington, IN 47405 USA
[2] Indiana Univ, Psychol & Brain Sci, Bloomington, IN 47405 USA
来源
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV) | 2015年
基金
美国国家科学基金会;
关键词
D O I
10.1109/ICCV.2015.226
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Hands appear very often in egocentric video, and their appearance and pose give important cues about what people are doing and what they are paying attention to. But existing work in hand detection has made strong assumptions that work well in only simple scenarios, such as with limited interaction with other people or in lab settings. We develop methods to locate and distinguish between hands in egocentric video using strong appearance models with Convolutional Neural Networks, and introduce a simple candidate region generation approach that outperforms existing techniques at a fraction of the computational cost. We show how these high-quality bounding boxes can be used to create accurate pixelwise hand regions, and as an application, we investigate the extent to which hand segmentation alone can distinguish between different activities. We evaluate these techniques on a new dataset of 48 first-person videos of people interacting in realistic environments, with pixel-level ground truth for over 15,000 hand instances.
引用
收藏
页码:1949 / 1957
页数:9
相关论文
共 33 条
[1]   Measuring the Objectness of Image Windows [J].
Alexe, Bogdan ;
Deselaers, Thomas ;
Ferrari, Vittorio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2189-2202
[2]  
[Anonymous], CVPR WORKSH
[3]  
[Anonymous], P CHI
[4]  
[Anonymous], ICDL EPIROB
[5]  
[Anonymous], NY TIMES
[6]  
[Anonymous], NY TIMES
[7]  
[Anonymous], CVPR WORKSH
[8]  
[Anonymous], CVPR WORKSH
[9]  
[Anonymous], 2011, CVPR
[10]  
[Anonymous], ECCV WORKSH