Objective evaluation of approaches of skin detection using ROC analysis

被引:31
作者
Schmugge, Stephen J.
Jayaram, Sriram
Shin, Min C.
Tsap, Leonid V.
机构
[1] Univ N Carolina, Dept Comp Sci, Charlotte, NC 28223 USA
[2] Lawrence Livermore Natl Lab, Dept Elect Engn, Syst Res Grp, Livermore, CA 94551 USA
关键词
skin detection; colorspace transformation; empirical evaluation;
D O I
10.1016/j.cviu.2006.10.009
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Skin detection is an important indicator of human presence and actions in many domains, including interaction, interfaces and security. It is commonly performed in three steps: transforming the pixel color to a non-RGB colorspace, dropping the illuminance component of skin color, and classifying by modeling the skin color distribution. In this paper, we evaluate the effect of these three steps on the skin detection performance. The importance of this study is a new comprehensive colorspace and color modeling testing methodology that would allow for making the best choices for skin detection. Combinations of nine colorspaces, the presence or the absence of the illuminance component, and the two color modeling approaches are compared for different settings (indoor or outdoor) and modeling parameters (the histogram size). The performance is measured by using a receiver operating characteristic (ROC) curve on a large dataset of 845 images (consisting more than 18.6 million pixels) with manual ground truth. The results reveal that (1) colorspace transformations can improve performance in certain instances, (2) the absence of the illuminance component decreases performance, and (3) skin color modeling has a greater impact than colorspace transformation. We found that the best performance was obtained on indoor images by transforming the pixel color to the HSI or SCT colorspaces, keeping the illuminance component, and modeling the color with the histogram approach using a larger size distribution. (C) 2007 Elsevier Inc. All rights reserved.
引用
收藏
页码:41 / 51
页数:11
相关论文
共 29 条
[11]   Face Detection Using Quantized Skin Color Regions Merging and Wavelet Packet Analysis [J].
Garcia, Christophe ;
Tziritas, Georgios .
IEEE TRANSACTIONS ON MULTIMEDIA, 1999, 1 (03) :264-277
[12]  
Gonzalez R., 2019, Digital Image Processing, V2nd
[13]   Face detection in color images [J].
Hsu, RL ;
Abdel-Mottaleb, M ;
Jain, AK .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (05) :696-706
[14]  
Jayaram S, 2004, P IEEE C COMP VIS PA
[15]   Statistical color models with application to skin detection [J].
Jones, MJ ;
Rehg, JM .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2002, 46 (01) :81-96
[16]   Physics-based face database for color research [J].
Marszalec, E ;
Martinkauppi, B ;
Soriano, M ;
Pietikäinen, M .
JOURNAL OF ELECTRONIC IMAGING, 2000, 9 (01) :32-38
[17]  
Ohtsuki T, 1998, J IMAGING SCI TECHN, V42, P554
[18]   LAFTER: Lips and face real time tracker [J].
Oliver, N ;
Pentland, AP ;
Berard, F .
1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :123-129
[19]  
POWELL MW, 1999, P IEEE WORKSH PHOT M, P21
[20]  
Poynton C., FREQUENTLY ASKED QUE