Real-Time Facial Feature Extraction Scheme Using Cascaded Networks

被引:0
作者
Kim, Hyeonwoo [1 ]
Kim, Hyungjoon [1 ]
Hwang, Eenjun [1 ]
机构
[1] Korea Univ, Sch Elect Engn, Seoul, South Korea
来源
2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA AND SMART COMPUTING (BIGCOMP) | 2019年
基金
新加坡国家研究基金会;
关键词
Facial landmarks; real-time extraction; MTCNN; face detection; face alignment; cascaded structure;
D O I
10.1109/bigcomp.2019.8679316
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Facial landmarks such as eyes, nose, and mouth are the most prominent feature points on the face. So far, many works have been done for efficiently extracting such landmarks from facial images. Utilizing more feature points for landmark extraction usually requires more processing time, which has been an obstacle to real-time processing or video processing. On the contrary, utilizing a too small number of feature points cannot represent diverse landmark properties such as shape accurately. In this paper, we propose a deep learning based method for extracting popular 68 feature points for facial landmarks quickly and accurately. To do that, we first detect all the faces in the image by using a cascaded structure composed of relatively light Convolution Neural Networks(CNN). Then, we perform facial landmark extraction for each face, which reduces the processing time a lot. We performed several experiments to evaluate the performance of our method. We report some of the results.
引用
收藏
页码:292 / 298
页数:7
相关论文
共 20 条
[1]  
[Anonymous], 2017, ARXIV170202719
[2]  
[Anonymous], 2016, PROC CVPR IEEE, DOI DOI 10.1109/CVPR.2016.596
[3]  
Ben-Hur A, 2001, ADV NEUR IN, V13, P367
[4]   Approaching human level facial landmark localization by deep learning [J].
Fan, Haoqiang ;
Zhou, Erjin .
IMAGE AND VISION COMPUTING, 2016, 47 :27-35
[5]   Face Detection, Bounding Box Aggregation and Pose Estimation for Robust Facial Landmark Localisation in the Wild [J].
Feng, Zhen-Hua ;
Kittler, Josef ;
Awais, Muhammad ;
Huber, Patrik ;
Wu, Xiao-Jun .
2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, :2106-2111
[6]  
Girshick R., 2014, IEEE COMP SOC C COMP, DOI [10.1109/CVPR.2014.81, DOI 10.1109/CVPR.2014.81]
[7]   Fast R-CNN [J].
Girshick, Ross .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1440-1448
[8]  
Hou QQ, 2015, IEEE IMAGE PROC, P1800, DOI 10.1109/ICIP.2015.7351111
[9]   An Intelligent Product Recommendation Model to Reflect the Recent Purchasing Patterns of Customers [J].
Kim, Haein ;
Yang, Geunho ;
Jung, Hosang ;
Lee, Sang Ho ;
Ahn, Jae Joon .
MOBILE NETWORKS & APPLICATIONS, 2019, 24 (01) :163-170
[10]  
King DE, 2009, J MACH LEARN RES, V10, P1755