3-D Facial Landmarks Detection for Intelligent Video Systems

被引:14
|
作者
Hoang, Van-Thanh [1 ]
Huang, De-Shuang [2 ]
Jo, Kang-Hyun [3 ,4 ]
机构
[1] Univ Ulsan, Grad Sch Elect Engn, Elect & Comp Engn, Ulsan 44610, South Korea
[2] Tongji Univ, Sch Elect & Informat Engn, Inst Machine Learning & Syst Biol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai, Peoples R China
[4] Univ Ulsan, Sch Elect Engn, Ulsan, South Korea
关键词
Face; Three-dimensional displays; Detectors; Computer architecture; Convolution; Task analysis; Computational modeling; Convolution block; convolutional neural network (CNN); facial landmarks; stacked hourglass;
D O I
10.1109/TII.2020.2966513
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial landmark detection is a fundamental research topic in computer vision that is widely adopted in many applications. Recently, thanks to the development of convolutional neural networks, this topic has been largely improved. This article proposes facial-landmark detector, which is based on a state-of-the-art architecture for landmark localization called stacked hourglass network, to obtain accurate facial landmark-points. More specifically, this article uses residual networks as the backbone instead of a 7 x 7 convolution layer. Additionally, it modifies the hourglass modules by using the residual-dense blocks in the mainstream for capturing more efficient features and the 1 x 1 convolution layers in the branch streams for reducing the model size and computational time, instead of the original residual blocks. The proposed architecture also enhances the features from modified hourglass modules with finer-resolution features via a lateral connection to generate more accurate results. The proposed network can outperform other state-of-the-art methods on the AFLW2000-3D dataset and the LS3D-W dataset, the largest three-dimensional (3-D face) alignment dataset to date.
引用
收藏
页码:578 / 586
页数:9
相关论文
共 50 条
  • [31] 3-D Neighborhood Cross-Differencing: A New Paradigm Serves Remote Sensing Change Detection
    Jing, Wei
    Chi, Kaichen
    Li, Qiang
    Wang, Qi
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [32] OctreeNet: A Novel Sparse 3-D Convolutional Neural Network for Real-Time 3-D Outdoor Scene Analysis
    Wang, Fei
    Zhuang, Yan
    Gu, Hong
    Hu, Huosheng
    IEEE TRANSACTIONS ON AUTOMATION SCIENCE AND ENGINEERING, 2020, 17 (02) : 735 - 747
  • [33] Reliability of personal identification base on optical 3D measurement of a few facial landmarks
    Zappa, Emanuele
    Mazzoleni, Paolo
    ICCS 2010 - INTERNATIONAL CONFERENCE ON COMPUTATIONAL SCIENCE, PROCEEDINGS, 2010, 1 (01): : 2763 - 2771
  • [34] 3-D Convolutional Neural Networks for RGB-D Salient Object Detection and Beyond
    Chen, Qian
    Zhang, Zhenxi
    Lu, Yanye
    Fu, Keren
    Zhao, Qijun
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (03) : 4309 - 4323
  • [35] 3-D Point Cloud Map Compression for Connected Intelligent Vehicles
    Choi, Youngjoon
    Baek, Hannah
    Jeong, Jinseop
    Kim, Kanghee
    IEEE INTERNET COMPUTING, 2024, 28 (01) : 53 - 60
  • [36] 3-D Facial Expression Recognition via Attention-Based Multichannel Data Fusion Network
    Gu, Yu
    Yan, Huan
    Zhang, Xiang
    Liu, Zhi
    Ren, Fuji
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
  • [37] Diversity Knowledge Distillation for LiDAR-Based 3-D Object Detection
    Ning, Kanglin
    Liu, Yanfei
    Su, Yanzhao
    Jiang, Ke
    IEEE SENSORS JOURNAL, 2023, 23 (11) : 11181 - 11193
  • [38] A new method for automatic tracking of facial landmarks in 3D motion captured images (4D)
    Al-Anezi, T.
    Khambay, B.
    Peng, M. J.
    O'Leary, E.
    Ju, X.
    Ayoub, A.
    INTERNATIONAL JOURNAL OF ORAL AND MAXILLOFACIAL SURGERY, 2013, 42 (01) : 9 - 18
  • [39] 3-D Object Detection With Balanced Prediction Based on Contrastive Point Loss
    Tong, Jiaxun
    Liu, Kaiqi
    Bai, Xia
    Li, Wei
    IEEE SENSORS JOURNAL, 2024, 24 (04) : 4969 - 4977
  • [40] Point-Guided Contrastive Learning for Monocular 3-D Object Detection
    Feng, Dapeng
    Han, Songfang
    Xu, Hang
    Liang, Xiaodan
    Tan, Xiaojun
    IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (02) : 954 - 966