3-D Facial Landmarks Detection for Intelligent Video Systems

被引:14
|
作者
Hoang, Van-Thanh [1 ]
Huang, De-Shuang [2 ]
Jo, Kang-Hyun [3 ,4 ]
机构
[1] Univ Ulsan, Grad Sch Elect Engn, Elect & Comp Engn, Ulsan 44610, South Korea
[2] Tongji Univ, Sch Elect & Informat Engn, Inst Machine Learning & Syst Biol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai, Peoples R China
[4] Univ Ulsan, Sch Elect Engn, Ulsan, South Korea
关键词
Face; Three-dimensional displays; Detectors; Computer architecture; Convolution; Task analysis; Computational modeling; Convolution block; convolutional neural network (CNN); facial landmarks; stacked hourglass;
D O I
10.1109/TII.2020.2966513
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial landmark detection is a fundamental research topic in computer vision that is widely adopted in many applications. Recently, thanks to the development of convolutional neural networks, this topic has been largely improved. This article proposes facial-landmark detector, which is based on a state-of-the-art architecture for landmark localization called stacked hourglass network, to obtain accurate facial landmark-points. More specifically, this article uses residual networks as the backbone instead of a 7 x 7 convolution layer. Additionally, it modifies the hourglass modules by using the residual-dense blocks in the mainstream for capturing more efficient features and the 1 x 1 convolution layers in the branch streams for reducing the model size and computational time, instead of the original residual blocks. The proposed architecture also enhances the features from modified hourglass modules with finer-resolution features via a lateral connection to generate more accurate results. The proposed network can outperform other state-of-the-art methods on the AFLW2000-3D dataset and the LS3D-W dataset, the largest three-dimensional (3-D face) alignment dataset to date.
引用
收藏
页码:578 / 586
页数:9
相关论文
共 50 条
  • [1] Microwave Reconstruction of 3-D Human Facial Landmarks Using a Programmable Metasurface
    Li, Mingyi
    Xu, Jiawen
    Cui, Tie Jun
    Li, Lianlin
    IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS, 2024, 23 (11): : 3327 - 3331
  • [2] 3-D HANet: A Flexible 3-D Heatmap Auxiliary Network for Object Detection
    Xia, Qiming
    Chen, Yidong
    Cai, Guorong
    Chen, Guikun
    Xie, Daoshun
    Su, Jinhe
    Wang, Zongyue
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [3] Reproducibility of facial soft tissue landmarks on 3D laser-scanned facial images
    Toma, A. M.
    Zhurov, A.
    Playle, R.
    Ong, E.
    Richmond, S.
    ORTHODONTICS & CRANIOFACIAL RESEARCH, 2009, 12 (01) : 33 - 42
  • [4] An Empirical Study of Ground Segmentation for 3-D Object Detection
    Yang, Hongcheng
    Liang, Dingkang
    Liu, Zhe
    Li, Jingyu
    Zou, Zhikang
    Ye, Xiaoqing
    Bai, Xiang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (03) : 3071 - 3083
  • [5] A new method for facial landmarks detection
    Peng, Xiaoning
    Zou, Beiji
    Wang, Lei
    CHINESE JOURNAL OF ELECTRONICS, 2009, 18 (01): : 74 - 78
  • [6] 3D facial expression modeling based on facial landmarks in single image
    Lv, Chenlei
    Wu, Zhongke
    Wang, Xingce
    Zhou, Mingquan
    NEUROCOMPUTING, 2019, 355 : 155 - 167
  • [7] 3-D RECONSTRUCTION FOR EVALUATION OF FACIAL TRAUMA
    ZINREICH, SJ
    AMERICAN JOURNAL OF NEURORADIOLOGY, 1992, 13 (03) : 893 - 895
  • [8] Enhancing Monocular 3-D Object Detection Through Data Augmentation Strategies
    Jia, Yisong
    Wang, Jue
    Pan, Huihui
    Sun, Weichao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73 : 1 - 11
  • [9] Face recognition for video surveillance with aligned facial landmarks learning
    Lin, Jirui
    Xiao, Laiyuan
    Wu, Tao
    TECHNOLOGY AND HEALTH CARE, 2018, 26 : S169 - S178
  • [10] 3-D Prostate MR and TRUS Images Detection and Segmentation for Puncture Biopsy
    Liu, Dong
    Wang, Long
    Du, Yu
    Cong, Ming
    Li, Yongyao
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2022, 71