3-D Facial Landmarks Detection for Intelligent Video Systems

被引:14
|
作者
Hoang, Van-Thanh [1 ]
Huang, De-Shuang [2 ]
Jo, Kang-Hyun [3 ,4 ]
机构
[1] Univ Ulsan, Grad Sch Elect Engn, Elect & Comp Engn, Ulsan 44610, South Korea
[2] Tongji Univ, Sch Elect & Informat Engn, Inst Machine Learning & Syst Biol, Shanghai 201804, Peoples R China
[3] Tongji Univ, Shanghai, Peoples R China
[4] Univ Ulsan, Sch Elect Engn, Ulsan, South Korea
关键词
Face; Three-dimensional displays; Detectors; Computer architecture; Convolution; Task analysis; Computational modeling; Convolution block; convolutional neural network (CNN); facial landmarks; stacked hourglass;
D O I
10.1109/TII.2020.2966513
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Facial landmark detection is a fundamental research topic in computer vision that is widely adopted in many applications. Recently, thanks to the development of convolutional neural networks, this topic has been largely improved. This article proposes facial-landmark detector, which is based on a state-of-the-art architecture for landmark localization called stacked hourglass network, to obtain accurate facial landmark-points. More specifically, this article uses residual networks as the backbone instead of a 7 x 7 convolution layer. Additionally, it modifies the hourglass modules by using the residual-dense blocks in the mainstream for capturing more efficient features and the 1 x 1 convolution layers in the branch streams for reducing the model size and computational time, instead of the original residual blocks. The proposed architecture also enhances the features from modified hourglass modules with finer-resolution features via a lateral connection to generate more accurate results. The proposed network can outperform other state-of-the-art methods on the AFLW2000-3D dataset and the LS3D-W dataset, the largest three-dimensional (3-D face) alignment dataset to date.
引用
收藏
页码:578 / 586
页数:9
相关论文
共 50 条
  • [41] Automated pain detection using STA-LSTM on facial landmarks
    Du, Tiehua
    Choo, Keng Wah
    Kong, Wai Ming
    Tan, Chin Wen
    Teo, Jing Chun
    Chan, Diana
    Sng, Ban Leong
    2024 8TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS, METAHEURISTICS & SWARM INTELLIGENCE, ISMSI 2024, 2024, : 36 - 40
  • [42] Drivers' Visual Distraction Detection Using Facial Landmarks and Head Pose
    Zhang, Shile
    Abdel-Aty, Mohamed
    TRANSPORTATION RESEARCH RECORD, 2022, 2676 (09) : 491 - 501
  • [43] Comprehensive Physical Design Flow Incorporating 3-D Connections for Monolithic 3-D ICs
    Kim, Suwan
    Park, Heechun
    IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2024, 43 (07) : 1944 - 1956
  • [44] A 3-D assisted generative model for facial texture super-resolution
    Mortazavian, Pouria
    Kittler, Josef
    Christmas, William
    2009 IEEE 3RD INTERNATIONAL CONFERENCE ON BIOMETRICS: THEORY, APPLICATIONS AND SYSTEMS, 2009, : 452 - 458
  • [45] MonoLI: Precise Monocular 3-D Object Detection for Next-Generation Consumer Electronics for Autonomous Electric Vehicles
    Gao, Honghao
    Yu, Xinxin
    Xu, Yueshen
    Kim, Jung Yoon
    Wang, Ye
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2024, 70 (01) : 3475 - 3486
  • [46] InversionNet3D: Efficient and Scalable Learning for 3-D Full-Waveform Inversion
    Zeng, Qili
    Feng, Shihang
    Wohlberg, Brendt
    Lin, Youzuo
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [47] Video-Based Air Quality Measurement With Dual-Channel 3-D Convolutional Network
    Wang, Zhenyu
    Yue, Shaolong
    Song, Chunfeng
    IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (18): : 14372 - 14384
  • [48] FM-3DFR: Facial Manipulation-Based 3-D Face Reconstruction
    Zhao, Shuwen
    Wang, Xinming
    Zhang, Dinghuang
    Zhang, Gongyue
    Wang, Zhiyong
    Liu, Honghai
    IEEE TRANSACTIONS ON CYBERNETICS, 2024, 54 (01) : 209 - 218
  • [49] 3-D Vision and Intelligent Online Inspection in SMT Microelectronic Packaging: A Review
    Li, Ting
    Wang, Shiyong
    Luo, Yongchao
    Wan, Jiafu
    Luo, Ziren
    Chen, Minghao
    IEEE JOURNAL OF EMERGING AND SELECTED TOPICS IN INDUSTRIAL ELECTRONICS, 2024, 5 (02): : 779 - 789
  • [50] Bidirectional Guided Attention Network for 3-D Semantic Detection of Remote Sensing Images
    Rao, Zhibo
    He, Mingyi
    Zhu, Zhidong
    Dai, Yuchao
    He, Renjie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (07): : 6138 - 6153