Wide Range Head Pose Estimation Using a Single RGB Camera for Intelligent Surveillance

被引:12
|
作者
Rahmaniar, Wahyu [1 ]
ul Haq, Qazi Mazhar [1 ]
Lin, Ting-Lan [1 ,2 ]
机构
[1] Natl Taipei Univ Technol, Dept Elect Engn, Taipei 10608, Taiwan
[2] Chung Yuan Christian Univ, Dept Elect Engn, Taoyuan 320314, Taiwan
关键词
Head; Pose estimation; Feature extraction; Three-dimensional displays; Magnetic heads; Deep learning; Real-time systems; CNN; coarse-fine classification; deep learning; Euler angle; head pose estimation; intelligent surveillance;
D O I
10.1109/JSEN.2022.3168863
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Head pose estimation is one of the sensing systems needed for some intelligent surveillance, such as human behavior analysis, intelligent driver assistance, visual attention, and monitoring. These systems require accurate alignment and head movement direction prediction. The previous methods are greatly dependent on the facial landmarks and depth information. Usually, the head pose is measured by estimating several keypoints that require a correct head pose mapping to get accurate results. Moreover, facial landmarks have a detrimental effect on performance when the face is occluded or not adequately visualized. This paper proposes a method for head pose estimation of various facial conditions, such as occlusion and challenging viewpoints. We present a combination of coarse and fine feature maps classification to train a multi-loss deep Convolutional Neural Networks (CNN) to get precise Euler angles (yaw, pitch, roll) of the head position without keypoints and landmarks. Our proposed method uses more quantization units for angle classification to learn coarse and fine structure mapping for better spatial clustering features on an RGB image of a single camera. The experiments are performed on benchmark datasets and some head poses in real cases. The mean average error of prediction is 5.06 degrees, 4.06 degrees, and 2.96 degrees, for the AFLW2000, AFLW, and BIWI datasets, which significantly improves the head pose estimation performance compared to the previous methods. Additionally, the proposed method outperforms previous approaches in computation time of 11 frames per second that is beneficial for real-life applications.
引用
收藏
页码:11112 / 11121
页数:10
相关论文
共 50 条
  • [41] Reliable pose estimation of underwater dock using single camera: a scene invariant approach
    Ghosh, Shatadal
    Ray, Ranjit
    Vadali, Siva Ram Krishna
    Shome, Sankar Nath
    Nandy, Sambhunath
    MACHINE VISION AND APPLICATIONS, 2016, 27 (02) : 221 - 236
  • [42] Head Pose Estimation Method of Eye Tracker Based on Binocular Camera
    Han Junjie
    Luo Kaiqing
    Qiu Jian
    Liu Dongmei
    Peng Li
    Han Peng
    LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
  • [43] Reliable pose estimation of underwater dock using single camera: a scene invariant approach
    Shatadal Ghosh
    Ranjit Ray
    Siva Ram Krishna Vadali
    Sankar Nath Shome
    Sambhunath Nandy
    Machine Vision and Applications, 2016, 27 : 221 - 236
  • [44] Robust Orthogonal Iteration Algorithm for Single Camera Pose Estimation
    Zhang Xiongfeng
    Liu Haibo
    Shang Yang
    ACTA OPTICA SINICA, 2019, 39 (09)
  • [45] Pose estimation from four corresponding points with a single camera
    Wang, Peng
    Zhou, Yongjun
    Zhang, Qiuzi
    OPTICAL METROLOGY AND INSPECTION FOR INDUSTRIAL APPLICATIONS, 2010, 7855
  • [46] An Efficient Face Detector on a CPU Using Dual-Camera Sensors for Intelligent Surveillance Systems
    Putro, Muhamad Dwisnanto
    Duy-Linh Nguyen
    Kang-Hyun Jo
    IEEE SENSORS JOURNAL, 2022, 22 (01) : 565 - 574
  • [47] Triticale field phenotyping using RGB camera for ear counting and yield estimation
    Piotr Stefański
    Sajid Ullah
    Przemysław Matysik
    Krystyna Rybka
    Journal of Applied Genetics, 2024, 65 : 271 - 281
  • [48] Head Pose Estimation Using Deep Architectures
    Felea, Iulian-Ionut
    Florea, Laura
    Florea, Corneliu
    Vertan, Constantin
    2018 12TH INTERNATIONAL CONFERENCE ON COMMUNICATIONS (COMM), 2018, : 505 - 508
  • [49] Head pose estimation in the wild using Convolutional Neural Networks and adaptive gradient methods
    Patacchiola, Massimiliano
    Cangelosi, Angelo
    PATTERN RECOGNITION, 2017, 71 : 132 - 143
  • [50] HEAD POSE ESTIMATION USING LEARNED DISCRETIZATION
    Kim, Se Yeon
    Spurlock, Scott
    Souvenir, Richard
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2687 - 2691