A Study of the Frameworks for Digital Humans: Analyzing Facial Tracking evolution and New Research Directions with AI

被引：0

作者：

Vilchis, Carlos ^{[1
]}

Gonzalez-Mendoza, Miguel ^{[1
]}

Chang, Leonardo ^{[1
]}

Navarro-Tuch, Sergio A. ^{[1
]}

Ochoa Ruiz, Gilberto ^{[1
]}

Rudomin, Isaac ^{[2
]}

机构：

[1] Tecnol Monterrey, Sch Engn, Comp Sci Dept, Monterrey, Nuevo Leon, Mexico

[2] Univ Autonoma Metropolitana Cuajimalpa, Dept Tecnol Informac, Mexico City, DF, Mexico

来源：

PROCEEDINGS OF THE 17TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS (HUCAPP), VOL 2 | 2022年

关键词：

Motion Capture; Facial simulation; Human-Computer Interfaces; Avatars; FACS; Digital Humans; EMOTION; EXPRESSION;

D O I：

10.5220/0010823600003124

中图分类号：

TP3 [计算技术、计算机技术];

学科分类号：

0812 ;

摘要：

There actual scenario of techniques and methods to improve our perception of digitals humans is mostly oriented to increase alikeness and interactivity inside a helpful workflow. Breakthrough milestones have been achieved to improve facial expression recognition systems thanks to the effectiveness of Deep Neural Networks. This survey analyzes all the open and fully integrated frameworks (deep learning-based or not) available today. All of those can be replicated by peers to analyze their effectiveness and efficiency in real-time environments. Also, we present an overview analysis of present-day environments for digital humans that use state-of-the-art facial tracking and animation retargeting to settle a direction on the future steps in our research objectives in this field.

引用

页码：154 / 162

页数：9

共 56 条

[1] Blend Shape Interpolation and FACS for Realistic Avatar [J].

Alkawaz, Mohammed Hazim ;

Mohamad, Dzulkifli ;

Basori, Ahmad Hoirul ;

Saba, Tanzila .

3D RESEARCH, 2015, 6 (01)

[2] Realistic Facial Expression of Virtual Human Based on Color, Sweat, and Tears Effects [J].

Alkawaz, Mohammed Hazim ;

Basori, Ahmad Hoirul ;

Mohamad, Dzulkifli ;

Mohamed, Farhan .

SCIENTIFIC WORLD JOURNAL, 2014,

[3] HapFACS 3.0: FACS-Based Facial Expression Generator for 3D Speaking Virtual Characters [J].

Amini, Reza ;

Lisetti, Christine ;

Ruiz, Guido .

IEEE TRANSACTIONS ON AFFECTIVE COMPUTING, 2015, 6 (04) :348-360

[4] A High-Fidelity Open Embodied Avatar with Lip Syncing and Expression Capabilities [J].

Aneja, Deepali ;

McDuff, Daniel ;

Shah, Shital .

ICMI'19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION, 2019, :69-73

[5] Learning to Generate 3D Stylized Character Expressions from Humans [J].

Aneja, Deepali ;

Chaudhuri, Bindita ;

Colburn, Alex ;

Faigin, Gary ;

Shapiro, Linda ;

Mones, Barbara .

2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :160-169

[6] Modeling Stylized Character Expressions via Deep Learning [J].

Aneja, Deepali ;

Colburn, Alex ;

Faigin, Gary ;

Shapiro, Linda ;

Mones, Barbara .

COMPUTER VISION - ACCV 2016, PT II, 2017, 10112 :136-153

[7]

[Anonymous], 2016, ACM SIGGRAPH 2016 RE

[8] OpenFace 2.0: Facial Behavior Analysis Toolkit [J].

Baltrusaitis, Tadas ;

Zadeh, Amir ;

Lim, Yao Chong ;

Morency, Louis-Philippe .

PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, :59-66

[9] EmotioNet: An accurate, real-time algorithm for the automatic annotation of a million facial expressions in the wild [J].

Benitez-Quiroz, C. Fabian ;

Srinivasan, Ramprakash ;

Martinez, Aleix M. .

2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :5562-5570

[10]

Bhat K.S., 2013, P 12 ACM SIGGRAPH EU, P7

← 1 2 3 4 5 6 →