Microwave Reconstruction of 3-D Human Facial Landmarks Using a Programmable Metasurface

被引:1
作者
Li, Mingyi [1 ]
Xu, Jiawen [1 ]
Cui, Tie Jun [2 ]
Li, Lianlin [3 ]
机构
[1] Peking Univ, Sch Elect, Beijing 100871, Peoples R China
[2] Southeast Univ, State Key Lab Millimeter Waves, Nanjing 210096, Peoples R China
[3] Peking Univ, Sch Elect, State Key Lab Adv Opt Commun Syst & Networks, Beijing 100871, Peoples R China
来源
IEEE ANTENNAS AND WIRELESS PROPAGATION LETTERS | 2024年 / 23卷 / 11期
关键词
Metasurfaces; Encoding; Three-dimensional displays; Microwave theory and techniques; Microwave imaging; Image reconstruction; Faces; Deep learning; facial reconstruction (FR); microwave imaging; programmable metasurface;
D O I
10.1109/LAWP.2024.3403686
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Nowadays, 3-D human facial reconstruction (FR) plays a pivotal role in various areas including human-robot interaction, virtual reality, identification, and so on. However, conventional FR strategies are largely based on optical sensors, and thus suffer from the intrinsic risk in terms of obstacle (e.g., mask) occlusion, light-condition dependence, privacy infringement, and so on. To tackle it, we here propose to leverage the microwave for the 3-D FR, by utilizing a fundamental fact that the microwave, unlike optics, is capable of operating in the conditions of all-weather, all-day, and occlusion. To this end, we design an inexpensive transceiver architecture based on a large-aperture programmable metasurface, enabling to capture fully the 3-D facial information of the subject, meanwhile suppressing the unwanted disturbances from surrounding environment and other body parts. Afterward, we design a deep artificial network for converting the microwave raw data into the 3-D coordinates of 68 facial landmarks. We fabricate a proof-of-principle prototype system working within the frequency range of (25 to 26.5) GHz, and experimentally demonstrate that the reported strategy is efficient in the reconstruction of 3-D human facial landmarks even for the subject wearing a mask.
引用
收藏
页码:3327 / 3331
页数:5
相关论文
共 27 条
[1]  
Abdel-Aziz Y.I., 1971, P S CLOS RANG PHOT
[2]   Wireless Communication Based on Information Metasurfaces [J].
Dai, Jun Yan ;
Tang, Wankai ;
Chen, Ming Zheng ;
Chan, Chi Hou ;
Cheng, Qiang ;
Jin, Shi ;
Cui, Tie Jun .
IEEE TRANSACTIONS ON MICROWAVE THEORY AND TECHNIQUES, 2021, 69 (03) :1493-1510
[3]   INTRODUCTION TO SUBSURFACE RADAR [J].
DANIELS, DJ ;
GUNTON, DJ ;
SCOTT, HF .
IEE PROCEEDINGS-F RADAR AND SIGNAL PROCESSING, 1988, 135 (04) :278-320
[4]  
Francis M. H., 2008, Modern Antenna Handbook, P929
[5]   Cross Modal Focal Loss for RGBD Face Anti-Spoofing [J].
George, Anjith ;
Marcel, Sebastien .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :7878-7887
[6]  
Grupp M., 2017, P ROBOT WORLD CUP, P121
[7]  
Hu J., 2018, P IEEE C COMP VIS PA, P7132
[8]   Efficient 3D reconstruction for face recognition [J].
Jiang, DL ;
Hu, YX ;
Yan, SC ;
Zhang, L ;
Zhang, HJ ;
Gao, W .
PATTERN RECOGNITION, 2005, 38 (06) :787-798
[9]   Electromagnetic reprogrammable coding-metasurface holograms [J].
Li, Lianlin ;
Cui, Tie Jun ;
Ji, Wei ;
Liu, Shuo ;
Ding, Jun ;
Wan, Xiang ;
Li, Yun Bo ;
Jiang, Menghua ;
Qiu, Cheng-Wei ;
Zhang, Shuang .
NATURE COMMUNICATIONS, 2017, 8
[10]   Efficient Wireless Power Transfer System Integrating With Metasurface for Biological Applications [J].
Li, Long ;
Liu, Haixia ;
Zhang, Huiying ;
Xue, Weiming .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2018, 65 (04) :3230-3239