Toward Communication-Efficient Digital Twin via AI-Powered Transmission and Reconstruction

被引:11
作者
Li, Mi [1 ]
Chen, Cen [2 ,3 ]
Yang, Xulei [4 ]
Zhou, Joey Tianyi [5 ,6 ]
Zhang, Tao [7 ]
Li, Yangfan [8 ]
机构
[1] Jiaxing Univ, Coll Informat Sci & Engn, Jiaxing 314001, Peoples R China
[2] South China Univ Technol, Sch Future Technol, Guangzhou 510641, Peoples R China
[3] Hunan Univ, Shenzhen Inst, Changsha 410082, Peoples R China
[4] ASTAR, Inst Infocomm Res I2R, Singapore 138632, Singapore
[5] ASTAR, Ctr Frontier AI Res CFAR, Singapore 138632, Singapore
[6] ASTAR, Inst High Performance Comp IHPC, Singapore 138632, Singapore
[7] Changsha Univ, Sch Comp Sci & Engn, Changsha 410022, Peoples R China
[8] Cent South Univ, Sch Comp Sci & Engn, Changsha 410083, Peoples R China
关键词
Point cloud compression; Digital twins; Three-dimensional displays; Image reconstruction; Wireless communication; Image coding; Symbols; Communication-efficient; digital twin; deep neural networks; point cloud; POINT CLOUD;
D O I
10.1109/JSAC.2023.3310089
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Digital twin technology has recently gathered pace in engineering communities as it allows for the convergence of the real structure and its digital counterpart. 3D point cloud data is a more effective way to describe the real world and to reconstruct the digital counterpart than the conventional 2D images or 360-degree images. Large-scale, e.g., city-scale digital twins, typically collect point cloud data via internet-of-things (IoT) devices and transmit it over wireless networks. However, the existing wireless transmission technology can not carry real-time point cloud transmission for digital twin reconstruction due to mass data volume, high processing overheads, and low delay-tolerance. We propose a novel artificial intelligence (AI) powered end-to-end framework, termed AIRec, for efficient digital twin communication from point cloud compression, wireless channel coding, and digital twin reconstruction. AIRec adopts the encoder-decoder architecture. In the encoder, a novel importance-aware pooling scheme is designed to adaptively select important points with learnable thresholds to reduce the transmission volume. We also design a novel noise-aware joint source and channel coding is proposed to adaptively adjust the transmission strategy based on SNR and map the features to error-resilient channel symbols for wireless transmission to achieve a good tradeoff between the transmission rate and reconstruction quality. The decoder can accurately reconstruct the digital twins from the received symbols. Extensive experiments of typical datasets and comparison with baselines show that we achieve a good reconstruction quality under 24x compression ratio.
引用
收藏
页码:3624 / 3635
页数:12
相关论文
共 46 条
[1]   A Benchmark for Surface Reconstruction [J].
Berger, Matthew ;
Levine, Joshua A. ;
Nonato, Luis Gustavo ;
Taubin, Gabriel ;
Silva, Claudio T. .
ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (02)
[2]   Deep Joint Source-Channel Coding for Wireless Image Transmission [J].
Bourtsoulatze, Eirina ;
Kurka, David Burth ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (03) :567-579
[3]  
Brock A, 2016, Arxiv, DOI arXiv:1608.04236
[4]  
Burrough PA., 2015, Principles of geographical information systems, DOI DOI 10.2307/144481
[5]  
Burth Kurka D., 2020, INT ZUR SEM INF COMM, P90
[6]   Optimum design of chamfer distance transforms [J].
Butt, MA ;
Maragos, P .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 1998, 7 (10) :1477-1484
[7]   Photogrammetric Point Cloud Segmentation and Object Information Extraction for Creating Virtual Environments and Simulations [J].
Chen, Meida ;
Feng, Andrew ;
McAlinden, Ryan ;
Soibelman, Lucio .
JOURNAL OF MANAGEMENT IN ENGINEERING, 2020, 36 (02)
[8]   A Volumetric Approach to Point Cloud Compression-Part I: Attribute Compression [J].
Chou, Philip A. ;
Koroteev, Maxim ;
Krivokuca, Maja .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :2203-2216
[9]   Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis [J].
Dai, Angela ;
Qi, Charles Ruizhongtai ;
Niessner, Matthias .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :6545-6554
[10]   Cloud-Based Digital Twinning for Structural Health Monitoring Using Deep Learning [J].
Dang, Hung ;
Tatipamula, Mallik ;
Nguyen, Huan Xuan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (06) :3820-3830