A Small-Scale Image U-Net-Based Color Quality Enhancement for Dense Point Cloud

被引:3
作者
Xing, Jinrui [1 ]
Yuan, Hui [1 ]
Zhang, Wei [2 ]
Guo, Tian [1 ]
Chen, Chen [1 ]
机构
[1] Shandong Univ, Sch Control Sci & Engn, Jinan 250061, Peoples R China
[2] Xidian Univ, Sch Telecommun Engn, Xian 710071, Peoples R China
基金
中国国家自然科学基金;
关键词
Point cloud compression; Three-dimensional displays; Image color analysis; Geometry; Image reconstruction; Image coding; Neural networks; Quality enhancement; dense point cloud; deep learning; compression artifacts removal; COMPRESSION;
D O I
10.1109/TCE.2024.3367539
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Efficient compression for 3D point clouds is crucial due to their massive data volume. Quality enhancement can significantly improve the compression efficiency of 3D point clouds. In this study, we propose a neural network-based quality enhancement method for color attributes of dense 3D point cloud. Our approach involves the extraction of 3D patches from an input distorted point cloud, followed by their conversion into 2D images using a specific scan order. We then propose an efficient U-Net-inspired neural network, namely SSIU-Net, to enhance the quality of these 2D images. Finally, the processed 2D images are converted back to 3D patches, allowing for the point cloud reconstruction. Experimental results demonstrate that the proposed method, when implemented in both G-PCC and V-PCC, achieves competitive results. For example, 0.146 dB, 0.417dB and 0.270 dB PSNR gains can be achieved for Luma (Y), Chroma difference of blue (Cb) and Chroma difference of red (Cr) components compared with G-PCC, corresponding to 4.1%, 9.4% and 12.5% BD-rate savings. The source code is available at https://github.com/xjr998/SSIU.
引用
收藏
页码:669 / 683
页数:15
相关论文
共 43 条
[1]   Video-Based Point Cloud Compression Artifact Removal [J].
Akhtar, Anique ;
Gao, Wen ;
Li, Li ;
Li, Zhu ;
Jia, Wei ;
Liu, Shan .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :2866-2876
[2]  
[Anonymous], 2020, document ISO/IEC JTCI/SC29 WG11 N19331
[3]  
[Anonymous], 2020, G-PCC Metric
[4]  
Bjontegaard G., 2001, document SG16 VCEG-M33
[5]  
Brown T., 2020, P 34 C ADV NEUR INF, P1877, DOI DOI 10.48550/ARXIV.2005.14165
[6]   RePCD-Net: Feature-Aware Recurrent Point Cloud Denoising Network [J].
Chen, Honghua ;
Wei, Zeyong ;
Li, Xianzhi ;
Xu, Yabin ;
Wei, Mingqiang ;
Wang, Jun .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2022, 130 (03) :615-629
[7]  
Chen T.-W., 2022, PROC IEEE INT C CONS, P1
[8]   Layered Projection-Based Quality Assessment of 3D Point Clouds [J].
Chen, Tianxin ;
Long, Chunyi ;
Su, Honglei ;
Chen, Lijun ;
Chi, Jieru ;
Pan, Zhenkuan ;
Yang, Huan ;
Liu, Yuxin .
IEEE ACCESS, 2021, 9 :88108-88120
[9]   A Convolutional Neural Network Approach for Post-Processing in HEVC Intra Coding [J].
Dai, Yuanying ;
Liu, Dong ;
Wu, Feng .
MULTIMEDIA MODELING (MMM 2017), PT I, 2017, 10132 :28-39
[10]   Compression of 3D Point Clouds Using a Region-Adaptive Hierarchical Transform [J].
de Queiroz, Ricardo L. ;
Chou, Philip A. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (08) :3947-3956