3D-PSSIM: Projective Structural Similarity for 3D Mesh Quality Assessment Robust to Topological Irregularities

被引:0
作者
Lee, Seongmin [1 ]
Kang, Jiwoo [2 ]
Lee, Sanghoon [1 ]
Lin, Weisi [3 ]
Bovik, Alan Conrad [4 ]
机构
[1] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
[2] Sookmyung Womens Univ, Div Artificial Intelligence Engn, Seoul 04310, South Korea
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[4] Univ Texas Austin, Dept Elect & Comp Engn, Lab Image & Video Engn, Austin, TX 78712 USA
基金
新加坡国家研究基金会;
关键词
3D mesh quality assessment; projective structural similarity; topology robust mesh quality assessment; POINT CLOUD QUALITY; VISUAL QUALITY; ERROR;
D O I
10.1109/TPAMI.2024.3422490
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite acceleration in the use of 3D meshes, it is difficult to find effective mesh quality assessment algorithms that can produce predictions highly correlated with human subjective opinions. Defining mesh quality features is challenging due to the irregular topology of meshes, which are defined on vertices and triangles. To address this, we propose a novel 3D projective structural similarity index (3D-PSSIM) for meshes that is robust to differences in mesh topology. We address topological differences between meshes by introducing multi-view and multi-layer projections that can densely represent the mesh textures and geometrical shapes irrespective of mesh topology. It also addresses occlusion problems that occur during projection. We propose visual sensitivity weights that capture the perceptual sensitivity to the degree of mesh surface curvature. 3D-PSSIM computes perceptual quality predictions by aggregating quality-aware features that are computed in multiple projective spaces onto the mesh domain, rather than on 2D spaces. This allows 3D-PSSIM to determine which parts of a mesh surface are distorted by geometric or color impairments. Experimental results show that 3D-PSSIM can predict mesh quality with high correlation against human subjective judgments, across the presence of noise, even when there are large topological differences, outperforming existing mesh quality assessment models.
引用
收藏
页码:9595 / 9611
页数:17
相关论文
共 80 条
[41]   Visual Saliency and Quality Evaluation for 3D Point Clouds and Meshes: An Overview [J].
Lin, Weisi ;
Lee, Sanghoon .
APSIPA TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING, 2022, 11 (01)
[42]   PQA-Net: Deep No Reference Point Cloud Quality Assessment via Multi-View Projection [J].
Liu, Qi ;
Yuan, Hui ;
Su, Honglei ;
Liu, Hao ;
Wang, Yu ;
Yang, Huan ;
Hou, Junhui .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (12) :4645-4660
[43]  
Luebke D., 2002, Level of detail for 3D graphics
[44]   Intrinsic and Isotropic Resampling for 3D Point Clouds [J].
Lv, Chenlei ;
Lin, Weisi ;
Zhao, Baoquan .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (03) :3274-3291
[45]   Adaptively Isotropic Remeshing Based on Curvature Smoothed Field [J].
Lv, Chenlei ;
Lin, Weisi ;
Zheng, Jianmin .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2024, 30 (07) :3196-3209
[46]   3D Mesh Compression: Survey, Comparisons, and Emerging Trends [J].
Maglo, Adrien ;
Lavoue, Guillaume ;
Dupont, Florent ;
Hudelot, Celine .
ACM COMPUTING SURVEYS, 2015, 47 (03)
[47]   EFFECTS OF A VISUAL FIDELITY CRITERION ON ENCODING OF IMAGES [J].
MANNOS, JL ;
SAKRISON, DJ .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1974, 20 (04) :525-536
[48]   HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions [J].
Mantiuk, Rafal ;
Kim, Kil Joong ;
Rempel, Allan G. ;
Heidrich, Wolfgang .
ACM TRANSACTIONS ON GRAPHICS, 2011, 30 (04)
[49]   PCQM: A Full-Reference Quality Metric for Colored 3D Point Clouds [J].
Meynet, Gabriel ;
Nehme, Yana ;
Digne, Julie ;
Lavoue, Guillaume .
2020 TWELFTH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE (QOMEX), 2020,
[50]   Gradient of B-splines in volume rendering [J].
Mihajlovic, Z ;
Budin, L ;
Radej, J .
MELECON 2004: PROCEEDINGS OF THE 12TH IEEE MEDITERRANEAN ELECTROTECHNICAL CONFERENCE, VOLS 1-3, 2004, :239-242