3D-PSSIM: Projective Structural Similarity for 3D Mesh Quality Assessment Robust to Topological Irregularities

被引:0
作者
Lee, Seongmin [1 ]
Kang, Jiwoo [2 ]
Lee, Sanghoon [1 ]
Lin, Weisi [3 ]
Bovik, Alan Conrad [4 ]
机构
[1] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
[2] Sookmyung Womens Univ, Div Artificial Intelligence Engn, Seoul 04310, South Korea
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[4] Univ Texas Austin, Dept Elect & Comp Engn, Lab Image & Video Engn, Austin, TX 78712 USA
基金
新加坡国家研究基金会;
关键词
3D mesh quality assessment; projective structural similarity; topology robust mesh quality assessment; POINT CLOUD QUALITY; VISUAL QUALITY; ERROR;
D O I
10.1109/TPAMI.2024.3422490
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite acceleration in the use of 3D meshes, it is difficult to find effective mesh quality assessment algorithms that can produce predictions highly correlated with human subjective opinions. Defining mesh quality features is challenging due to the irregular topology of meshes, which are defined on vertices and triangles. To address this, we propose a novel 3D projective structural similarity index (3D-PSSIM) for meshes that is robust to differences in mesh topology. We address topological differences between meshes by introducing multi-view and multi-layer projections that can densely represent the mesh textures and geometrical shapes irrespective of mesh topology. It also addresses occlusion problems that occur during projection. We propose visual sensitivity weights that capture the perceptual sensitivity to the degree of mesh surface curvature. 3D-PSSIM computes perceptual quality predictions by aggregating quality-aware features that are computed in multiple projective spaces onto the mesh domain, rather than on 2D spaces. This allows 3D-PSSIM to determine which parts of a mesh surface are distorted by geometric or color impairments. Experimental results show that 3D-PSSIM can predict mesh quality with high correlation against human subjective judgments, across the presence of noise, even when there are large topological differences, outperforming existing mesh quality assessment models.
引用
收藏
页码:9595 / 9611
页数:17
相关论文
共 80 条
[71]  
Wang Z, 2002, INT CONF ACOUST SPEE, P3313
[72]  
WANG Z., 2004, IMAGE PROCESSING IEE, V13, P600
[73]   Mean Squared Error: Love It or Leave It? A new look at signal fidelity measures [J].
Wang, Zhou ;
Bovik, Alan C. .
IEEE SIGNAL PROCESSING MAGAZINE, 2009, 26 (01) :98-117
[74]  
Wu ZR, 2015, PROC CVPR IEEE, P1912, DOI 10.1109/CVPR.2015.7298801
[75]   Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index [J].
Xue, Wufeng ;
Zhang, Lei ;
Mou, Xuanqin ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (02) :684-695
[76]   Inferring Point Cloud Quality via Graph Similarity [J].
Yang, Qi ;
Ma, Zhan ;
Xu, Yiling ;
Li, Zhu ;
Sun, Jun .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2022, 44 (06) :3015-3029
[77]   Single-View 3D Mesh Reconstruction for Seen and Unseen Categories [J].
Yang, Xianghui ;
Lin, Guosheng ;
Zhou, Luping .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :3746-3758
[78]   The Unreasonable Effectiveness of Deep Features as a Perceptual Metric [J].
Zhang, Richard ;
Isola, Phillip ;
Efros, Alexei A. ;
Shechtman, Eli ;
Wang, Oliver .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :586-595
[79]  
Zhang Z., 2021, P IEEE INT C MULT EX, P1
[80]   No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Models [J].
Zhang, Zicheng ;
Sun, Wei ;
Min, Xiongkuo ;
Wang, Tao ;
Lu, Wei ;
Zhai, Guangtao .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) :7618-7631