3D-PSSIM: Projective Structural Similarity for 3D Mesh Quality Assessment Robust to Topological Irregularities

被引:0
作者
Lee, Seongmin [1 ]
Kang, Jiwoo [2 ]
Lee, Sanghoon [1 ]
Lin, Weisi [3 ]
Bovik, Alan Conrad [4 ]
机构
[1] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
[2] Sookmyung Womens Univ, Div Artificial Intelligence Engn, Seoul 04310, South Korea
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[4] Univ Texas Austin, Dept Elect & Comp Engn, Lab Image & Video Engn, Austin, TX 78712 USA
基金
新加坡国家研究基金会;
关键词
3D mesh quality assessment; projective structural similarity; topology robust mesh quality assessment; POINT CLOUD QUALITY; VISUAL QUALITY; ERROR;
D O I
10.1109/TPAMI.2024.3422490
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Despite acceleration in the use of 3D meshes, it is difficult to find effective mesh quality assessment algorithms that can produce predictions highly correlated with human subjective opinions. Defining mesh quality features is challenging due to the irregular topology of meshes, which are defined on vertices and triangles. To address this, we propose a novel 3D projective structural similarity index (3D-PSSIM) for meshes that is robust to differences in mesh topology. We address topological differences between meshes by introducing multi-view and multi-layer projections that can densely represent the mesh textures and geometrical shapes irrespective of mesh topology. It also addresses occlusion problems that occur during projection. We propose visual sensitivity weights that capture the perceptual sensitivity to the degree of mesh surface curvature. 3D-PSSIM computes perceptual quality predictions by aggregating quality-aware features that are computed in multiple projective spaces onto the mesh domain, rather than on 2D spaces. This allows 3D-PSSIM to determine which parts of a mesh surface are distorted by geometric or color impairments. Experimental results show that 3D-PSSIM can predict mesh quality with high correlation against human subjective judgments, across the presence of noise, even when there are large topological differences, outperforming existing mesh quality assessment models.
引用
收藏
页码:9595 / 9611
页数:17
相关论文
共 80 条
[1]   Learning Graph Convolutional Network for Blind Mesh Visual Quality Assessment [J].
Abouelaziz, Ilyass ;
Chetouani, Aladine ;
El Hassouni, Mohammed ;
Cherifi, Hocine ;
Latecki, Longin Jan .
IEEE ACCESS, 2021, 9 :108200-108211
[2]   No-reference mesh visual quality assessment via ensemble of convolutional neural networks and compact multi-linear pooling [J].
Abouelaziz, Ilyass ;
Chetouani, Aladine ;
El Hassouni, Mohammed ;
Latecki, Longin Jan ;
Cherifi, Hocine .
PATTERN RECOGNITION, 2020, 100
[3]   3D visual saliency and convolutional neural network for blind mesh quality assessment [J].
Abouelaziz, Ilyass ;
Chetouani, Aladine ;
El Hassouni, Mohammed ;
Latecki, Longin Jan ;
Cherifi, Hocine .
NEURAL COMPUTING & APPLICATIONS, 2020, 32 (21) :16589-16603
[4]  
Abouelaziz I, 2017, IEEE IMAGE PROC, P755, DOI 10.1109/ICIP.2017.8296382
[5]   A Curvature based method for blind mesh visual quality assessment using a general regression neural network [J].
Abouelaziz, Ilyass ;
El Hassouni, Mohammed ;
Cherifi, Hocine .
2016 12TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS (SITIS), 2016, :793-797
[6]   No-Reference 3D Mesh Quality Assessment Based on Dihedral Angles Model and Support Vector Regression [J].
Abouelaziz, Ilyass ;
El Hassouni, Mohammed ;
Cherifi, Hocine .
IMAGE AND SIGNAL PROCESSING (ICISP 2016), 2016, 9680 :369-377
[7]  
Al-Regib G, 2002, IEEE INFOCOM SER, P743, DOI 10.1109/INFCOM.2002.1019320
[8]  
Alexiou E, 2020, IEEE INT CONF MULTI, DOI 10.1109/icmew46912.2020.9106005
[9]   An unequal error protection method for progressively transmitted 3-D models [J].
AlRegib, G ;
Altunbasak, Y ;
Rossignac, J .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (04) :766-776
[10]   LEAST-SQUARES FITTING OF 2 3-D POINT SETS [J].
ARUN, KS ;
HUANG, TS ;
BLOSTEIN, SD .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1987, 9 (05) :699-700