Graph Signal Processing for Geometric Data and Beyond: Theory and Applications

被引:35
作者
Hu, Wei [1 ]
Pang, Jiahao [2 ]
Liu, Xianming [3 ]
Tian, Dong [2 ]
Lin, Chia-Wen [4 ,5 ,6 ]
Vetro, Anthony [7 ]
机构
[1] Peking Univ, Wangxuan Inst Comp Technol, Beijing 100080, Peoples R China
[2] InterDigital, Imaging Sci Lab, Princeton, NJ 08540 USA
[3] Harbin Inst Technol, Sch Comp Sci & Technol, Harbin 150001, Peoples R China
[4] Natl Tsing Hua Univ, Dept Elect Engn, Hsinchu 30013, Taiwan
[5] Natl Tsing Hua Univ, Inst Commun Engn, Hsinchu 30013, Taiwan
[6] Ind Technol Res Inst, Elect & Optoelect Syst Res Labs, Hsinchu, Taiwan
[7] Mitsubishi Elect Res Labs, Cambridge, MA 02139 USA
关键词
Three-dimensional displays; Geometry; Symmetric matrices; Manifolds; Laplace equations; Tools; Spectral analysis; Graph Signal Processing (GSP); geometric data; riemannian manifold; graph neural networks (GNNs); interpretability; FOURIER-TRANSFORM; POINT CLOUDS; IMAGE; CONVERGENCE; REGULARIZATION; COMPRESSION; LAPLACIAN; REPRESENTATION;
D O I
10.1109/TMM.2021.3111440
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Geometric data acquired from real-world scenes, e.g., 2D depth images, 3D point clouds, and 4D dynamic point clouds, have found a wide range of applications including immersive telepresence, autonomous driving, surveillance, etc. Due to irregular sampling patterns of most geometric data, traditional image/video processing methodologies are limited, while Graph Signal Processing (GSP)-a fast-developing field in the signal processing community-enables processing signals that reside on irregular domains and plays a critical role in numerous applications of geometric data from low-level processing to high-level analysis. To further advance the research in this field, we provide the first timely and comprehensive overview of GSP methodologies for geometric data in a unified manner by bridging the connections between geometric data and graphs, among the various geometric data modalities, and with spectral/nodal graph filtering techniques. We also discuss the recently developed Graph Neural Networks (GNNs) and interpret the operation of these networks from the perspective of GSP. We conclude with a brief discussion of open problems and challenges.
引用
收藏
页码:3961 / 3977
页数:17
相关论文
共 121 条
  • [1] Adelson EH., 1991, COMPUTATIONAL MODELS, P3, DOI DOI 10.7551/MITPRESS/2002.003.0004
  • [2] Anis A, 2016, INT CONF ACOUST SPEE, P6360, DOI 10.1109/ICASSP.2016.7472901
  • [3] 3D Semantic Parsing of Large-Scale Indoor Spaces
    Armeni, Iro
    Sener, Ozan
    Zamir, Amir R.
    Jiang, Helen
    Brilakis, Ioannis
    Fischer, Martin
    Savarese, Silvio
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 1534 - 1543
  • [4] ON THE RATE OF CONVERGENCE OF THE PRECONDITIONED CONJUGATE-GRADIENT METHOD
    AXELSSON, O
    LINDSKOG, G
    [J]. NUMERISCHE MATHEMATIK, 1986, 48 (05) : 499 - 523
  • [5] Graph-Based Blind Image Deblurring From a Single Photograph
    Bai, Yuanchao
    Cheung, Gene
    Liu, Xianming
    Gao, Wen
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (03) : 1404 - 1418
  • [6] SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences
    Behley, Jens
    Garbade, Martin
    Milioto, Andres
    Quenzel, Jan
    Behnke, Sven
    Stachniss, Cyrill
    Gall, Juergen
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 9296 - 9306
  • [7] 3D people surveillance on range data sequences of a rotating Lidar
    Benedek, Csaba
    [J]. PATTERN RECOGNITION LETTERS, 2014, 50 : 149 - 158
  • [8] A Benchmark for Surface Reconstruction
    Berger, Matthew
    Levine, Joshua A.
    Nonato, Luis Gustavo
    Taubin, Gabriel
    Silva, Claudio T.
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2013, 32 (02):
  • [9] Geometric Deep Learning Going beyond Euclidean data
    Bronstein, Michael M.
    Bruna, Joan
    LeCun, Yann
    Szlam, Arthur
    Vandergheynst, Pierre
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (04) : 18 - 42
  • [10] Bruna J., 2014, PROC 2 INT C LEARN R