A GRAPH LEARNING ALGORITHM BASED ON GAUSSIAN MARKOV RANDOM FIELDS AND MINIMAX CONCAVE PENALTY

被引:5
作者
Koyakumaru, Tatsuya [1 ]
Yukawa, Masahiro [1 ]
Pavez, Eduardo [2 ]
Ortega, Antonio [2 ]
机构
[1] Keio Univ, Dept Elect & Elect Engn, Tokyo, Japan
[2] Univ Southern Calif, Los Angeles, CA 90007 USA
来源
2021 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP 2021) | 2021年
关键词
graph signal processing; graph learning; graphical lasso; minimax concave penalty; primal-dual splitting method; proximity operator; INVERSE COVARIANCE ESTIMATION; LASSO; SELECTION;
D O I
10.1109/ICASSP39728.2021.9413850
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper presents a graph learning framework to produce sparse and accurate graphs from network data. While our formulation is inspired by the graphical lasso, a key difference is the use of a nonconvex alternative of the l(1) norm as well as a quadratic term to ensure overall convexity. Specifically, the weakly-convex minimax concave penalty (MCP) is used, which is given by subtracting the Huber function from the l(1) norm, inducing a less-biased sparse solution than l(1). In our framework, the graph Laplacian is represented by a linear transform of the vector corresponding to its upper triangular part. Via a reformulation relying on the Moreau decomposition, the problem can be solved by the primal-dual splitting method. An admissible choice of parameters for provable convergence is presented. Numerical examples show that the proposed method significantly outperforms its l(1)-based counterpart for sparse grid graphs.
引用
收藏
页码:5410 / 5414
页数:5
相关论文
共 29 条
  • [1] Linearly involved generalized Moreau enhanced models and their proximal splitting algorithm under overall convexity condition
    Abe, Jiro
    Yamagishi, Masao
    Yamada, Isao
    [J]. INVERSE PROBLEMS, 2020, 36 (03)
  • [2] [Anonymous], 2005, MG STAT PRO
  • [3] [Anonymous], 2017, CONVEX ANAL MONOTONE, DOI [10.1007/978-3-319-48311-5, DOI 10.1007/978-3-319-48311-5]
  • [4] Banerjee O, 2008, J MACH LEARN RES, V9, P485
  • [5] Network Anomaly Detection: Methods, Systems and Tools
    Bhuyan, Monowar H.
    Bhattacharyya, D. K.
    Kalita, J. K.
    [J]. IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2014, 16 (01): : 303 - 336
  • [6] A Primal-Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms
    Condat, Laurent
    [J]. JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2013, 158 (02) : 460 - 479
  • [7] The joint graphical lasso for inverse covariance estimation across multiple classes
    Danaher, Patrick
    Wang, Pei
    Witten, Daniela M.
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2014, 76 (02) : 373 - 397
  • [8] Graph Learning From Data Under Laplacian and Structural Constraints
    Egilmez, Hilmi E.
    Pavez, Eduardo
    Ortega, Antonio
    [J]. IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (06) : 825 - 841
  • [9] Sparse inverse covariance estimation with the graphical lasso
    Friedman, Jerome
    Hastie, Trevor
    Tibshirani, Robert
    [J]. BIOSTATISTICS, 2008, 9 (03) : 432 - 441
  • [10] Network Inference via the Time-Varying Graphical Lasso
    Hallac, David
    Park, Youngsuk
    Boyd, Stephen
    Leskovec, Jure
    [J]. KDD'17: PROCEEDINGS OF THE 23RD ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2017, : 205 - 213