Matrix Completion With Cross-Concentrated Sampling: Bridging Uniform Sampling and CUR Sampling

被引:9
作者
Cai, HanQin [1 ,2 ]
Huang, Longxiu [3 ,4 ]
Li, Pengyu [5 ]
Needell, Deanna [6 ]
机构
[1] Univ Cent Florida, Dept Stat & Data Sci, Orlando, FL 32816 USA
[2] Univ Cent Florida, Dept Comp Sci, Orlando, FL 32816 USA
[3] Michigan State Univ, Dept Computat Math Sci & Engn, E Lansing, MI 48823 USA
[4] Michigan State Univ, Dept Math, E Lansing, MI 48823 USA
[5] Univ Michigan, Dept Elect Engn & Comp Sci, Ann Arbor, MI 48109 USA
[6] Univ Calif Los Angeles, Dept Math, Los Angeles, CA 90095 USA
关键词
Matrix decomposition; Motion pictures; Collaboration; Minimization; Data models; Complexity theory; Bridges; Cross-concentrated sampling; CUR decomposition; collaborative filtering; image recovery; low-rank matrix; link prediction; matrix completion; recommendation system; sampling strategy; LOW-RANK MATRIX; APPROXIMATION; DECOMPOSITION; ALGORITHMS;
D O I
10.1109/TPAMI.2023.3261185
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
While uniform sampling has been widely studied in the matrix completion literature, CUR sampling approximates a low-rank matrix via row and column samples. Unfortunately, both sampling models lack flexibility for various circumstances in real-world applications. In this work, we propose a novel and easy-to-implement sampling strategy, coined Cross-Concentrated Sampling (CCS). By bridging uniform sampling and CUR sampling, CCS provides extra flexibility that can potentially save sampling costs in applications. In addition, we also provide a sufficient condition for CCS-based matrix completion. Moreover, we propose a highly efficient non-convex algorithm, termed Iterative CUR Completion (ICURC), for the proposed CCS model. Numerical experiments verify the empirical advantages of CCS and ICURC against uniform sampling and its baseline algorithms, on both synthetic and real-world datasets.
引用
收藏
页码:10100 / 10113
页数:14
相关论文
共 60 条
[1]  
Altschuler J, 2016, PR MACH LEARN RES, V48
[2]   Convex multi-task feature learning [J].
Argyriou, Andreas ;
Evgeniou, Theodoros ;
Pontil, Massimiliano .
MACHINE LEARNING, 2008, 73 (03) :243-272
[3]   FASTER SUBSET SELECTION FOR MATRICES AND APPLICATIONS [J].
Avron, Haim ;
Boutsidis, Christos .
SIAM JOURNAL ON MATRIX ANALYSIS AND APPLICATIONS, 2013, 34 (04) :1464-1499
[4]  
Bennett J., 2007, ACM SIGKDD explorations newsletter, V9, P51, DOI DOI 10.1145/1345448.1345459
[5]  
Cai HQ, 2021, J MACH LEARN RES, V22
[6]  
Cai HQ, 2023, Arxiv, DOI arXiv:2204.03316
[7]   Fast Robust Tensor Principal Component Analysis via Fiber CUR Decomposition [J].
Cai, HanQin ;
Chao, Zehan ;
Huang, Longxiu ;
Needell, Deanna .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW 2021), 2021, :189-197
[8]   Robust CUR Decomposition: Theory and Imaging Applications* [J].
Cai, HanQin ;
Hamm, Keaton ;
Huang, Longxiu ;
Needell, Deanna .
SIAM JOURNAL ON IMAGING SCIENCES, 2021, 14 (04) :1472-1503
[9]   Rapid Robust Principal Component Analysis: CUR Accelerated Inexact Low Rank Estimation [J].
Cai, HanQin ;
Hamm, Keaton ;
Huang, Longxiu ;
Li, Jiaqi ;
Wang, Tao .
IEEE SIGNAL PROCESSING LETTERS, 2021, 28 :116-120
[10]   Fast and provable algorithms for spectrally sparse signal reconstruction via low-rank Hankel matrix completion [J].
Cai, Jian-Feng ;
Wang, Tianming ;
Wei, Ke .
APPLIED AND COMPUTATIONAL HARMONIC ANALYSIS, 2019, 46 (01) :94-121