Orthogonal Inductive Matrix Completion

被引:10
作者
Ledent, Antoine [1 ]
Alves, Rodrigo [2 ]
Kloft, Marius [3 ]
机构
[1] TU Kaiserslautern, Dept Comp Sci, Marius Klofts Res Grp, D-67633 Kaiserslautern, Germany
[2] TU Kaiserslautern, Machine Learning Grp, D-67633 Kaiserslautern, Germany
[3] TU Kaiserslautern, Comp Sci CS & Machine Learning ML, D-67633 Kaiserslautern, Germany
关键词
Motion pictures; Optimization; Recommender systems; Training; Social networking (online); Predictive models; Learning systems; Machine learning; recommender systems; statistical learning;
D O I
10.1109/TNNLS.2021.3106155
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We propose orthogonal inductive matrix completion (OMIC), an interpretable approach to matrix completion based on a sum of multiple orthonormal side information terms, together with nuclear-norm regularization. The approach allows us to inject prior knowledge about the singular vectors of the ground-truth matrix. We optimize the approach by a provably converging algorithm, which optimizes all components of the model simultaneously. We study the generalization capabilities of our method in both the distribution-free setting and in the case where the sampling distribution admits uniform marginals, yielding learning guarantees that improve with the quality of the injected knowledge in both cases. As particular cases of our framework, we present models that can incorporate user and item biases or community information in a joint and additive fashion. We analyze the performance of OMIC on several synthetic and real datasets. On synthetic datasets with a sliding scale of user bias relevance, we show that OMIC better adapts to different regimes than other methods. On real-life datasets containing user/items recommendations and relevant side information, we find that OMIC surpasses the state of the art, with the added benefit of greater interpretability.
引用
收藏
页码:2259 / 2270
页数:12
相关论文
共 28 条
[1]  
Aggarwal CC., 2016, Recommender Systems, Vvol. 1, DOI 10.1007/978-3-319-29659-3
[2]  
[Anonymous], 2012, P 18 ACM SIGKDD INT, DOI DOI 10.1145/2339530.2339612
[3]  
Bell, 2009, BELLKOR SOLUTION NET, V81, P1
[4]   The Power of Convex Relaxation: Near-Optimal Matrix Completion [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2010, 56 (05) :2053-2080
[5]   Exact Matrix Completion via Convex Optimization [J].
Candes, Emmanuel J. ;
Recht, Benjamin .
FOUNDATIONS OF COMPUTATIONAL MATHEMATICS, 2009, 9 (06) :717-772
[6]  
Chen TQ, 2012, J MACH LEARN RES, V13, P3619
[7]  
Chiang KY, 2018, J MACH LEARN RES, V19
[8]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[9]   DE-NOISING BY SOFT-THRESHOLDING [J].
DONOHO, DL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (03) :613-627
[10]  
Gaillard Julien, 2015, Advances in Information Retrieval. 37th European Conference on IR Research (ECIR 2015). Proceedings: LNCS 9022, P327, DOI 10.1007/978-3-319-16354-3_35