PEPNet: Parameter and Embedding Personalized Network for Infusing with Personalized Prior Information

被引:33
作者
Chang, Jianxin [1 ]
Zhang, Chenbin [1 ]
Hui, Yiqun [1 ]
Leng, Dewei [1 ]
Niu, Yanan [1 ]
Song, Yang [1 ]
Gai, Kun [2 ]
机构
[1] Kuaishou Technol, Beijing, Peoples R China
[2] Unaffiliated, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 29TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2023 | 2023年
关键词
Multi-Domain Learning; Multi-Task Learning; Personalization; Recommender System;
D O I
10.1145/3580305.3599884
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the increase of content pages and interactive buttons in online services such as online-shopping and video-watching websites, industrial-scale recommender systems face challenges in multi-domain and multi-task recommendations. The core of multi-task and multi-domain recommendation is to accurately capture user interests in multiple scenarios given multiple user behaviors. In this paper, we propose a plug-and-play Parameter and Embedding Personalized Network (PEPNet) for multi-domain and multi-task recommendation. PEPNet takes personalized prior information as input and dynamically scales the bottom-level Embedding and top-level DNN hidden units through gate mechanisms. Embedding Personalized Network (EPNet) performs personalized selection on Embedding to fuse features with different importance for different users in multiple domains. Parameter Personalized Network (PPNet) executes personalized modification on DNN parameters to balance targets with different sparsity for different users in multiple tasks. We have made a series of special engineering optimizations combining the Kuaishou training framework and the online deployment environment. By infusing personalized selection of Embedding and personalized modification of DNN parameters, PEPNet tailored to the interests of each individual obtains significant performance gains, with online improvements exceeding 1% in multiple task metrics across multiple domains. We have deployed PEPNet in Kuaishou apps, serving over 300 million users every day.
引用
收藏
页码:3795 / 3804
页数:10
相关论文
共 37 条
[1]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[2]  
[Anonymous], 2016, EUR C INF RETR
[3]  
[Anonymous], 2018, ARXIV180305170
[4]   Convex multi-task feature learning [J].
Argyriou, Andreas ;
Evgeniou, Theodoros ;
Pontil, Massimiliano .
MACHINE LEARNING, 2008, 73 (03) :243-272
[5]   A theory of learning from different domains [J].
Ben-David, Shai ;
Blitzer, John ;
Crammer, Koby ;
Kulesza, Alex ;
Pereira, Fernando ;
Vaughan, Jennifer Wortman .
MACHINE LEARNING, 2010, 79 (1-2) :151-175
[6]  
Ben-David Shai., 2006, P NIPS, P137
[7]  
Cheng Heng-Tze., 2016, P 1 WORKSHOP DEEP LE, P7, DOI 10.1145/2988450.2988454
[8]   Domain adaptation for statistical classifiers [J].
Daumé, H ;
Marcu, D .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2006, 26 (101-126) :101-126
[9]  
Glorot X., 2010, International conference on artificial intelligence and statistics, P249
[10]  
Guo HF, 2017, PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1725