A Novel Macro-Micro Fusion Network for User Representation Learning on Mobile Apps

被引:9
作者
Bian, Shuqing [1 ,3 ]
Zhao, Wayne Xin [2 ,3 ]
Zhou, Kun [1 ,3 ]
Chen, Xu [2 ,3 ]
Cai, Jing [4 ]
He, Yancheng [4 ]
Luo, Xingji [4 ]
Wen, Ji-Rong [2 ,3 ]
机构
[1] Renmin Univ China, Sch Informat, Beijing, Peoples R China
[2] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
[3] Beijing Key Lab Big Data Management & Anal Method, Beijing, Peoples R China
[4] Tencent, Platform & Content Grp, Shenzhen, Peoples R China
来源
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021) | 2021年
基金
中国国家自然科学基金;
关键词
User Representation Learning; Mobile Data Modeling; Mutual Information Maximization;
D O I
10.1145/3442381.3450109
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The evolution of mobile apps has greatly changed the way that we live. It becomes increasingly important to understand and model the users on mobile apps. Instead of focusing on some specific app alone, it has become a popular paradigm to study the user behavior on various mobile apps in a symbiotic environment. In this paper, we study the task of user representation learning with both macro and micro interaction data on mobile apps. Specifically, macro and micro interaction refer to user-app interaction or user-item interaction on some specific app, respectively. By combining the two kinds of user data, it is expected to derive a more comprehensive, robust user representation model on mobile apps. In order to effectively fuse the information across the macro and micro views, we propose a novel macro-micro fusion network for user representation learning on mobile apps. With a Transformer architecture as the base model, we design a representation fusion component that is able to capture the category-based semantic alignment at the user level. After such semantic alignment, the information across the two views can be adaptively fused in our approach. Furthermore, we adopt mutual information maximization to derive a self-supervised loss to enhance the learning of our fusion network. Extensive experiments with three downstream tasks on two real-world datasets have demonstrated the effectiveness of our approach.
引用
收藏
页码:3199 / 3209
页数:11
相关论文
共 59 条
[1]  
[Anonymous], 2012, P 26 INT C NEURAL IN
[2]  
[Anonymous], 2020, KDD 2020, DOI DOI 10.1016/J.SIMYCO.2020.03.001
[3]  
[Anonymous], 2019, IJCAI 2019
[4]  
Bourigault Simon, 2016, MACHINE LEARNING KNO, P265
[5]  
Cao Da, 2017, ACM T INF SYST, V35, P4
[6]   Achieving Accuracy and Scalability Simultaneously in Detecting Application Clones on Android Markets [J].
Chen, Kai ;
Liu, Peng ;
Zhang, Yingjun .
36TH INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING (ICSE 2014), 2014, :175-186
[7]  
Chen Weijian, 2019, IJCAI 2019
[8]   MAdFraud: Investigating Ad Fraud in Android Applications [J].
Crussell, Jonathan ;
Stevens, Ryan ;
Chen, Hao .
MOBISYS'14: PROCEEDINGS OF THE 12TH ANNUAL INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS, APPLICATIONS, AND SERVICES, 2014, :123-134
[9]   Item-based top-N recommendation algorithms [J].
Deshpande, M ;
Karypis, G .
ACM TRANSACTIONS ON INFORMATION SYSTEMS, 2004, 22 (01) :143-177
[10]   FraudDroid: Automated Ad Fraud Detection for Android Apps [J].
Dong, Feng ;
Wang, Haoyu ;
Li, Li ;
Guo, Yao ;
Bissyande, Tegawende F. ;
Liu, Tianming ;
Xu, Guoai ;
Klein, Jacques .
ESEC/FSE'18: PROCEEDINGS OF THE 2018 26TH ACM JOINT MEETING ON EUROPEAN SOFTWARE ENGINEERING CONFERENCE AND SYMPOSIUM ON THE FOUNDATIONS OF SOFTWARE ENGINEERING, 2018, :257-268