A Novel Macro-Micro Fusion Network for User Representation Learning on Mobile Apps

被引:9
作者
Bian, Shuqing [1 ,3 ]
Zhao, Wayne Xin [2 ,3 ]
Zhou, Kun [1 ,3 ]
Chen, Xu [2 ,3 ]
Cai, Jing [4 ]
He, Yancheng [4 ]
Luo, Xingji [4 ]
Wen, Ji-Rong [2 ,3 ]
机构
[1] Renmin Univ China, Sch Informat, Beijing, Peoples R China
[2] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
[3] Beijing Key Lab Big Data Management & Anal Method, Beijing, Peoples R China
[4] Tencent, Platform & Content Grp, Shenzhen, Peoples R China
来源
PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE 2021 (WWW 2021) | 2021年
基金
中国国家自然科学基金;
关键词
User Representation Learning; Mobile Data Modeling; Mutual Information Maximization;
D O I
10.1145/3442381.3450109
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The evolution of mobile apps has greatly changed the way that we live. It becomes increasingly important to understand and model the users on mobile apps. Instead of focusing on some specific app alone, it has become a popular paradigm to study the user behavior on various mobile apps in a symbiotic environment. In this paper, we study the task of user representation learning with both macro and micro interaction data on mobile apps. Specifically, macro and micro interaction refer to user-app interaction or user-item interaction on some specific app, respectively. By combining the two kinds of user data, it is expected to derive a more comprehensive, robust user representation model on mobile apps. In order to effectively fuse the information across the macro and micro views, we propose a novel macro-micro fusion network for user representation learning on mobile apps. With a Transformer architecture as the base model, we design a representation fusion component that is able to capture the category-based semantic alignment at the user level. After such semantic alignment, the information across the two views can be adaptively fused in our approach. Furthermore, we adopt mutual information maximization to derive a self-supervised loss to enhance the learning of our fusion network. Extensive experiments with three downstream tasks on two real-world datasets have demonstrated the effectiveness of our approach.
引用
收藏
页码:3199 / 3209
页数:11
相关论文
共 59 条
[21]  
Hjelm R. D., 2019, ICLR 2019
[22]  
Jamali Mohsen, 2013, P 22 INT C WORLD WID, P643, DOI DOI 10.1145/2488388.2488445
[23]   Understanding Usage States on Mobile Devices [J].
Jesdabodi, Chakajkla ;
Maalej, Walid .
PROCEEDINGS OF THE 2015 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING (UBICOMP 2015), 2015, :1221-1225
[24]   Self-Attentive Sequential Recommendation [J].
Kang, Wang-Cheng ;
McAuley, Julian .
2018 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2018, :197-206
[25]  
King DB, 2015, ACS SYM SER, V1214, P1, DOI 10.1021/bk-2015-1214.ch001
[26]  
Li B, 2009, 21ST INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE (IJCAI-09), PROCEEDINGS, P2052
[27]  
Li Bin, 2009, P 26 ANN INT C MACH, P617
[28]   Matching Users and Items Across Domains to Improve the Recommendation Quality [J].
Li, Chung-Yi ;
Lin, Shou-De .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :801-810
[29]   "What Apps Did You Use?": Understanding the Long-term Evolution of Mobile App Usage [J].
Li, Tong ;
Zhang, Mingyang ;
Cao, Hancheng ;
Li, Yong ;
Tarkoma, Sasu ;
Hui, Pan .
WEB CONFERENCE 2020: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2020), 2020, :66-76
[30]   PERUIM: Understanding Mobile Application Privacy with Permission-UI Mapping [J].
Li, Yuanchun ;
Guo, Yao ;
Chen, Xiangqun .
UBICOMP'16: PROCEEDINGS OF THE 2016 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING, 2016, :682-693