Adapted transformer network for news recommendation

被引:24
作者
Huang, Jinsheng [1 ]
Han, Zhuobing [2 ]
Xu, Hongyan [1 ]
Liu, Hongtao [1 ]
机构
[1] Tianjin Univ, Coll Intelligence & Comp, Tianjin, Peoples R China
[2] Coordinat Ctr China, Natl Comp Network Emergency Response Tech Team, Beijing, Peoples R China
基金
国家重点研发计划;
关键词
News Recommendation; Transformer; Attention;
D O I
10.1016/j.neucom.2021.10.049
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Online news recommendation aims to provide personalized news for users according to their interests. Existing methods usually learn user preference from their historical reading records in a static and inde-pendent way, which ignore the dynamic interaction with the target candidate news. In fact, it is impor-tant to fully capture the semantic interaction between user?s historical news and candidate news since the user?s interests would be different in terms of different candidate news. In this paper, we propose a novel news recommendation model with an adapted transformer network. There are three parts in our approach, i.e., a news encoder to learn the semantic features of news, a user encoder to learn the initial representations of users, an adapted transformer module to learn the deep interaction between users and candidate news. The core is that we effectively integrate the historical clicked news and the candidate news into the transformer framework to capture their inherent relatedness. Besides, an additive attention layer is proposed to learn different informativeness of words since different words are differently useful for news or users? representation. We conduct extensive experiments on a real-world dataset from MSN news and the results indicates the effectiveness of our proposed approach. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:119 / 129
页数:11
相关论文
共 27 条
[1]  
Capelle M., 2012, P 2 INT C WEB INT MI, P1, DOI DOI 10.1145/2254129.2254163
[2]  
Garcin, 2013, P 7 ACM C REC SYST, P105, DOI DOI 10.1145/2507157.2507166
[3]  
Guo HF, 2017, PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1725
[4]   Personalized News Recommendation and Simulation Based on Improved Collaborative Filtering Algorithm [J].
Han, Kunni .
COMPLEXITY, 2020, 2020
[5]  
Haidong Chen, 2016, 2016 IEEE International Workshop on Electromagnetics (iWEM): Applications and Student Innovation Competition, P1, DOI [10.1109/PESGM.2016.7741231, 10.1109/iWEM.2016.7504980]
[6]  
Huang PS, 2013, PROCEEDINGS OF THE 22ND ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT (CIKM'13), P2333
[7]  
Karkali M, 2013, SIGIR'13: THE PROCEEDINGS OF THE 36TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH & DEVELOPMENT IN INFORMATION RETRIEVAL, P1117
[8]  
Kim Yoon, 2014, P C EMP METH NAT LAN, P1746, DOI [DOI 10.48550/ARXIV.1408.5882, 10.3115/v1/D14-1181, DOI 10.3115/V1/D14-1181]
[9]  
King DB, 2015, ACS SYM SER, V1214, P1
[10]  
Kompan M, 2010, LECT NOTES BUS INF P, V61, P61