Personalized multi-head self-attention network for news recommendation
被引:1
|
作者:
Zheng, Cong
论文数: 0引用数: 0
h-index: 0
机构:
Global Energy Interconnect Grp Co Ltd, 8 Xuanwumennei St, Beijing, Peoples R ChinaGlobal Energy Interconnect Grp Co Ltd, 8 Xuanwumennei St, Beijing, Peoples R China
Zheng, Cong
[1
]
Song, Yixuan
论文数: 0引用数: 0
h-index: 0
机构:
Baidu Online Network Technol Beijing Co Ltd, Baidu Campus,10 Shangdi 10th St, Beijing, Peoples R ChinaGlobal Energy Interconnect Grp Co Ltd, 8 Xuanwumennei St, Beijing, Peoples R China
Song, Yixuan
[2
]
机构:
[1] Global Energy Interconnect Grp Co Ltd, 8 Xuanwumennei St, Beijing, Peoples R China
[2] Baidu Online Network Technol Beijing Co Ltd, Baidu Campus,10 Shangdi 10th St, Beijing, Peoples R China
News recommendation;
Natural language processing;
Multi-head self-attention;
Neural networks;
Embedding;
D O I:
10.1016/j.neunet.2024.106824
中图分类号:
TP18 [人工智能理论];
学科分类号:
081104 ;
0812 ;
0835 ;
1405 ;
摘要:
With the rapid explosion of online news and user population, personalized news recommender systems have proved to be efficient ways of alleviating information overload problems by suggesting information which attracts users in line with their tastes. Exploring relationships among words and news is critical to structurally model users' latent tastes including interested domains, while selecting informative words and news can directly reflect users' interests. Most of the current studies do not provide an effective framework that combines distilling users' interested latent spaces and explicit points systematically. Moreover, introducing more advanced techniques to merely chase accuracy has become a universal phenomenon. In this study, we design a P ersonalized M ulti-Head S elf-Attention N etwork ( PMSN ) for news recommendation, which combines multi-head self-attention network with personalized attention mechanism from both word and news levels. Multi-head self-attention mechanism is used to model interactions among words and news, exploring latent interests. Personalized attention mechanism is applied by embedding users' IDs to highlight informative words and news, which can enhance the interpretability of personalization. Comprehensive experiments conducted using two real-world datasets demonstrate that PMSN efficiently outperforms state-of-the-art methods in terms of recommendation accuracy, without complicated structure design and exhausted even external resources consumption. Furthermore, visualized case study validates that attention mechanism indeed increases the interpretability.
机构:
School of Computer Science and Technology, Harbin University of Science and Technology, HarbinSchool of Computer Science and Technology, Harbin University of Science and Technology, Harbin
Han Y.-L.
Wang X.-Y.
论文数: 0引用数: 0
h-index: 0
机构:
School of Computer Science and Technology, Harbin University of Science and Technology, HarbinSchool of Computer Science and Technology, Harbin University of Science and Technology, Harbin
Wang X.-Y.
Beijing Youdian Daxue Xuebao/Journal of Beijing University of Posts and Telecommunications,
2021,
44
(05):
: 127
-
132
机构:
Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Peng Cheng Lab, Shenzhen, Peoples R ChinaTsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Xiao, Xi
Xiao, Wentao
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Peng Cheng Lab, Shenzhen, Peoples R ChinaTsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Xiao, Wentao
Zhang, Dianyan
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Peng Cheng Lab, Shenzhen, Peoples R ChinaTsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Zhang, Dianyan
Zhang, Bin
论文数: 0引用数: 0
h-index: 0
机构:
Peng Cheng Lab, Shenzhen, Peoples R ChinaTsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Zhang, Bin
Hu, Guangwu
论文数: 0引用数: 0
h-index: 0
机构:
Shenzhen Inst Informat Technol, Sch Comp Sci, Shenzhen, Peoples R ChinaTsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Hu, Guangwu
Li, Qing
论文数: 0引用数: 0
h-index: 0
机构:
Peng Cheng Lab, Shenzhen, Peoples R China
Southern Univ Sci & Technol, Shenzhen, Peoples R ChinaTsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Li, Qing
Xia, Shutao
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
Peng Cheng Lab, Shenzhen, Peoples R ChinaTsinghua Univ, Shenzhen Int Grad Sch, Shenzhen, Peoples R China
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
Xiao, Xi
Zhang, Dianyan
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
Zhang, Dianyan
Hu, Guangwu
论文数: 0引用数: 0
h-index: 0
机构:
Shenzhen Inst Informat Technol, Sch Comp Sci, Shenzhen 518172, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
Hu, Guangwu
Jiang, Yong
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
Jiang, Yong
Xia, Shutao
论文数: 0引用数: 0
h-index: 0
机构:
Tsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
Peng Cheng Lab, Shenzhen 518055, Peoples R ChinaTsinghua Univ, Tsinghua Shenzhen Int Grad Sch, Shenzhen 518055, Peoples R China
机构:
China Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R ChinaChina Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
Wang, Wuli
Sun, Qi
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R ChinaChina Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
Sun, Qi
Zhang, Li
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R ChinaChina Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
Zhang, Li
Ren, Peng
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R ChinaChina Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
Ren, Peng
Wang, Jianbu
论文数: 0引用数: 0
h-index: 0
机构:
Minist Nat Resources, Inst Oceanog 1, Lab Marine Phys & Remote Sensing, Qingdao 266061, Peoples R ChinaChina Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
Wang, Jianbu
Ren, Guangbo
论文数: 0引用数: 0
h-index: 0
机构:
Minist Nat Resources, Inst Oceanog 1, Lab Marine Phys & Remote Sensing, Qingdao 266061, Peoples R China
Qingdao Key Lab Spatial Informat Dynam Percept & S, Qingdao 266061, Peoples R ChinaChina Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China
Ren, Guangbo
Liu, Baodi
论文数: 0引用数: 0
h-index: 0
机构:
China Univ Petr East China, Coll Control Sci & Engn, Qingdao 266580, Peoples R ChinaChina Univ Petr East China, Coll Oceanog & Space Informat, Qingdao 266580, Peoples R China