In-depth Recommendation Model Based on Self-Attention Factorization

被引:4
作者
Ma, Hongshuang [1 ]
Liu, Qicheng [1 ]
机构
[1] Yantai Univ, Sch Comp & Control Engn, Yantai 264000, Shandong, Peoples R China
来源
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS | 2023年 / 17卷 / 03期
基金
中国国家自然科学基金;
关键词
Self-attention network; deep learning; recommendation model; review text;
D O I
10.3837/tiis.2023.03.003
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Rating prediction is an important issue in recommender systems, and its accuracy affects the experience of the user and the revenue of the company. Traditional recommender systems use Factorization Machines for rating predictions and each feature is selected with the same weight. Thus, there are problems with inaccurate ratings and limited data representation. This study proposes a deep recommendation model based on self-attention Factorization (SAFMR) to solve these problems. This model uses Convolutional Neural Networks to extract features from user and item reviews. The obtained features are fed into self-attention mechanism Factorization Machines, where the self-attention network automatically learns the dependencies of the features and distinguishes the weights of the different features, thereby reducing the prediction error. The model was experimentally evaluated using six classes of dataset. We compared MSE, NDCG and time for several real datasets. The experiment demonstrated that the SAFMR model achieved excellent rating prediction results and recommendation correlations, thereby verifying the effectiveness of the model.
引用
收藏
页码:721 / 739
页数:19
相关论文
共 50 条
  • [1] Multi-head Self-attention Recommendation Model based on Feature Interaction Enhancement
    Yin, Yunfei
    Huang, Caihao
    Sun, Jingqin
    Huang, Faliang
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 1740 - 1745
  • [2] Spiking neural self-attention network for sequence recommendation
    Bai, Xinzhu
    Huang, Yanping
    Peng, Hong
    Yang, Qian
    Wang, Jun
    Liu, Zhicai
    APPLIED SOFT COMPUTING, 2025, 169
  • [3] Weight Adjustment Framework for Self-Attention Sequential Recommendation
    Su, Zheng-Ang
    Zhang, Juan
    APPLIED SCIENCES-BASEL, 2024, 14 (09):
  • [4] Self-Attention Network for Session-Based Recommendation With Streaming Data Input
    Sun, Shiming
    Tang, Yuanhe
    Dai, Zemei
    Zhou, Fu
    IEEE ACCESS, 2019, 7 : 110499 - 110509
  • [5] A Self-attention Network Based Node Embedding Model
    Nguyen, Dai Quoc
    Nguyen, Tu Dinh
    Phung, Dinh
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2020, PT III, 2021, 12459 : 364 - 377
  • [6] SanMove: next location recommendation via self-attention network
    Wang, Bin
    Li, Huifeng
    Tong, Le
    Zhang, Qian
    Zhu, Sulei
    Yang, Tao
    DATA TECHNOLOGIES AND APPLICATIONS, 2023, 57 (03) : 330 - 343
  • [7] Modeling Periodic Pattern with Self-Attention Network for Sequential Recommendation
    Ma, Jun
    Zhao, Pengpeng
    Liu, Yanchi
    Sheng, Victor S.
    Xu, Jiajie
    Zhao, Lei
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT III, 2020, 12114 : 557 - 572
  • [8] Graph contextualized self-attention network for software service sequential recommendation
    Fu, Zixuan
    Wang, Chenghua
    Xu, Jiajie
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2023, 149 : 509 - 517
  • [9] Cross-domain recommendation of overlapping users based on self-attention graph convolution network
    Xing, Xing
    Wang, Shiqi
    Liu, Jiawen
    Li, Yunxi
    Jia, Zhichun
    2023 35TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC, 2023, : 4984 - 4988
  • [10] Personalized News Recommendation with CNN and Multi-Head Self-Attention
    Li, Aibin
    He, Tingnian
    Guo, Yi
    Li, Zhuoran
    Rong, Yixuan
    Liu, Guoqi
    2022 IEEE 13TH ANNUAL UBIQUITOUS COMPUTING, ELECTRONICS & MOBILE COMMUNICATION CONFERENCE (UEMCON), 2022, : 102 - 108