Autoregressive Decoder With Extracted Gap Sessions for Sequential/Session-Based Recommendation

被引:2
作者
Chung, Jaewon [1 ]
Lee, Jung Hwa [2 ]
Jang, Beakcheol [2 ]
机构
[1] Yonsei Univ, Grad Sch Int Studies, Seoul 03722, South Korea
[2] Yonsei Univ, Grad Sch Informat, Seoul 03722, South Korea
关键词
Recommender systems; Pegasus; transformer;
D O I
10.1109/ACCESS.2023.3297204
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Learning the complex relationships between items in a sequential recommendation system (SRS) and session-based recommendation system (SBRS) is critical for obtaining higher prediction scores. In recent studies, to capture item-item information, items have been represented as the nodes of graph neural networks (GNNs) and the relevance of items with self-/soft attention layers has been calculated. GNNs have been used because standalone attention-based methods focus only on the relative significance of items within a single session, neglecting high-order item-item relationships that change through sessions. The relational summarization task is a natural language processing task that extracts the relationship between two tokens from a related corpus; however, its adaptation to SRS and SBRS is unknown. To fill this lacuna, in this study, the relationships between items from related sessions are extracted using the transformer-based abstractive summarization model PEGASUS. To improve session embedding, the proposed model, named "gap-session transformer" utilizes gap-session masking to learn the relationships between items within different sessions. In addition, a group of sessions are divided into multiple corpus sets based on the theme of each corpus, and the autoregressive beam-search decoder is connected to a transformer decoder for the generation of the next session while auxiliary tasks are performed to enhance the recommendation task. Extensive experiments conducted on the MovieLens1M dataset and Yoochoose dataset verify that our model significantly outperforms the state-of-the-art (SOTA) methods, and the results demonstrate the efficacy of the relational summarization task in recommendation systems.
引用
收藏
页码:75215 / 75224
页数:10
相关论文
共 48 条
  • [1] Beltagy I, 2020, Arxiv, DOI arXiv:2004.05150
  • [2] Chami I, 2019, ADV NEUR IN, V32
  • [3] Chen T., 2020, P 26 ACM SIGKDD INT, P1
  • [4] Defferrard M, 2016, ADV NEUR IN, V29
  • [5] Devlin J, 2019, Arxiv, DOI [arXiv:1810.04805, 10.48550/arXiv.1810.04805]
  • [6] Fan AEL, 2018, Arxiv, DOI arXiv:1711.05217
  • [7] Feng YF, 2019, AAAI CONF ARTIF INTE, P3558
  • [8] Streaming Session-based Recommendation
    Guo, Lei
    Yin, Hongzhi
    Wang, Qinyong
    Chen, Tong
    Zhou, Alexander
    Nguyen Quoc Viet Hung
    [J]. KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, : 1569 - 1577
  • [9] Guo NC, 2021, Arxiv, DOI arXiv:2107.05366
  • [10] Gupta P, 2021, Arxiv, DOI arXiv:1909.04276