Scope-aware Re-ranking with Gated Attention in Feed

被引:2
作者
Qian, Hao [1 ]
Wu, Qintong [1 ]
Zhang, Kai [2 ]
Zhang, Zhiqiang [1 ]
Gu, Lihong [1 ]
Zeng, Xiaodong [1 ]
Zhou, Jun [1 ]
Gu, Jinjie [1 ]
机构
[1] Ant Grp, Hangzhou, Peoples R China
[2] Univ Sci & Technol China, Sch Data Sci, Hefei, Anhui, Peoples R China
来源
WSDM'22: PROCEEDINGS OF THE FIFTEENTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING | 2022年
关键词
Recommender System; Learing To Rank; Re-ranking;
D O I
10.1145/3488560.3498403
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Modern recommendation systems introduce the re-ranking stage to optimize the entire list directly. This paper focuses on the design of re-ranking framework in feed to optimally model the mutual influence between items and further promote user engagement. On mobile devices, users browse the feed almost in a top-down manner and rarely compare items back and forth. Besides, users often compare item with its adjacency based on their partial observations. Given the distinct user behavior patterns, the modeling of mutual influence between items should be carefully designed. Existing re-ranking models encode the mutual influence between items with sequential encoding methods. However, previous works may be dissatisfactory due to the ignorance of connections between items on different scopes. In this paper, we first discuss Unidirectivity and Locality on the impacts and consequences, then report corresponding solutions in industrial applications. We propose a novel framework based on the empirical evidence from user analysis. To address the above problems, we design a Scope-aware Re-ranking with Gated Attention model (SRGA) to emulate the user behavior patterns from two aspects: 1) we emphasize the influence along the user's common browsing direction; 2) we strength the impacts of pivotal adjacent items within the user visual window. Specifically, we design a global scope attention to encode inter-item patterns unidirectionally from top to bottom. Besides, we devise a local scope attention sliding over the recommendation list to underline interactions among neighboring items. Furthermore, we design a learned gate mechanism to aggregating the information dynamically from local and global scope attention. Extensive offline experiments and online A/B testing demonstrate the benefits of our novel framework. The proposed SRGA model achieves the best performance in offline metrics compared with the state-of-the-art re-ranking methods. Further, empirical results on live traffic validate that our recommender system, equipped with SRGA in the re-ranking stage, improves significantly in user engagement.
引用
收藏
页码:804 / 812
页数:9
相关论文
共 37 条
  • [1] Learning Groupwise Multivariate Scoring Functions Using Deep Neural Networks
    Ai, Qingyao
    Wang, Xuanhui
    Bruch, Sebastian
    Golbandi, Nadav
    Bendersky, Michael
    Najork, Marc
    [J]. PROCEEDINGS OF THE 2019 ACM SIGIR INTERNATIONAL CONFERENCE ON THEORY OF INFORMATION RETRIEVAL (ICTIR'19), 2019, : 84 - 91
  • [2] Learning a Deep Listwise Context Model for Ranking Refinement
    Ai, Qingyao
    Bi, Keping
    Guo, Jiafeng
    Croft, W. Bruce
    [J]. ACM/SIGIR PROCEEDINGS 2018, 2018, : 135 - 144
  • [3] [Anonymous], 2017, P 2017 C EMP METH NA, DOI [10.18653/v1/D17-1151, DOI 10.18653/V1/D17-1151]
  • [4] Ba Jimmy Lei, 2016, LAYER NORMALIZATION, DOI 10.48550/arXiv.1607.06450
  • [5] Bello Irwan, 2019, ARXIV 181002019
  • [6] BenyouWang Lifeng Shang, 2021, INT C LEARNING REPRE
  • [7] Burges C., 2005, ICML, P89
  • [8] Burges C.J. C., ADV NEURAL INFORM PR
  • [9] Burges Christopher J. C., 2010, Technical Report MSR-TR- 2010-82, DOI DOI 10.1111/J.1467-8535
  • [10] Cao Z., 2007, P 24 ICML, P129