Dually Enhanced Delayed Feedback Modeling for Streaming Conversion Rate Prediction

被引:5
作者
Dai, Sunhao [1 ]
Zhou, Yuqi [1 ]
Xu, Jun [1 ]
Wen, Ji-Rong [1 ]
机构
[1] Renmin Univ China, Gaoling Sch Artificial Intelligence, Beijing, Peoples R China
来源
PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023 | 2023年
基金
国家重点研发计划;
关键词
Delayed Feedback; Conversion Prediction; Online Advertising;
D O I
10.1145/3583780.3614856
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In online industrial advertising systems, conversion actions (e.g., purchases or downloads) often occur significantly delayed, even up to several days or weeks after the user clicks. This phenomenon leads to the crucial challenge called delayed feedback problem in streaming CVR prediction, that is, the online systems cannot receive the true label of conversions immediately for continuous training. To mitigate the delayed feedback problem, recent state-of-the-art methods often apply sample duplicate mechanisms to introduce early certain conversion information. Nevertheless, these works have overlooked a crucial issue of rapid shifts in data distribution and considered both the newly observed data and duplicated early data together, resulting in biases in both distributions. In this work, we propose a Dually enhanced Delayed Feedback Model (DDFM), which tackles the above issues by treating the newly observed data and duplicated early data separately. DDFM consists of dual unbiased CVR estimators that share the same form but utilize different latent variables as weights: one for the newly observed data and the other for the duplicated early data. To avoid high variance, we adopt an addition-only formula for these latent variables, eliminating multiplication or division operations. Furthermore, we design a shared-bottom network that efficiently and jointly estimates the latent variables in DDFM. Theoretical analysis demonstrates the unbiasedness and convergence properties of DDFM. Extensive experiments on both public and industrial large-scale real-world datasets exhibit that our proposed DDFM consistently outperforms existing state-of-the-art methods.
引用
收藏
页码:390 / 399
页数:10
相关论文
共 41 条
[1]  
Bishop Christopher M., 2006, Pattern recognition and machine learning
[2]   Modeling Delayed Feedback in Display Advertising [J].
Chapelle, Olivier .
PROCEEDINGS OF THE 20TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING (KDD'14), 2014, :1097-1105
[3]   Asymptotically Unbiased Estimation for Delayed Feedback Modeling via Label Correction [J].
Chen, Yu ;
Jin, Jiaqi ;
Zhao, Hui ;
Wang, Pengjie ;
Liu, Guojun ;
Xu, Jian ;
Zheng, Bo .
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22), 2022, :369-379
[4]   Real Negatives Matter: Continuous Training with Real Negatives for Delayed Feedback Modeling [J].
Gu, Siyu ;
Sheng, Xiang-Rong ;
Fan, Ying ;
Zhou, Guorui ;
Zhu, Xiaoqiang .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :2890-2898
[5]   Streaming Session-based Recommendation [J].
Guo, Lei ;
Yin, Hongzhi ;
Wang, Qinyong ;
Chen, Tong ;
Zhou, Alexander ;
Nguyen Quoc Viet Hung .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :1569-1577
[6]   Conversion Prediction with Delayed Feedback: A Multi-task Learning Approach [J].
Hou, Yilin ;
Zhao, Guangming ;
Liu, Chuanren ;
Zu, Zhonglin ;
Zhu, Xiaoqiang .
2021 21ST IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2021), 2021, :191-199
[7]   A Multi-Task Learning Approach for Delayed Feedback Modeling [J].
Huangfu, Zhigang ;
Zhang, Gong-Duo ;
Wu, Zhengwei ;
Wu, Qintong ;
Zhang, Zhiqiang ;
Gu, Lihong ;
Zhou, Jun ;
Gu, Jinjie .
COMPANION PROCEEDINGS OF THE WEB CONFERENCE 2022, WWW 2022 COMPANION, 2022, :116-120
[8]  
Imbens GW, 2015, CAUSAL INFERENCE FOR STATISTICS, SOCIAL, AND BIOMEDICAL SCIENCES: AN INTRODUCTION, P1, DOI 10.1017/CBO9781139025751
[9]  
Joulani Pooria., 2013, P INT C MACHINE LEAR, P1453
[10]   StreamingRec: A Framework for Benchmarking Stream-based News Recommenders [J].
Jugovac, Michael ;
Jannach, Dietmar ;
Karimi, Mozhgan .
12TH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS), 2018, :269-273