Bounding System-Induced Biases in Recommender Systems with a Randomized Dataset

被引:4
作者
Liu, Dugang [1 ]
Cheng, Pengxiang [2 ]
Lin, Zinan
Zhang, Xiaolian [3 ]
Dong, Zhenhua [3 ]
Zhang, Rui [4 ]
He, Xiuqiang [5 ]
Pan, Weike [1 ]
Ming, Zhong [1 ]
机构
[1] Shenzhen Univ, Coll Comp Sci & Software Engn, 3688 Nanhai Ave, Shenzhen 518060, Guangdong, Peoples R China
[2] Huawei Noahs Ark Lab, Bantian St, Shenzhen 518129, Guangdong, Peoples R China
[3] Huawei 2012 Lab, Bantian St, Shenzhen 518129, Guangdong, Peoples R China
[4] Tsinghua Univ, Beijing 518055, Guangdong, Peoples R China
[5] Tencent FIT, 33 Haitian Second Rd, Shenzhen 518057, Guangdong, Peoples R China
基金
中国国家自然科学基金;
关键词
System-induced bias; recommender systems; randomized dataset; upper bound minimization;
D O I
10.1145/3582002
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Debiased recommendation with a randomized dataset has shown very promising results in mitigating system-induced biases. However, it still lacks more theoretical insights or an ideal optimization objective function compared with the other more well-studied routes without a randomized dataset. To bridge this gap, we study the debiasing problem from a new perspective and propose to directly minimize the upper bound of an ideal objective function, which facilitates a better potential solution to system-induced biases. First, we formulate a new ideal optimization objective function with a randomized dataset. Second, according to the prior constraints that an adopted loss function may satisfy, we derive two different upper bounds of the objective function: a generalization error bound with triangle inequality and a generalization error bound with separability. Third, we show that most existing related methods can be regarded as the insufficient optimization of these two upper bounds. Fourth, we propose a novel method called debiasing approximate upper bound (DUB) with a randomized dataset, which achieves a more sufficient optimization of these upper bounds. Finally, we conduct extensive experiments on a public dataset and a real product dataset to verify the effectiveness of our DUB.
引用
收藏
页数:26
相关论文
共 53 条
  • [1] Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
  • [2] Controlling Popularity Bias in Learning-to-Rank Recommendation
    Abdollahpouri, Himan
    Burke, Robin
    Mobasher, Bamshad
    [J]. PROCEEDINGS OF THE ELEVENTH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS'17), 2017, : 42 - 46
  • [3] Addressing Trust Bias for Unbiased Learning-to-Rank
    Agarwal, Aman
    Wang, Xuanhui
    Li, Cheng
    Bendersky, Mike
    Najork, Marc
    [J]. WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 4 - 14
  • [4] Estimating Position Bias without Intrusive Interventions
    Agarwal, Aman
    Zaitsev, Ivan
    Wang, Xuanhui
    Li, Cheng
    Najork, Marc
    Joachims, Thorsten
    [J]. PROCEEDINGS OF THE TWELFTH ACM INTERNATIONAL CONFERENCE ON WEB SEARCH AND DATA MINING (WSDM'19), 2019, : 474 - 482
  • [5] Causal Embeddings for Recommendation
    Bonner, Stephen
    Vasile, Flavian
    [J]. 12TH ACM CONFERENCE ON RECOMMENDER SYSTEMS (RECSYS), 2018, : 104 - 112
  • [6] Should I Follow the Crowd? A Probabilistic Analysis of the Effectiveness of Popularity in Recommender Systems
    Canamares, Rocio
    Castells, Pablo
    [J]. ACM/SIGIR PROCEEDINGS 2018, 2018, : 415 - 424
  • [7] AutoDebias: Learning to Debias for Recommendation
    Chen, Jiawei
    Dong, Hande
    Qiu, Yang
    He, Xiangnan
    Xin, Xin
    Chen, Liang
    Lin, Guli
    Yang, Keping
    [J]. SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 21 - 30
  • [8] Courty N, 2017, ADV NEUR IN, V30
  • [9] Gopalan P, 2015, UNCERTAINTY IN ARTIFICIAL INTELLIGENCE, P326
  • [10] Enhanced Doubly Robust Learning for Debiasing Post-Click Conversion Rate Estimation
    Guo, Siyuan
    Zou, Lixin
    Liu, Yiding
    Ye, Wenwen
    Cheng, Suqi
    Wang, Shuaiqiang
    Chen, Hechang
    Yin, Dawei
    Chang, Yi
    [J]. SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 275 - 284