Enhancing Explicit and Implicit Feature Interactions via Information Sharing for Parallel Deep CTR Models

被引:35
作者
Chen, Bo [1 ]
Wang, Yichao [1 ]
Liu, Zhirong [1 ]
Tang, Ruiming [1 ]
Guo, Wei [1 ]
Zheng, Hongkun [2 ]
Yao, Weiwei [2 ]
Zhang, Muyu [2 ]
He, Xiuqiang [1 ]
机构
[1] Huawei Noahs Ark Lab, Shenzhen, Peoples R China
[2] Huawei Technol Co Ltd, Shenzhen, Peoples R China
来源
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON INFORMATION & KNOWLEDGE MANAGEMENT, CIKM 2021 | 2021年
关键词
Click-Through Rate Prediction; Neural Network; Feature Interactions;
D O I
10.1145/3459637.3481915
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Effectively modeling feature interactions is crucial for CTR prediction in industrial recommender systems. The state-of-the-art deep CTR models with parallel structure (e.g., DCN) learn explicit and implicit feature interactions through independent parallel networks. However, these models suffer from trivial sharing issues, namely insufficient sharing in hidden layers and excessive sharing in network input, limiting the model's expressiveness and effectiveness. Therefore, to enhance information sharing between explicit and implicit feature interactions, we propose a novel deep CTR model EDCN. EDCN introduces two advanced modules, namely bridge module and regulation module, which work collaboratively to capture the layer-wise interactive signals and learn discriminative feature distributions for each hidden layer of the parallel networks. Furthermore, two modules are lightweight and model-agnostic, which can be generalized well to mainstream parallel deep CTR models. Extensive experiments and studies are conducted to demonstrate the effectiveness of EDCN on two public datasets and one industrial dataset. Moreover, the compatibility of two modules over various parallel-structured models is verified, and they have been deployed onto the online advertising platform in Huawei, where a one-month A/B test demonstrates the improvement over the base parallel-structured model by 7.30% and 4.85% in terms of CTR and eCPM, respectively.
引用
收藏
页码:3757 / 3766
页数:10
相关论文
共 41 条
[1]  
[Anonymous], 2010, P 27 INT C MACH LEAR
[2]  
[Anonymous], P 19 ACM SIGKDD INT
[3]  
Blondel Mathieu, 2016, P 30 C NEUR INF PROC
[4]  
Cheng Heng-Tze, 2016, P 1 WORKSHOP DEEP LE, P7
[5]   Automatic heart girth measurement for cattle based on deep learning [J].
Du, Ao ;
Guo, Hao ;
Lu, Jie ;
Su, Yang ;
Ruchay, Alexey ;
Pezzuolo, Andrea .
2021 IEEE INTERNATIONAL WORKSHOP ON METROLOGY FOR AGRICULTURE AND FORESTRY (IEEE METROAGRIFOR 2021), 2021, :27-31
[6]  
Guo HF, 2017, PROCEEDINGS OF THE TWENTY-SIXTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P1725
[7]   Order-aware Embedding Neural Network for CTR Prediction [J].
Guo, Wei ;
Tang, Ruiming ;
Guo, Huifeng ;
Han, Jianhua ;
Yang, Wen ;
Zhang, Yuzhou .
PROCEEDINGS OF THE 42ND INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL (SIGIR '19), 2019, :1121-1124
[8]  
He X., 2014, Proceedings of the Eighth International Workshop on data Mining for Online Advertising, P1, DOI [DOI 10.1145/2648584.2648589, 10.1145/2648584.2648589]
[9]   Neural Factorization Machines for Sparse Predictive Analytics [J].
He, Xiangnan ;
Chua, Tat-Seng .
SIGIR'17: PROCEEDINGS OF THE 40TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2017, :355-364
[10]  
Hu D, 2019, INT CONF ACOUST SPEE, P3941, DOI [10.1109/icassp.2019.8683898, 10.1109/ICASSP.2019.8683898]