Towards Communication-Efficient Model Updating for On-Device Session-Based Recommendation

被引:2
作者
Xia, Xin [1 ]
Yu, Junliang [1 ]
Xu, Guandong [2 ]
Yin, Hongzhi [1 ]
机构
[1] Univ Queensland, Brisbane, Qld, Australia
[2] Univ Technol Sydney, Sydney, NSW, Australia
来源
PROCEEDINGS OF THE 32ND ACM INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE MANAGEMENT, CIKM 2023 | 2023年
基金
澳大利亚研究理事会;
关键词
Session-Based Recommendation; On-Device Recommendation; Model Compression; Recommender Systems; NETWORKS;
D O I
10.1145/3583780.3615088
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
On-device recommender systems recently have garnered increasing attention due to their advantages of providing prompt response and securing privacy. To stay current with evolving user interests, cloud-based recommender systems are periodically updated with new interaction data. However, on-device models struggle to retrain themselves because of limited onboard computing resources. As a solution, we consider the scenario where the model retraining occurs on the server side and then the updated parameters are transferred to edge devices via network communication. While this eliminates the need for local retraining, it incurs a regular transfer of parameters that significantly taxes network bandwidth. To mitigate this issue, we develop an efficient approach based on compositional codes to compress the model update. This approach ensures the on-device model is updated flexibly with minimal additional parameters whilst utilizing previous knowledge. The extensive experiments conducted on multiple session-based recommendation models with distinctive architectures demonstrate that the on-device model can achieve comparable accuracy to the retrained server-side counterpart through transferring an update 60x smaller in size. The codes are available at https://github.com/xiaxin1998/ODUpdate.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Aji A. F., 2017, P 2017 C EMP METH NA, DOI [10.18653/v1/D17-1045, DOI 10.18653/V1/D17-1045]
  • [2] Changmai Benu Madhab, 2019, ARXIV190912756
  • [3] Update Compression for Deep Neural Networks on the Edge
    Chen, Bo
    Bakhshi, Ali
    Batista, Gustavo
    Ng, Brian
    Chin, Tat-Jun
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3075 - 3085
  • [4] Chen Ting, 2018, P MACHINE LEARNING R, P854
  • [5] Learning Elastic Embeddings for Customizing On-Device Recommenders
    Chen, Tong
    Yin, Hongzhi
    Zheng, Yujia
    Huang, Zi
    Wang, Yang
    Wang, Meng
    [J]. KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, : 138 - 147
  • [6] Chen WL, 2015, PR MACH LEARN RES, V37, P2285
  • [7] DESIGN AND CHARACTERIZATION OF A MEDICAL MULTI-BEAM SYSTEM WITH DIRECTLY GROWN CNT FIELD EMISSION EMITTERS
    Choi, Jinho
    Lee, Hanna
    Yu, Junho
    Gupta, Amar Prasad
    Sharma, Mrinal Bhusal
    Jang, Jaekyu
    Jung, Jaeik
    Lee, Won Jung
    Yeo, Seung Jun
    Kim, Seung Hoon
    Kong, Moonkyoo
    Ryu, Jehwang
    [J]. 2023 IEEE 36TH INTERNATIONAL VACUUM NANOELECTRONICS CONFERENCE, IVNC, 2023, : 201 - 203
  • [8] A Survey of On-Device Machine Learning: An Algorithms and Learning Theory Perspective
    Dhar, Sauptik
    Guo, Junyao
    Liu, Jiayi
    Tripathi, Samarth
    Kurup, Unmesh
    Shah, Mohak
    [J]. ACM TRANSACTIONS ON INTERNET OF THINGS, 2021, 2 (03):
  • [9] Gong Y., 2014, ARXIV14126115
  • [10] Gretton A, 2012, J MACH LEARN RES, V13, P723