AFM3D: An Asynchronous Federated Meta-Learning Framework for Driver Distraction Detection

被引:4
作者
Liu, Sheng [1 ,2 ]
You, Linlin [1 ,2 ]
Zhu, Rui [3 ]
Liu, Bing [4 ,5 ]
Liu, Rui [6 ]
Yu, Han [6 ]
Yuen, Chau [7 ]
机构
[1] Sun Yat Sen Univ, Sch Intelligent Syst Engn, Shenzhen 518107, Peoples R China
[2] Guangdong Prov Key Lab Intelligent Transportat Sy, Guangzhou 510275, Peoples R China
[3] ASTAR, Inst High Performance Comp, Singapore 138632, Singapore
[4] BYD Auto Co Ltd, Shenzhen 518118, Peoples R China
[5] Univ Sci & Technol China, Sch Comp Sci & Technol, Hefei 230026, Peoples R China
[6] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[7] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Three-dimensional displays; Data models; Vehicles; Task analysis; Solid modeling; Metalearning; Context modeling; Driver distraction detection; federated learning; asynchronous federated learning; federated meta-learning;
D O I
10.1109/TITS.2024.3357138
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Driver Distraction Detection (3D) is of great significance in helping intelligent vehicles decide whether to remind drivers or take over the driving task and avoid traffic accidents. However, the current centralized learning paradigm of 3D has become unpractical because of rising limitations on data sharing and increasing concerns about user privacy. In this context, 3D is further facing three emerging challenges, namely data islands, data heterogeneity, and the straggler issue. To jointly address these three issues and make the 3D model training and deployment more practical and efficient, this paper proposes an Asynchronous Federated Meta-learning framework called AFM3D. Specifically, AFM3D bridges data islands through Federated Learning (FL), a novel distributed learning paradigm that enables multiple clients (i.e., private vehicles with individual data of drivers) to learn a global model collaboratively without data exchange. Moreover, AFM3D further utilizes meta-learning to tackle data heterogeneity by training a meta-model that can adapt to new driver data quickly with satisfactory performance. Finally, AFM3D is designed to operate in an asynchronous mode to reduce delays caused by stragglers and achieve efficient learning. A temporally weighted aggregation strategy is also designed to handle stale models commonly encountered in the asynchronous mode and in turn, optimize the aggregation direction. Extensive experiment results show that AFM3D can boost performance in terms of model accuracy, recall, F1 score, test loss, and learning speed by 7.61%, 7.44%, 7.95%, 9.95%, and 50.91%, respectively, against five state-of-the-art methods.
引用
收藏
页码:9659 / 9674
页数:16
相关论文
共 53 条
  • [1] Abouelnaga Y, 2018, Arxiv, DOI arXiv:1706.09498
  • [2] FedAT: A High-Performance and Communication -Efficient Federated Learning System with Asynchronous Tiers
    Chai, Zheng
    Chen, Yujing
    Anwar, Ali
    Zhao, Liang
    Cheng, Yue
    Rangwala, Huzefa
    [J]. SC21: INTERNATIONAL CONFERENCE FOR HIGH PERFORMANCE COMPUTING, NETWORKING, STORAGE AND ANALYSIS, 2021,
  • [3] Chen F, 2019, Arxiv, DOI arXiv:1802.07876
  • [4] Chen S., P IEEE SMARTW UB INT
  • [5] Asynchronous Online Federated Learning for Edge Devices with Non-IID Data
    Chen, Yujing
    Ning, Yue
    Slawski, Martin
    Rangwala, Huzefa
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2020, : 15 - 24
  • [6] Privacy enabled driver behavior analysis in heterogeneous IoV using federated learning
    Chhabra, Rishu
    Singh, Saravjeet
    Khullar, Vikas
    [J]. ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 120
  • [7] FLEET: Online Federated Learning via Staleness Awareness and Performance Prediction
    Damaskinos, Georgios
    Guerraoui, Rachid
    Kermarrec, Anne-Marie
    Nitu, Vlad
    Patra, Rhicheek
    Taiani, Francois
    [J]. ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2022, 13 (05)
  • [8] Federated Learning-based Driver Activity Recognition for Edge Devices
    Doshi, Keval
    Yilmaz, Yasin
    [J]. 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS, CVPRW 2022, 2022, : 3337 - 3345
  • [9] FRNet: DCNN for Real-Time Distracted Driving Detection Toward Embedded Deployment
    Duan, Cong
    Gong, Yipeng
    Liao, Jiacai
    Zhang, Minghai
    Cao, Libo
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (09) : 9835 - 9848
  • [10] Fallah A, 2020, ADV NEUR IN, V33