An Ensemble Framework Based on Fine Multi-Window Feature Engineering and Overfitting Prevention for Transportation Mode Recognition

被引:2
作者
Zeng, Zehong [1 ]
Liu, Yueyang [1 ]
Lu, Xiaoshi [1 ]
Zhang, Yuanyuan [2 ]
Lu, Xiaoling [1 ]
机构
[1] Renmin Univ China, Ctr Appl Stat, Sch Stat, Beijing, Peoples R China
[2] Beijing Baixingkefu Network Technol Co Ltd, Beijing, Peoples R China
来源
ADJUNCT PROCEEDINGS OF THE 2023 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING & THE 2023 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTING, UBICOMP/ISWC 2023 ADJUNCT | 2023年
基金
中国国家自然科学基金;
关键词
Transportation Mode Recognition; Feature Engineering; Model Ensemble; Overfitting Prevention;
D O I
10.1145/3594739.3610756
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents our solution to the SHL recognition challenge 2023 which focuses on recognizing 8 transportation modes in a user-independent manner based on motion and GPS sensor data. Our team ZZL propose an ensemble framework based on fine multi-window feature engineering and overfitting prevention. Firstly, we extracted a large and diverse set of features in the feature engineering process, including incorporating OpenStreetMap data to better leverage location data, and introducing multiple time windows to extract long, medium, and short term aggregated features, providing rich feature inputs. Secondly, we proposed an ensemble framework that comprehensively utilizes different techniques to prevent overfitting, including data downsampling, fine-tuning data distribution, designed train-test splitting, and model integration. Moreover, we applied post-processing on the model predictions to smooth the predicted results. Finally, we achieve F1-score of 0.868 on validation dataset.
引用
收藏
页码:563 / 568
页数:6
相关论文
共 12 条
[1]  
[Anonymous], OPENSTREETMAP DAT GU
[2]   IndRNN Based Long-term Temporal Recognition in the Spatial an Frequency Domain [J].
Zhao, Beidi ;
Li, Shuai ;
Gao, Yanbo .
UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2020, :368-372
[3]   Combining LSTM and CNN for Mode of Transportation Classification from Smartphone Sensors [J].
Friedrich, Bjoern ;
Luebbe, Carolin ;
Hein, Andreas .
UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2020, :305-310
[4]   The University of Sussex-Huawei Locomotion and Transportation Dataset for Multimodal Analytics With Mobile Devices [J].
Gjoreski, Hristijan ;
Ciliberto, Mathias ;
Wang, Lin ;
Morales, Francisco Javier Ordonez ;
Mekki, Sami ;
Valentin, Stefan ;
Roggen, Daniel .
IEEE ACCESS, 2018, 6 :42592-42604
[5]   Tackling the SHL Challenge 2020 with Person-specific Classifiers and Semi-supervised Learning [J].
Kalabakov, Stefan ;
Stankoski, Simon ;
Rescic, Nina ;
Kiprijanovska, Ivana ;
Andova, Andrejaana ;
Picard, Clement ;
Janko, Vito ;
Gjoreski, Martin ;
Lustrek, Mitja .
UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2020, :323-328
[6]   Activity Recognition for Locomotion and Transportation Dataset Using Deep Learning [J].
Naseeb, Chan ;
Al Saeedi, Bilal .
UBICOMP/ISWC '20 ADJUNCT: PROCEEDINGS OF THE 2020 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2020 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2020, :329-334
[7]  
OpenStreetMap, 2023, About Us
[8]   Multiple Tree Model Integration for Transportation Mode Recognition [J].
Ren, Yan .
UBICOMP/ISWC '21 ADJUNCT: PROCEEDINGS OF THE 2021 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2021 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2021, :385-389
[9]   Triple-O for SHL Recognition Challenge: An Ensemble Framework for Multi-class Imbalance and Training-testing Distribution Inconsistency by OvO Binarization with Confidence Weight of One-class Classification [J].
Su, Jinhua ;
Zhang, Yuanyuan .
UBICOMP/ISWC '21 ADJUNCT: PROCEEDINGS OF THE 2021 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2021 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2021, :401-407
[10]  
Wang L., 2023, P 2023 ACM INT JOINT