A Multi-task Transformer Architecture for Drone State Identification and Trajectory Prediction

被引:0
作者
Souli, Nicolas [1 ,2 ]
Palamas, Andreas [4 ]
Panayiotou, Tania [1 ,2 ]
Kolios, Panayiotis [2 ,3 ]
Ellinas, Georgios [1 ,2 ]
机构
[1] Univ Cyprus, Dept Elect & Comp Engn, Nicosia, Cyprus
[2] Univ Cyprus, KIOS Res & Innovat Ctr Excellence, Nicosia, Cyprus
[3] Univ Cyprus, Dept Comp Sci, Nicosia, Cyprus
[4] Wiztech Grp, Limassol, Cyprus
来源
2024 20TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SMART SYSTEMS AND THE INTERNET OF THINGS, DCOSS-IOT 2024 | 2024年
关键词
Multi-task learning; Transformers; Drone trajectory prediction; State identification;
D O I
10.1109/DCOSS-IoT61029.2024.00051
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
With the proliferation of unmanned aerial vehicles in various applications ranging from delivery services to surveillance and rescue operations, an efficient drone state identification and trajectory prediction framework is becoming a mandate. This work introduces a novel multi-task learning framework that provides drone state identification and trajectory prediction enhancements with the use of a novel Transformer neural network architecture. The proposed system exploits the ability of Transformer models to handle sequential data, capturing more effectively than conventional models' temporal dependencies and relations inherent to drone movement data. The proposed framework utilizes a dual-task learning approach, facilitating simultaneous prediction of drone state and trajectory and enhancing both tasks' performance via shared feature learning. Extensive evaluations are conducted to validate the efficiency of the proposed framework, with two complementary datasets encompassing diverse drone movements and conditions. The results demonstrate significant improvement in terms of drone state identification and trajectory prediction performance compared to existing methods.
引用
收藏
页码:285 / 291
页数:7
相关论文
共 50 条
[31]   Bidirectional Transformer Based Multi-Task Learning for Natural Language Understanding [J].
Tripathi, Suraj ;
Singh, Chirag ;
Kumar, Abhay ;
Pandey, Chandan ;
Jain, Nishant .
NATURAL LANGUAGE PROCESSING AND INFORMATION SYSTEMS (NLDB 2019), 2019, 11608 :54-65
[32]   Conditional Multi-Task learning for Plant Disease Identification [J].
Lee, Sue Han ;
Goeau, Herve ;
Bonnet, Pierre ;
Joly, Alexis .
2020 25TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2021, :3320-3327
[33]   MULTI-TASK LEARNING FOR FACE IDENTIFICATION AND ATTRIBUTE ESTIMATION [J].
Hsieh, Hui-Lan ;
Hsu, Winston ;
Chen, Yan-Ying .
2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, :2981-2985
[34]   A multi-task minutiae transformer network for fingerprint recognition of young children [J].
Liu, Manhua ;
Liu, Aitong ;
Shi, Yelin ;
Liu, Shuxin .
EXPERT SYSTEMS WITH APPLICATIONS, 2025, 273
[35]   A Multi-Task Representation Learning Architecture for Enhanced Graph Classification [J].
Xie, Yu ;
Gong, Maoguo ;
Gao, Yuan ;
Qin, A. K. ;
Fan, Xiaolong .
FRONTIERS IN NEUROSCIENCE, 2020, 13
[36]   Adaptive transformer-based multi-task learning framework for synchronous prediction of substation flooding and outage risks [J].
Shi, Yu ;
Shi, Ying ;
Yao, Degui ;
Lu, Ming ;
Liang, Yun .
ELECTRIC POWER SYSTEMS RESEARCH, 2025, 242
[37]   Multi-task Learning for Person Re-identification [J].
Gao, Hua ;
Yu, Lingyan ;
Huang, Yujiao ;
Dong, Yiwei ;
Chan, Sixian .
INTELLIGENCE SCIENCE AND BIG DATA ENGINEERING, ISCIDE 2017, 2017, 10559 :259-268
[38]   Deep multi-task learning with flexible and compact architecture search [J].
Zhao, Jiejie ;
Lv, Weifeng ;
Du, Bowen ;
Ye, Junchen ;
Sun, Leilei ;
Xiong, Guixi .
INTERNATIONAL JOURNAL OF DATA SCIENCE AND ANALYTICS, 2023, 15 (02) :187-199
[39]   Deep multi-task learning with flexible and compact architecture search [J].
Jiejie Zhao ;
Weifeng Lv ;
Bowen Du ;
Junchen Ye ;
Leilei Sun ;
Guixi Xiong .
International Journal of Data Science and Analytics, 2023, 15 :187-199
[40]   Exploring Multi-Task Multi-Lingual Learning of Transformer Models for Hate Speech and Offensive Speech Identification in Social Media [J].
Mishra S. ;
Prasad S. ;
Mishra S. .
SN Computer Science, 2021, 2 (2)