Multi-task Learning for Features Extraction in Financial Annual Reports

被引:0
作者
Montariol, Syrielle [1 ]
Martinc, Matej [1 ]
Pelicon, Andraz [1 ]
Pollak, Senja [1 ]
Koloski, Boshko [1 ]
Loncarski, Igor [2 ]
Valentincic, Aljosa [2 ]
Sustar, Katarina Sitar [2 ]
Ichev, Riste [2 ]
Znidarsic, Martin [1 ]
机构
[1] Jozef Stefan Inst, Jamova Cesta 39, Ljubljana 1000, Slovenia
[2] Univ Ljubljana, Sch Econ & Business, Kardeljeva Pl 17, Ljubljana 1000, Slovenia
来源
MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II | 2023年 / 1753卷
关键词
Multi-task learning; Financial reports; Corporate social responsibility; INFORMATION; DISCLOSURE;
D O I
10.1007/978-3-031-23633-4_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For assessing various performance indicators of companies, the focus is shifting from strictly financial (quantitative) publicly disclosed information to qualitative (textual) information. This textual data can provide valuable weak signals, for example through stylistic features, which can complement the quantitative data on financial performance or on Environmental, Social and Governance (ESG) criteria. In this work, we use various multi-task learning methods for financial text classification with the focus on financial sentiment, objectivity, forward-looking sentence prediction and ESG-content detection. We propose different methods to combine the information extracted from training jointly on different tasks; our best-performing method highlights the positive effect of explicitly adding auxiliary task predictions as features for the final target task during the multi-task training. Next, we use these classifiers to extract textual features from annual reports of FTSE350 companies and investigate the link between ESG quantitative scores and these features.
引用
收藏
页码:7 / 24
页数:18
相关论文
共 50 条
[31]   Multi-task learning for aspect term extraction and aspect sentiment classification [J].
Akhtar, Md Shad ;
Garg, Tarun ;
Ekbal, Asif .
NEUROCOMPUTING, 2020, 398 :247-256
[32]   Enhancing relation extraction using multi-task learning with SDP evidence [J].
Wang, Hailin ;
Zhang, Dan ;
Liu, Guisong ;
Huang, Li ;
Qin, Ke .
INFORMATION SCIENCES, 2024, 670
[33]   Predicting Glaucoma Progression using Multi-task Learning with Heterogeneous Features [J].
Maya, Shigeru ;
Morino, Kai ;
Yamanishi, Kenji .
2014 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2014, :261-270
[34]   A Multi-task Learning Framework with Features Based on Behavioral Pattern Conversation [J].
Tang, Bo ;
Wang, Nan ;
Li, Jinbao ;
Shen, Zhonghui .
MOBILE AND UBIQUITOUS SYSTEMS: COMPUTING, NETWORKING AND SERVICES, MOBIQUITOUS 2023, PT II, 2024, 594 :256-267
[35]   Task Variance Regularized Multi-Task Learning [J].
Mao, Yuren ;
Wang, Zekai ;
Liu, Weiwei ;
Lin, Xuemin ;
Hu, Wenbin .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2023, 35 (08) :8615-8629
[36]   MULTI-TASK DISTILLATION: TOWARDS MITIGATING THE NEGATIVE TRANSFER IN MULTI-TASK LEARNING [J].
Meng, Ze ;
Yao, Xin ;
Sun, Lifeng .
2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, :389-393
[37]   Multimodal Multi-Task Financial Risk Forecasting [J].
Sawhney, Ramit ;
Mathur, Puneet ;
Mangal, Ayush ;
Khanna, Piyush ;
Shah, Rajiv Ratn ;
Zimmermann, Roger .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :456-465
[38]   Curriculum Modeling the Dependence among Targets with Multi-task Learning for Financial Marketing [J].
Weng, Yunpeng ;
Tang, Xing ;
Chen, Liang ;
He, Xiuqiang .
PROCEEDINGS OF THE 46TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, SIGIR 2023, 2023, :1914-1918
[39]   Dual-Task Network for Terrace and Ridge Extraction: Automatic Terrace Extraction via Multi-Task Learning [J].
Zhang, Jun ;
Zhang, Jun ;
Huang, Xiao ;
Zhou, Weixun ;
Fu, Huyan ;
Chen, Yuyan ;
Zhan, Zhenghao .
REMOTE SENSING, 2024, 16 (03)
[40]   LEARNING DEEP FEATURES FOR MULTIPLE OBJECT TRACKING BY USING A MULTI-TASK LEARNING STRATEGY [J].
Wang, Li ;
Nam Trung Pham ;
Ng, Tian-Tsong ;
Wang, Gang ;
Chan, Kap Luk ;
Leman, Karianto .
2014 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2014, :838-842