Multi-task Learning for Features Extraction in Financial Annual Reports

被引:0
作者
Montariol, Syrielle [1 ]
Martinc, Matej [1 ]
Pelicon, Andraz [1 ]
Pollak, Senja [1 ]
Koloski, Boshko [1 ]
Loncarski, Igor [2 ]
Valentincic, Aljosa [2 ]
Sustar, Katarina Sitar [2 ]
Ichev, Riste [2 ]
Znidarsic, Martin [1 ]
机构
[1] Jozef Stefan Inst, Jamova Cesta 39, Ljubljana 1000, Slovenia
[2] Univ Ljubljana, Sch Econ & Business, Kardeljeva Pl 17, Ljubljana 1000, Slovenia
来源
MACHINE LEARNING AND PRINCIPLES AND PRACTICE OF KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT II | 2023年 / 1753卷
关键词
Multi-task learning; Financial reports; Corporate social responsibility; INFORMATION; DISCLOSURE;
D O I
10.1007/978-3-031-23633-4_1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
For assessing various performance indicators of companies, the focus is shifting from strictly financial (quantitative) publicly disclosed information to qualitative (textual) information. This textual data can provide valuable weak signals, for example through stylistic features, which can complement the quantitative data on financial performance or on Environmental, Social and Governance (ESG) criteria. In this work, we use various multi-task learning methods for financial text classification with the focus on financial sentiment, objectivity, forward-looking sentence prediction and ESG-content detection. We propose different methods to combine the information extracted from training jointly on different tasks; our best-performing method highlights the positive effect of explicitly adding auxiliary task predictions as features for the final target task during the multi-task training. Next, we use these classifiers to extract textual features from annual reports of FTSE350 companies and investigate the link between ESG quantitative scores and these features.
引用
收藏
页码:7 / 24
页数:18
相关论文
共 50 条
[21]   An overview of multi-task learning [J].
Zhang, Yu ;
Yang, Qiang .
NATIONAL SCIENCE REVIEW, 2018, 5 (01) :30-43
[22]   Calibrated Multi-Task Learning [J].
Nie, Feiping ;
Hu, Zhanxuan ;
Li, Xuelong .
KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, :2012-2021
[23]   An overview of multi-task learning [J].
Yu Zhang ;
Qiang Yang .
National Science Review, 2018, 5 (01) :30-43
[24]   Boosted multi-task learning [J].
Chapelle, Olivier ;
Shivaswamy, Pannagadatta ;
Vadrevu, Srinivas ;
Weinberger, Kilian ;
Zhang, Ya ;
Tseng, Belle .
MACHINE LEARNING, 2011, 85 (1-2) :149-173
[25]   Parallel Multi-Task Learning [J].
Zhang, Yu .
2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, :629-638
[26]   Survey of Multi-Task Learning [J].
Zhang Y. ;
Liu J.-W. ;
Zuo X. .
Jisuanji Xuebao/Chinese Journal of Computers, 2020, 43 (07) :1340-1378
[27]   A Survey on Multi-Task Learning [J].
Zhang, Yu ;
Yang, Qiang .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2022, 34 (12) :5586-5609
[28]   A multi-task learning based approach to biomedical entity relation extraction [J].
Li, Qingqing ;
Yang, Zhihao ;
Luo, Ling ;
Wang, Lei ;
Zhang, Yin ;
Lin, Hongfei ;
Wang, Jian ;
Yang, Liang ;
Xu, Kan ;
Zhang, Yijia .
PROCEEDINGS 2018 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2018, :680-682
[29]   Joint Extraction of Nested Entities and Relations Based on Multi-task Learning [J].
Wan, Jing ;
Qin, Chunyu ;
Yang, Jing .
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, KSEM 2023, 2023, 14118 :368-382
[30]   Multi-task learning for aspect term extraction and aspect sentiment classification [J].
Akhtar, Md Shad ;
Garg, Tarun ;
Ekbal, Asif .
NEUROCOMPUTING, 2020, 398 :247-256