Graph-aware pre-trained language model for political sentiment analysis in Filipino social media

Elections are emotionally and sentimentally charged events that offer unique opportunities for analysis of sentiments not typically observed during non-election periods. Unlike recurring phenomena, elections are inherently singular events, with each election shaped by distinct political, social, and cultural contexts. In the digital age, social media has become a direct channel for politicians and political parties to engage with voters, making it a critical platform for sentiment analysis. However, challenges such as imbalanced datasets, the prevalence of noisy non-text elements (e.g., emojis, hashtags, user mentions), and the need for effective integration of graphbased learning remain significant hurdles in sentiment prediction. To address these challenges, we constructed an imbalanced dataset of 8035 manually annotated tweets and approximately 516,000 weakly labeled Filipino tweets related to the 2022 Philippine National Election. Leveraging these datasets, we designed a Bidirectional Encoder Representations from Transformers (BERT) and Graph Convolution Network (GCN) model, which uniquely incorporates emojis, hashtags, and user mentions as features to enhance semantic understanding. Differing from the prior literature that focused solely on textual data or discarded non-textual elements, our model integrates these features to achieve a robust performance that outperforms baseline models with a macrorecall score of 64.73% and a macro F1-score of 68.72% on the imbalanced dataset. Additionally, we introduce a topic modeling framework that combines BERT embeddings with Latent Dirichlet Allocation (LDA) and LogLikelihood Ratio (LLR) to yield more distinct topic clusters for deeper sentiment analysis. Our work therefore contributes two novel datasets in Filipino as well as methodologies that bridge sentiment prediction and analysis, and in so doing, provides valuable resources for future research.