Fine-tuning with Hierarchical Prompting for Robust Propaganda Classification Across Annotation Schemas (2026.findings-acl)
Copied to clipboard
Lukas Stähelin, Veronika Solopova, Max Upravitelev, David Kaplan, Premtim Sahitaj, Ariana Sahitaj, Charlott Jakob, Sebastian Möller, Vera Schmitt
| Challenge: | Propaganda detection in social media is challenging due to noisy, short texts and low annotation agreements. |
| Approach: | They propose a new intent-focused taxonomy of propaganda techniques and compare it against an established, higher-agreement schema. |
| Outcome: | The proposed taxonomy outperforms existing models and reveals methodological differences hidden in base models. |
Similar Papers
HQP: A Human-Annotated Dataset for Detecting Online Propaganda (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for detecting online propaganda use weak labels that can be noisy and incorrect. |
| Approach: | They propose a dataset for detecting online propaganda with high-quality labels . they show that state-of-the-art language models fail in detecting propaganda when trained with weak labels compared to prompt-based learning . |
| Outcome: | The proposed dataset is the first large-scale dataset for detecting online propaganda that was created through human annotation. |
Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles (2024.lrec-main)
Copied to clipboard
| Challenge: | Using large language models (LLMs) to detect propaganda from text is a challenge for the development of sophisticated models. |
| Approach: | They propose to use a large propaganda dataset to identify propagandistic content in text, visual, or multimodal languages to improve their models. |
| Outcome: | The proposed model performs better on a large propaganda dataset than the existing models on skewed datasets. |
Fine-Tuned Neural Models for Propaganda Detection at the Sentence and Fragment levels (D19-50)
Copied to clipboard
| Challenge: | The system was evaluated on a unified development set without distributing the gold labels. |
| Approach: | They propose to use fine-grained propaganda detection to build models that can explain why an article is propagandistic. |
| Outcome: | The proposed model performed on all eighteen propaganda techniques in the corpus of the shared task. |
Annotating the Annotators: Analysis, Insights and Modelling from an Annotation Campaign on Persuasion Techniques Detection (2025.findings-acl)
Copied to clipboard
Davide Bassi, Dimitar Iliyanov Dimitrov, Bernardo D’Auria, Firoj Alam, Maram Hasanain, Christian Moro, Luisa Orrù, Gian Piero Turchi, Preslav Nakov, Giovanni Da San Martino
| Challenge: | Existing annotation campaigns based on heuristic guidelines have not been thoroughly discussed. |
| Approach: | They propose a probabilistic model for optimizing intervention scheduling to reduce the cost of an expert oversight in annotation tasks. |
| Outcome: | The proposed model advocates for an expert oversight in annotation tasks and periodic quality audits to reduce costs. |
Large Language Models for Propaganda Span Annotation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Using propagandistic techniques to manipulate online audiences is increasing in recent years. |
| Approach: | They investigate whether Large Language Models (LLMs) such as GPT-4 can extract propagandistic spans and the potential of employing them to collect more cost-effective annotations. |
| Outcome: | The proposed model provides labels that have higher agreement with expert annotators and lead to specialized models that achieve state-of-the-art over an unseen Arabic testing set. |
TWEETSPIN: Fine-grained Propaganda Detection in Social Media Using Multi-View Representations (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies on propaganda detection involve document and fragment-level analyses of news articles. |
| Approach: | They propose a neural approach to detect and categorize propaganda tweets across fine-grained categories . they use a dataset containing tweets weakly annotated with different propaganda techniques . |
| Outcome: | The proposed method outperforms benchmark methods and transfers knowledge to low-resource news domains. |
Ensembling Prompting Strategies for Zero-Shot Hierarchical Text Classification with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Hierarchical text classification is a challenging task in natural language processing. |
| Approach: | They propose a method which integrates the results of diverse prompting strategies to promote LLMs’ reliability. |
| Outcome: | The proposed method boosts the performance of single prompting strategies and achieves SOTA results on three benchmark datasets. |
KinyaProp: Fine-Grained Propaganda Annotation in Kinyarwanda (2026.acl-long)
Copied to clipboard
| Challenge: | Propaganda is a widely used approach for shaping public opinion and disseminating misinformation in news media. |
| Approach: | They propose a fine-grained propaganda dataset for Kinyarwanda . they find that current LLMs are not reliable annotators in low resource settings . |
| Outcome: | The proposed dataset shows that current LLMs perform poorly in low resource settings . the dataset shows they perform poorly on discourse-level techniques . |
Zero-shot prompt-based classification: topic labeling in times of foundation models in German Tweets (2025.acl-srw)
Copied to clipboard
| Challenge: | Recent advances in NLP have enabled the use of text-to-text annotation without providing training samples. |
| Approach: | They propose a text-to-text interface for automatic annotation using written guidelines without providing training samples. |
| Outcome: | The proposed approach is comparable with the fine-tuned BERT but without any training data. |
Synthetic Propaganda Embeddings To Train A Linear Projection (D19-50)
Copied to clipboard
| Challenge: | Using contextualized token embeddings, we can extract features of propaganda from contextualized embeddnings without fine-tuning the large parameters of the base model. |
| Approach: | They propose a method for detecting fine-grained categories of propaganda in text by generating synthetically generated embeddings from pre-trained language models. |
| Outcome: | The proposed method is used in the first shared task in fine-grained propaganda detection at NLP4IF as Team Stalin. |