| Challenge: | Propaganda is a widely used approach for shaping public opinion and disseminating misinformation in news media. |
| Approach: | They propose a fine-grained propaganda dataset for Kinyarwanda . they find that current LLMs are not reliable annotators in low resource settings . |
| Outcome: | The proposed dataset shows that current LLMs perform poorly in low resource settings . the dataset shows they perform poorly on discourse-level techniques . |
Similar Papers
HQP: A Human-Annotated Dataset for Detecting Online Propaganda (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for detecting online propaganda use weak labels that can be noisy and incorrect. |
| Approach: | They propose a dataset for detecting online propaganda with high-quality labels . they show that state-of-the-art language models fail in detecting propaganda when trained with weak labels compared to prompt-based learning . |
| Outcome: | The proposed dataset is the first large-scale dataset for detecting online propaganda that was created through human annotation. |
Fine-Tuned Neural Models for Propaganda Detection at the Sentence and Fragment levels (D19-50)
Copied to clipboard
| Challenge: | The system was evaluated on a unified development set without distributing the gold labels. |
| Approach: | They propose to use fine-grained propaganda detection to build models that can explain why an article is propagandistic. |
| Outcome: | The proposed model performed on all eighteen propaganda techniques in the corpus of the shared task. |
Pretrained Ensemble Learning for Fine-Grained Propaganda Detection (D19-50)
Copied to clipboard
| Challenge: | Propaganda detection is a reallife challenge that can affect how people understand news . |
| Approach: | They propose to use a manually annotated dataset to tackle the propaganda detection on sentence level classification task of NLP4IF 2019 workshop co-located with EMNLP-IJCNLP 2019 conference. |
| Outcome: | The proposed model is ranked in the first place with 68.8312 F1-score on the development dataset and in the sixth place with 61.3990 F1 score on the testing dataset. |
Fine-Grained Analysis of Propaganda in News Article (D19-1)
Copied to clipboard
| Challenge: | Existing methods for detecting propaganda are noisy and lack of explainability. |
| Approach: | They propose to perform fine-grained analysis of texts by detecting all fragments that contain propaganda techniques as well as their type. |
| Outcome: | The proposed model outperforms several strong BERT-based baselines. |
Large Language Models for Propaganda Span Annotation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Using propagandistic techniques to manipulate online audiences is increasing in recent years. |
| Approach: | They investigate whether Large Language Models (LLMs) such as GPT-4 can extract propagandistic spans and the potential of employing them to collect more cost-effective annotations. |
| Outcome: | The proposed model provides labels that have higher agreement with expert annotators and lead to specialized models that achieve state-of-the-art over an unseen Arabic testing set. |
Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles (2024.lrec-main)
Copied to clipboard
| Challenge: | Using large language models (LLMs) to detect propaganda from text is a challenge for the development of sophisticated models. |
| Approach: | They propose to use a large propaganda dataset to identify propagandistic content in text, visual, or multimodal languages to improve their models. |
| Outcome: | The proposed model performs better on a large propaganda dataset than the existing models on skewed datasets. |
PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intent (2025.coling-main)
Copied to clipboard
Jiateng Liu, Lin Ai, Zizhou Liu, Payam Karisani, Zheng Hui, Yi Fung, Preslav Nakov, Julia Hirschberg, Heng Ji
| Challenge: | Existing research on propaganda detection does not capture the motives behind the content or its broader impact. |
| Approach: | They propose a framework that dissects propaganda into techniques, arousal appeals, and underlying intent. |
| Outcome: | The proposed framework improves performance in a wide range of scenarios and can be used to identify and categorize propaganda techniques. |
PropXplain: Can LLMs Enable Explainable Propaganda Detection? (2025.findings-emnlp)
Copied to clipboard
Maram Hasanain, Md Arid Hasan, Mohamed Bayan Kmainasi, Elisa Sartori, Ali Ezzat Shahroor, Giovanni Da San Martino, Firoj Alam
| Challenge: | Currently, propagandistic content detection studies focus on detection, with little attention given to explanations justifying the predicted label. |
| Approach: | They propose a multilingual explanation-enhanced dataset and an explanation-based LLM to address this issue. |
| Outcome: | The proposed model performs comparably while also generating explanations. |
EnCBP: A New Benchmark Dataset for Finer-Grained Cultural Background Prediction in English (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing research on cultural background modeling is coarse-grained and does not examine cultural differences among speakers of the same language. |
| Approach: | They use a news-based cultural background prediction dataset to annotate, validate and benchmark NLP models with cultural background features. |
| Outcome: | The proposed model improves on nine syntactic, semantic, and psycholinguistic tasks while introducing cultural background information does not improve the Go-Emotions task due to text domain conflicts. |
On Sentence Representations for Propaganda Detection: From Handcrafted Features to Word Embeddings (D19-50)
Copied to clipboard
| Challenge: | The rise of fake and hyperpartisan news on social media and online news outlets calls for improved automatic detection of propaganda in texts. |
| Approach: | They propose to use handcrafted features and learn dense semantic representations to detect propaganda in sentence-level and with random undersampling of the majority class (non-propaganda) |
| Outcome: | The proposed system achieves a ranking of 10 among 25 participants, with 59.5 F1-score. |