| Challenge: | Using propagandistic techniques to manipulate online audiences is increasing in recent years. |
| Approach: | They investigate whether Large Language Models (LLMs) such as GPT-4 can extract propagandistic spans and the potential of employing them to collect more cost-effective annotations. |
| Outcome: | The proposed model provides labels that have higher agreement with expert annotators and lead to specialized models that achieve state-of-the-art over an unseen Arabic testing set. |
Similar Papers
Can GPT-4 Identify Propaganda? Annotation and Detection of Propaganda Spans in News Articles (2024.lrec-main)
Copied to clipboard
| Challenge: | Using large language models (LLMs) to detect propaganda from text is a challenge for the development of sophisticated models. |
| Approach: | They propose to use a large propaganda dataset to identify propagandistic content in text, visual, or multimodal languages to improve their models. |
| Outcome: | The proposed model performs better on a large propaganda dataset than the existing models on skewed datasets. |
Synthetic Propaganda Embeddings To Train A Linear Projection (D19-50)
Copied to clipboard
| Challenge: | Using contextualized token embeddings, we can extract features of propaganda from contextualized embeddnings without fine-tuning the large parameters of the base model. |
| Approach: | They propose a method for detecting fine-grained categories of propaganda in text by generating synthetically generated embeddings from pre-trained language models. |
| Outcome: | The proposed method is used in the first shared task in fine-grained propaganda detection at NLP4IF as Team Stalin. |
Large Language Models for Data Annotation and Synthesis: A Survey (2024.emnlp-main)
Copied to clipboard
Zhen Tan, Dawei Li, Song Wang, Alimohammad Beigi, Bohan Jiang, Amrita Bhattacharjee, Mansooreh Karami, Jundong Li, Lu Cheng, Huan Liu
| Challenge: | Existing surveys focus on LLMs' specific utility for data annotation and synthesis. |
| Approach: | They propose to use large language models to generate annotations from raw data . they also propose to review learning strategies for models utilizing LLM-generated annotations . |
| Outcome: | The proposed models can be used to improve the efficacy of machine learning models by generating and labeling raw data with relevant information. |
PropXplain: Can LLMs Enable Explainable Propaganda Detection? (2025.findings-emnlp)
Copied to clipboard
Maram Hasanain, Md Arid Hasan, Mohamed Bayan Kmainasi, Elisa Sartori, Ali Ezzat Shahroor, Giovanni Da San Martino, Firoj Alam
| Challenge: | Currently, propagandistic content detection studies focus on detection, with little attention given to explanations justifying the predicted label. |
| Approach: | They propose a multilingual explanation-enhanced dataset and an explanation-based LLM to address this issue. |
| Outcome: | The proposed model performs comparably while also generating explanations. |
KinyaProp: Fine-Grained Propaganda Annotation in Kinyarwanda (2026.acl-long)
Copied to clipboard
| Challenge: | Propaganda is a widely used approach for shaping public opinion and disseminating misinformation in news media. |
| Approach: | They propose a fine-grained propaganda dataset for Kinyarwanda . they find that current LLMs are not reliable annotators in low resource settings . |
| Outcome: | The proposed dataset shows that current LLMs perform poorly in low resource settings . the dataset shows they perform poorly on discourse-level techniques . |
PropaInsight: Toward Deeper Understanding of Propaganda in Terms of Techniques, Appeals, and Intent (2025.coling-main)
Copied to clipboard
Jiateng Liu, Lin Ai, Zizhou Liu, Payam Karisani, Zheng Hui, Yi Fung, Preslav Nakov, Julia Hirschberg, Heng Ji
| Challenge: | Existing research on propaganda detection does not capture the motives behind the content or its broader impact. |
| Approach: | They propose a framework that dissects propaganda into techniques, arousal appeals, and underlying intent. |
| Outcome: | The proposed framework improves performance in a wide range of scenarios and can be used to identify and categorize propaganda techniques. |
“You Are An Expert Linguistic Annotator”: Limits of LLMs as Analyzers of Abstract Meaning Representation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) demonstrate proficiency and fluency in the use of language, but do they have the linguistic knowledge to serve as an expert linguistic annotator? |
| Approach: | They examine the successes and limitations of large language models using the Abstract Meaning Representation (AMR) parsing formalism. |
| Outcome: | The proposed models can reproduce the basic format of AMR, as well as some core event, argument, and modifier structure, but they have virtually no fully accurate parses. |
HQP: A Human-Annotated Dataset for Detecting Online Propaganda (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets for detecting online propaganda use weak labels that can be noisy and incorrect. |
| Approach: | They propose a dataset for detecting online propaganda with high-quality labels . they show that state-of-the-art language models fail in detecting propaganda when trained with weak labels compared to prompt-based learning . |
| Outcome: | The proposed dataset is the first large-scale dataset for detecting online propaganda that was created through human annotation. |
PlagBench: Exploring the Duality of Large Language Models in Plagiarism Generation and Detection (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent studies have raised concerns about the potential threats large language models pose to academic integrity and copyright protection. |
| Approach: | They propose a dataset of 46.5K synthetic text pairs that represent three major types of plagiarism: verbatim copying, paraphrasing, and summarization. |
| Outcome: | The proposed dataset shows that GPT-3.5 Turbo can produce high-quality paraphrases and summaries without significantly increasing text complexity compared to GPT-4 Turbo. |
Evaluating Large Language Models on Wikipedia-Style Survey Generation (2024.findings-acl)
Copied to clipboard
Fan Gao, Hang Jiang, Rui Yang, Qingcheng Zeng, Jinghui Lu, Moritz Blum, Tianwei She, Yuang Jiang, Irene Li
| Challenge: | Recent studies have shown that large language models can perform well in general tasks, but their effectiveness and limitations in domainspecific tasks remain unclear. |
| Approach: | They examine the proficiency of Large Language Models (LLMs) in generating succinct survey articles specific to the niche field of NLP in computer science. |
| Outcome: | The LLMs perform better in generating succinct survey articles specific to the niche field of NLP in computer science, compared to human-authored surveys, but they exhibit bias in evaluation. |