Content Moderation for Evolving Policies using Binary Question Answering (2023.acl-industry)
Copied to clipboard
| Challenge: | Social media platforms use content moderation to safeguard users from abuse, harassment, malicious attacks, spam, etc. |
| Approach: | They propose to model content moderation as a binary question answering problem where questions validate loosely coupled themes constituting a policy. |
| Outcome: | The proposed model improves recall at 95% precision on two proprietary datasets of social media posts and comments respectively annotated under curated Hate Speech and Commercial Spam policies. |
Similar Papers
Decoding the Rule Book: Extracting Hidden Moderation Criteria from Reddit Communities (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to train classifiers that predict norm violations are often opacity-prone . a new approach to identify and extract these implicit criteria from historical moderation data is proposed . |
| Approach: | They propose to extract implicit criteria from historical moderation data using an interpretable architecture. |
| Outcome: | The proposed model replicates neural moderation models while providing transparent insights into decision-making processes. |
CHAIRO: Contextual Hierarchical Analogical Induction and Reasoning Optimization for LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) have enabled more sophisticated content moderation, but these methods lack generalization, interpretability, and adaptability to unseen or ambiguous cases. |
| Approach: | They propose a new moderation framework that leverages analogical examples to enhance rule induction and decision reliability. |
| Outcome: | The proposed method outperforms rule-injected fine-tuning baselines and multi-stage static RAG pipelines in terms of moderation accuracy and rule quality. |
STAND-Guard: A Small Task-Adaptive Content Moderation Model (2025.coling-industry)
Copied to clipboard
| Challenge: | Content moderation is important for developing welcoming online platforms and responsible large language models. |
| Approach: | They propose a small task-adaptive coNtent moDeration model that can be easily adapted to new or customized content moderation tasks without extensive model tuning. |
| Outcome: | The proposed model is comparable to GPT-3.5-Turbo on unseen English binary classification tasks. |
A System for Dynamically Tracking Content Moderation on Reddit (2026.acl-demo)
Copied to clipboard
| Challenge: | Recent work in social media platforms delegate content moderation decisions to users and communities. |
| Approach: | They propose a software system for the dynamic monitoring of Reddit posts, communities, and moderation actions to enable scalable and reproducible research on decentralized platform governance and content moderation. |
| Outcome: | The proposed system is the only available solution for general-purpose, real-time, policy-compliant longitudinal data collection on Reddit. |
TNT: Text Normalization based Pre-training of Transformers for Content Moderation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Language model pre-training (self-supervised or unsupervised learning) has been widely used in a multitude of language processing tasks such as named entity recognition, sentiment analysis, question answering and content moderation. |
| Approach: | They propose a new language pre-training model TNT for content moderation that uses a combination of masking strategy and text normalization to learn from text. |
| Outcome: | The proposed model outperforms baselines on hate speech classification task and is a potential approach to misspelling correction. |
Policy Shaping and Generalized Update Equations for Semantic Parsing from Denotations (D18-1)
Copied to clipboard
| Challenge: | Existing learning approaches for parsing from denotations (SpFD) do not provide access to correct representations, so there are two steps for every training example. |
| Approach: | They propose a framework for parsing from denotations that generalizes three different learning algorithms. |
| Outcome: | The proposed framework outperforms previous work by 5.0% absolute on exact match accuracy on a question answering dataset. |
I love pineapple on pizza != I hate pineapple on pizza: Stance-Aware Sentence Transformers for Opinion Mining (2024.emnlp-main)
Copied to clipboard
| Challenge: | Sentence transformers excel at grouping topically similar texts, but struggle to differentiate opposing viewpoints on the same topic. |
| Approach: | They propose to fine-tune sentence transformers with arguments for and against controversial claims to enhance their utility for social computing tasks. |
| Outcome: | The proposed model improves opinion mining and stance detection tasks by combining human-generated controversial claims with stance-aware sentences. |
Revealing Hidden Mechanisms of Cross-Country Content Moderation with Natural Language Processing (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing knowledge on how and why NLP methods make content moderation decisions is limited . authors examine how and when to use LLMs in content modeation . |
| Approach: | They use Shapley values and LLM-guided explanations to reverse-engineer content moderation decisions across countries. |
| Outcome: | The proposed methods show that they reverse-engineer content moderation decisions across countries and over time. |
Multilingual Content Moderation: A Case Study on Reddit (2023.eacl-main)
Copied to clipboard
| Challenge: | a growing need for AI moderators to safeguard users and protect mental health of human moderator from traumatic content. |
| Approach: | They propose to use a multilingual dataset to study the challenges of content moderation . they propose to analyze 1.8 million Reddit comments in English, german, spanish and french . |
| Outcome: | The proposed dataset highlights the challenges and suggests related research problems . it shows that the proposed model can be used to predict the violated rule . |
Personalization up to a Point: Why Personalized Content Moderation Needs Boundaries, and How We Can Enforce Them (2025.emnlp-main)
Copied to clipboard
| Challenge: | Personalized content moderation can protect users from harm while facilitating free expression . however, it can also allow highly harmful and even illegal hate speech to spread . |
| Approach: | They propose to enforce legal boundaries on personalized content moderation models to reduce legal violations while maintaining user welfare. |
| Outcome: | The proposed approach reduces legal violations while maintaining user welfare while maintaining a high degree of model performance. |