| Challenge: | Conflict-of-Interest (CoI) editing is a problem on Wikipedia that is highly subjective . a key feature of Wiki sites is to allow people from all over the world to add or modify articles anonymously and without consequence. |
| Approach: | They frame CoI detection as a binary classification problem and explore features for it . they find that stylometric features outperform other types of features and give an F-measure of 0.63 . |
| Outcome: | The proposed method outperforms other features and gives an F-measure of 0.63 . the proposed method is not certain that the set of non-CoI articles contains any CoI articles . |
Similar Papers
It’s All Relative: Learning Interpretable Models for Scoring Subjective Bias in Documents from Pairwise Comparisons (2024.eacl-long)
Copied to clipboard
| Challenge: | a new model to score subjective bias in documents is developed to perform pairwise comparisons . a recent study shows that the model can be explained and validated for other domains based on the training data. |
| Approach: | They propose an interpretable model to score subjective bias in Wikipedia articles . they train the model on pairs of revisions of the same Wikipedia article . |
| Outcome: | The proposed model can interpret parameters to discover words most indicative of bias . it compares legal texts, news media and law amendments in three settings . |
WIKIBIAS: Detecting Multi-Span Subjective Biases in Language (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a particular type of bias is subjective bias, which introduces improper attitudes or presents a statement with the presupposition of truth. |
| Approach: | They propose to annotate a Wikipedia edits corpus with 4,000 sentence pairs to detect subjective bias. |
| Outcome: | The proposed dataset can be used as a research benchmark and generalize to multiple domains. |
Benchmarks and models for entity-oriented polarity detection (N18-3)
Copied to clipboard
| Challenge: | a dataset of 17,000 manually labeled documents is large for determining entity-oriented polarity in business news. |
| Approach: | They propose a convolutional neural network-based approach to classify entity-oriented polarity in business news. |
| Outcome: | The proposed model is based on convolutional neural networks and is small on the scale of existing models. |
Is a Document Educational or Just Wikipedia-Style? — Pitfalls of Classifier-Based Quality Filtering (2026.acl-short)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are pre-trained on massive data corpora, and the quality of these corporales is one of the main factors in achieving stateof-the-art performance. |
| Approach: | They propose to use Wikipedia-style reformatting to alter a model's quality assessment and enable low-quality content to surpass filtering thresholds. |
| Outcome: | The proposed model would reverse filtering decision for approximately 7% of evaluated documents, thereby admitting content into the pre-training corpus that would otherwise have been excluded. |
Measuring What Counts: The Case of Rumour Stance Classification (2020.aacl-main)
Copied to clipboard
| Challenge: | Numerous methods have been proposed to predict the stance of replies towards a given rumour, but their performance is not optimal for the four-class imbalanced task of rumor stance classification. |
| Approach: | They propose to use a four-class problem to predict the stance of replies towards a given rumour to help identify the most informative minority classes. |
| Outcome: | The proposed methods are robust to imbalanced data and score higher systems capable of recognising the two most informative minority classes (support and deny). |
WikiTalkEdit: A Dataset for modeling Editors’ behaviors on Wikipedia (2021.naacl-main)
Copied to clipboard
| Challenge: | Using the WikiTalkEdit dataset, we show how positive emotion and the use of first-person pronouns predict a positive emotional change in a Wikipedia contributor. |
| Approach: | They introduce and analyze WikiTalkEdit, a dataset of conversations and edit histories from Wikipedia, for research in online cooperation and conversation modeling. |
| Outcome: | The proposed dataset supports the classic understanding of style matching, where positive emotion and the use of first-person pronouns predict a positive emotional change in a Wikipedia contributor. |
Developing a Dataset of Overridden Information in Wikipedia (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing methods to detect information overridden by the Web are not accurate and require a user's perspective to make the decision. |
| Approach: | They propose a task to detect whether a reference sentence has overridden a target sentence by using sentence pairs from the difference between two versions of Wikipedia. |
| Outcome: | The proposed task is formalized as a binary classification problem to determine whether a reference sentence has overridden a target sentence. |
Why Should This Article Be Deleted? Transparent Stance Detection in Multilingual Wikipedia Editor Discussions (2023.emnlp-main)
Copied to clipboard
| Challenge: | Currently, only 20% of the English comments explicitly mention content moderation policies, but as few as 2% of the German and Turkish comments. |
| Approach: | They propose to use a multilingual dataset to predict stances with existing content moderation policies and to use them to explain moderation decisions. |
| Outcome: | The proposed model predicts stances and corresponding reasons with high accuracy, adding transparency to the decision-making process. |
Towards an argumentative content search engine using weak supervision (C18-1)
Copied to clipboard
| Challenge: | Existing work focused on detecting claims within a small set of documents . however, pinpointing relevant claims within massive unstructured corpora, received little attention. |
| Approach: | They propose to use a weak signal to develop a query for claim–sentence detection using a large text corpus. |
| Outcome: | The proposed system outperforms previous results in terms of precision and coverage. |
Is External Information Useful for Stance Detection with LLMs? (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing studies suggest that external information, such as Wikipedia excerpts, can improve stance detection performance, but whether such information can benefit large language models remains an unanswered question. |
| Approach: | They conduct a systematic evaluation on how Wikipedia and web search external information can affect stance detection across eight LLMs and in three datasets with 12 targets. |
| Outcome: | The proposed model degrades performance in most cases, with macro F1 scores dropping by up to 27.9%, while fine-tuning mitigates but does not eliminate it. |