| Challenge: | Existing methods to assess article quality in Wikipedia are based on a document-level approach, but considering the whole document could have negative repercussions. |
| Approach: | They propose an edit-centric approach to assess Wikipedia article quality using an edit classifier and a generative module that provides an estimation and translates it into natural language. |
| Outcome: | The proposed model is cost-effective and can be implemented in Wikipedia. |
Similar Papers
NwQM: A neural quality assessment framework for Wikipedia (2020.emnlp-main)
Copied to clipboard
| Challenge: | Wikipedia articles are classified into several quality classes, which indicate their reliability as encyclopedic content. |
| Approach: | They propose a deep learning model which accumulates signals from key information sources to obtain improved Wikipedia article representation. |
| Outcome: | The proposed model improves Wikipedia article representation by 8% over state-of-the-art approaches with detailed ablation studies. |
Is a Document Educational or Just Wikipedia-Style? — Pitfalls of Classifier-Based Quality Filtering (2026.acl-short)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are pre-trained on massive data corpora, and the quality of these corporales is one of the main factors in achieving stateof-the-art performance. |
| Approach: | They propose to use Wikipedia-style reformatting to alter a model's quality assessment and enable low-quality content to surpass filtering thresholds. |
| Outcome: | The proposed model would reverse filtering decision for approximately 7% of evaluated documents, thereby admitting content into the pre-training corpus that would otherwise have been excluded. |
How Good is Your Wikipedia? Auditing Data Quality for Low-resource and Multilingual NLP (2026.acl-long)
Copied to clipboard
Kushal Tatariya, Artur Kulmizev, Wessel Poelman, Esther Ploeger, Marcel Bollmann, Johannes Bjerva, Jiaming Luo, Heather Lent, Miryam de Lhoneux
| Challenge: | Wikipedia’s perceived high quality and broad language coverage have established it as a fundamental resource in NLP. |
| Approach: | They propose a data filtering procedure which removes a large percentage of Wikipedia's data and a 4-level quality ranking of the site. |
| Outcome: | The results show that the proposed filtering procedure outperforms the raw Wikipedia models in three language modelling scenarios. |
Modelling Uncertainty in Collaborative Document Quality Assessment (D19-55)
Copied to clipboard
| Challenge: | Existing work on document quality assessment relies on predicting the quality of a document relative to a putative gold standard, without paying attention to the subjectivity of this task. |
| Approach: | They propose to use Gaussian processes and random forests to measure the uncertainty in document quality predictions. |
| Outcome: | The proposed methods can predict the quality of Wikipedia articles while providing an estimate of uncertainty when there is inconsistency in the quality labels from the contributors. |
StRE: Self Attentive Edit Quality Prediction in Wikipedia (P19-1)
Copied to clipboard
| Challenge: | Existing methods for content moderation and review rely on page reputation, editor activity or rule based heuristics. |
| Approach: | They propose a self-attentive revision encoder which leverages orthographic similarity of lexical units toward predicting the quality of new edits. |
| Outcome: | The proposed model outperforms existing models by at least 17% and at most 103% on a set of 21M revisions across 32K Wikipedia pages. |
Aligning Wikipedia with WordNet:a Review and Evaluation of Different Techniques (2020.lrec-1)
Copied to clipboard
| Challenge: | a reliable alignment between WordNet and Wikipedia is a valuable resource for the creation of new wordnets in other languages and for the development of existing wordnet. |
| Approach: | They evaluate methods for aligning Wikipedia articles with WordNet synsets . they use a new gold and silver standard and a method that creates wordnets in other languages . |
| Outcome: | The proposed methods can be used to evaluate the quality of alignments between Wikipedia and WordNet synsets. |
An Open Multilingual System for Scoring Readability of Wikipedia (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies on the readability of Wikipedia have focused on English only and there are currently no systems supporting automatic readability assessment of the 300+ languages in Wikipedia. |
| Approach: | They propose a multilingual model to assess Wikipedia's readability using a dataset spanning 14 languages. |
| Outcome: | The proposed model outperforms existing models in a zero-shot scenario and is more accurate than previous benchmarks. |
Evaluation Dataset and Methodology for Extracting Application-Specific Taxonomies from the Wikipedia Knowledge Graph (2020.lrec-1)
Copied to clipboard
| Challenge: | Recent efforts to extract hierarchical relations from unstructured text have been challenging. |
| Approach: | They propose an iterative method to extract an application-specific gold standard dataset from a Wikipedia knowledge graph and an evaluation framework to assess the quality of noisy automatically extracted taxonomies. |
| Outcome: | The proposed method reduces manual work and provides a first gold standard dataset and evaluation framework. |
Automated Peer Reviewing in Paper SEA: Standardization, Evaluation, and Analysis (2024.findings-emnlp)
Copied to clipboard
Jianxiang Yu, Zichen Ding, Jiaqi Tan, Kangyang Luo, Zhenmin Weng, Chenghua Gong, Long Zeng, RenJing Cui, Chengcheng Han, Qiushi Sun, Zhiyong Wu, Yunshi Lan, Xiang Li
| Challenge: | Existing approaches to review scientific papers are limited by their content or quality . SEA is a framework for automated scientific review, but its contents are generic or partial. |
| Approach: | They propose a framework for automated scientific review using large language models . they propose to use a standardized review dataset to fine-tune an LLM to generate high-quality reviews. |
| Outcome: | The proposed framework can generate high-quality reviews from standardized datasets and improves on the existing feedback mechanisms. |
It’s All Relative: Learning Interpretable Models for Scoring Subjective Bias in Documents from Pairwise Comparisons (2024.eacl-long)
Copied to clipboard
| Challenge: | a new model to score subjective bias in documents is developed to perform pairwise comparisons . a recent study shows that the model can be explained and validated for other domains based on the training data. |
| Approach: | They propose an interpretable model to score subjective bias in Wikipedia articles . they train the model on pairs of revisions of the same Wikipedia article . |
| Outcome: | The proposed model can interpret parameters to discover words most indicative of bias . it compares legal texts, news media and law amendments in three settings . |