A Computational Analysis of Vagueness in Revisions of Instructional Texts (2021.eacl-srw)
Copied to clipboard
| Challenge: | We analyze edits that involve cases of vagueness in instructional texts . we extract and analyze version pairs of an instruction before and after a revision . |
| Approach: | They propose to extract and analyze edits that involve cases of vagueness in instructions . they adopt a pairwise ranking task to show improvements over existing baselines . |
| Outcome: | The proposed model can distinguish between two versions of an instruction in a noisy dataset. |
Similar Papers
wikiHowToImprove: A Resource and Analyses on Edits in Instructional Texts (2020.lrec-1)
Copied to clipboard
| Challenge: | wikiHow articles are subject to revision edits, but do they provide clarifications? a new study compares changes made across multiple versions of the same set of instructions . |
| Approach: | They use wikiHow to analyze revision histories for 2.7 million sentences from wikihow . they use human annotation to categorize subset of edits and provide models . |
| Outcome: | The proposed model can distinguish between “older” and “newer” revisions of a sentence. |
Towards Modeling Revision Requirements in wikiHow Instructions (2020.emnlp-main)
Copied to clipboard
| Challenge: | wikiHow is a collaboratively edited platform of how-to guides . authors extend existing textual edits with 4 million sentences that remain unedited . |
| Approach: | They extend existing textual edits with a set of 4 million sentences that remain unedited over time. |
| Outcome: | The proposed model can predict the need for edits in wikiHow guides . the authors extend an existing resource of textual edits with a complementary set of 4 million sentences that remain unedited over time . |
What Can We Learn from Noun Substitutions in Revision Histories? (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work shows that resulting improvements can be modelled computationally, assuming that each revision contributes to the improvement. |
| Approach: | They propose to model improvements in sentences using wikiHow revision histories by assuming that each revision contributes to the improvement. |
| Outcome: | The proposed model fails in cases where humans can resort to factual knowledge or intuitions about the required level of specificity. |
It’s All Relative: Learning Interpretable Models for Scoring Subjective Bias in Documents from Pairwise Comparisons (2024.eacl-long)
Copied to clipboard
| Challenge: | a new model to score subjective bias in documents is developed to perform pairwise comparisons . a recent study shows that the model can be explained and validated for other domains based on the training data. |
| Approach: | They propose an interpretable model to score subjective bias in Wikipedia articles . they train the model on pairs of revisions of the same Wikipedia article . |
| Outcome: | The proposed model can interpret parameters to discover words most indicative of bias . it compares legal texts, news media and law amendments in three settings . |
LLM-driven Instruction Following: Progresses and Concerns (2023.emnlp-tutorial)
Copied to clipboard
| Challenge: | a tutorial on task instruction is aimed at researchers and practitioners interested in NLP generalization . labeled examples are unlikely to be available in large numbers or do not exist . |
| Approach: | This tutorial will examine the progress of natural language processing (NLP) using labeled examples. authors propose that task instructions act as a novel resource for supervision. |
| Outcome: | This tutorial aims to answer questions about instruction-driven NLP . it focuses on the use of task instructions in a low-shot scenario . |
Making Revisions Understandable: A Survey of Edit Intentions, Methods, and Applications (2026.findings-acl)
Copied to clipboard
| Challenge: | Text revision is a core process in document creation, capturing how authors iteratively refine, reorganize, and improve written content. |
| Approach: | They synthesize text revision research through the lens of edit intentions . they review prior work across the revision workflow including corpus construction, edit intention taxonomies, edit intentions, and edit intention identification. |
| Outcome: | The proposed approach synthesizes datasets, taxonomies, identification methods, and applications and highlights key open research directions. |
Identifying and Mitigating Spurious Correlations for Improving Robustness in NLP Models (2022.findings-naacl)
Copied to clipboard
| Challenge: | Existing work identifies task-specific shortcuts via human priors or error analyses, which requires extensive expertise and efforts. |
| Approach: | They propose to automatically identify spurious correlations in NLP models at scale by using existing interpretability methods to extract tokens that significantly affect model’s decision process. |
| Outcome: | The proposed method can identify spurious correlations in NLP models at scale and mitigate these leads to more robust models in multiple applications. |
Learning to Follow Object-Centric Image Editing Instructions Faithfully (2023.findings-emnlp)
Copied to clipboard
| Challenge: | avrahami et al., 2022b,a): natural language instructions are often underspecified, requiring models to uncover their implicit meaning. |
| Approach: | They propose to use paired data to model the implicit meaning of instructions . they also propose to ground the model to localize where the edit has to be performed . |
| Outcome: | The proposed model performs better than state-of-the-art baselines on paired data, showing improvements in quality and faithfulness. |
Self-Supervised Learning for Pairwise Data Refinement (2020.aacl-main)
Copied to clipboard
| Challenge: | Pairwise data constructed from weakly supervised signals is widely used for training deep learning models. |
| Approach: | They propose two methods to refine pairwise data that are aimed to obtain subsets that are more useful as learning examples. |
| Outcome: | The proposed methods achieve most machine translation gains in the first iteration, but following iterations further improve its intrinsic evaluation. |
CombiNMT: An Exploration into Neural Text Simplification Models (2020.lrec-1)
Copied to clipboard
| Challenge: | Neural Text Simplification (NMT) is a widely used technique in Machine Translation (NLP) |
| Approach: | They present a replication study of Exploring Neural Text Simplification Models using OpenNMT and Newsela datasets. |
| Outcome: | The proposed systems improve on the original paper by using an updated implementation of OpenNMT and the newsela corpus alongside the original Wikipedia dataset. |