What Can We Learn from Noun Substitutions in Revision Histories? (2020.coling-main)
Copied to clipboard
| Challenge: | Recent work shows that resulting improvements can be modelled computationally, assuming that each revision contributes to the improvement. |
| Approach: | They propose to model improvements in sentences using wikiHow revision histories by assuming that each revision contributes to the improvement. |
| Outcome: | The proposed model fails in cases where humans can resort to factual knowledge or intuitions about the required level of specificity. |
Similar Papers
wikiHowToImprove: A Resource and Analyses on Edits in Instructional Texts (2020.lrec-1)
Copied to clipboard
| Challenge: | wikiHow articles are subject to revision edits, but do they provide clarifications? a new study compares changes made across multiple versions of the same set of instructions . |
| Approach: | They use wikiHow to analyze revision histories for 2.7 million sentences from wikihow . they use human annotation to categorize subset of edits and provide models . |
| Outcome: | The proposed model can distinguish between “older” and “newer” revisions of a sentence. |
Computational modeling of semantic change (2024.eacl-tutorials)
Copied to clipboard
| Challenge: | Languages change constantly over time, influenced by social, technological, cultural and political factors that affect how people express themselves. |
| Approach: | They propose to categorise the types of change, the causes and the mechanisms underlying the different types of changes using large diachronic corpora and evaluation benchmarks. |
| Outcome: | In historical linguistics, tools and methods have been developed to analyse the process . they include categorisations of types of change, causes and mechanisms . but traditional methods, while informative, are often based on small, carefully curated samples. |
Extending the gold standard for a lexical substitution task: is it worth it? (L18-1)
Copied to clipboard
| Challenge: | a lexical substitution task requires systems to identify words that are semantically close to the target and to select among candidates those that best fit the context. |
| Approach: | They propose to use a lexical substitution task to evaluate systems' performance . they use 300 sentences containing a target word and a second dataset based on the same data . |
| Outcome: | The proposed model is based on a set of 300 sentences containing a target word . the proposed model has not been evaluated to our knowledge . |
Towards Modeling Revision Requirements in wikiHow Instructions (2020.emnlp-main)
Copied to clipboard
| Challenge: | wikiHow is a collaboratively edited platform of how-to guides . authors extend existing textual edits with 4 million sentences that remain unedited . |
| Approach: | They extend existing textual edits with a set of 4 million sentences that remain unedited over time. |
| Outcome: | The proposed model can predict the need for edits in wikiHow guides . the authors extend an existing resource of textual edits with a complementary set of 4 million sentences that remain unedited over time . |
Semantic Supersenses for English Possessives (L18-1)
Copied to clipboard
| Challenge: | Existing semantic categories for possessive constructions are limited to nominals and s-genitives. |
| Approach: | They propose to use a supersense inventory to annotate English possessives . they show existing supersensor categories are readily applicable to possessives. |
| Outcome: | The proposed annotations are applied to English possessives in a corpus of web reviews. |
Do Transformer Modifications Transfer Across Implementations and Applications? (2021.emnlp-main)
Copied to clipboard
Sharan Narang, Hyung Won Chung, Yi Tay, Liam Fedus, Thibault Fevry, Michael Matena, Karishma Malkan, Noah Fiedel, Noam Shazeer, Zhenzhong Lan, Yanqi Zhou, Wei Li, Nan Ding, Jake Marcus, Adam Roberts, Colin Raffel
| Challenge: | Currently, the Transformer is the de facto architecture of choice for processing sequential data. |
| Approach: | They evaluate the Transformer architecture and its modifications in a shared experimental setting . they conjecture that performance improvements may strongly depend on implementation details . |
| Outcome: | The proposed improvements do not significantly improve performance, the authors find . the proposed improvements are either developed in the same codebase or are minor changes . |
Learning to Substitute Words with Model-based Score Ranking (2025.naacl-long)
Copied to clipboard
| Challenge: | Experimental results show that the proposed approach outperforms both masked language models and large language models. |
| Approach: | They propose a model-based scoring approach to quantify sentence quality . they propose 'loss function' that optimizes alignment between model predictions and sentence scores . |
| Outcome: | The proposed approach outperforms masked language models and large language models in the quantitative analysis of word substitutions. |
GMEG-EXP: A Dataset of Human- and LLM-Generated Explanations of Grammatical and Fluency Edits (2024.lrec-main)
Copied to clipboard
| Challenge: | Recent work has explored the ability of large language models (LLMs) to generate explanations of existing labeled data. |
| Approach: | They propose a dataset to examine the ability of large language models to explain revisions in sentences by comparing human- and LLM-generated explanations of grammatical and fluency edits to a human evaluation criteria. |
| Outcome: | The proposed explanations address grammatical and fluency edits and are compared with a dataset built from the GMEG (Grammarly Multi-domain Evaluation for GEC) dataset. |
Are Synonym Substitution Attacks Really Synonym Substitution Attacks? (2023.findings-acl)
Copied to clipboard
| Challenge: | In synonym substitution attacks, an adversarial sample is constructed by substituting words in the original sentence with their synonyms. |
| Approach: | They examine how synonym substitution attacks replace words in the original sentence and show that there are still unresolved obstacles that make current SSAs generate invalid adversarial samples. |
| Outcome: | The proposed methods generate large fractions of invalid substitution words that are ungrammatical or do not preserve the original sentence’s semantics. |
NewsEdits: A News Article Revision Dataset and a Novel Document-Level Reasoning Challenge (2022.naacl-main)
Copied to clipboard
| Challenge: | a large dataset of news article revision histories provides clues to narrative and factual evolution in news articles. |
| Approach: | They propose tasks to predict edit-actions performed during version updates . they define article-level edit actions: Addition, Deletion, Edit and Refactor . |
| Outcome: | The proposed dataset is large-scale and multilingual and spans 15 years . it shows that edit-actions are predictable and are likely to be based on factual evolution . |