CILex: An Investigation of Context Information for Lexical Substitution Methods (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for lexical substitution rely on manually curated lexicals and contextual word embedding models. |
| Approach: | They propose a method that uses contextual sentence embeddings to generate substitutes for a target word given a context and a model that captures additional context information complimenting contextual word embedders. |
| Outcome: | The proposed method is state-of-the-art on the widely used LS07 and CoInCo datasets with P@1 scores of 55.96% and 57.25% for lexical substitution. |
Similar Papers
LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitution (2022.acl-long)
Copied to clipboard
| Challenge: | Lexical substitution is the task of generating meaningful substitutes for a word in a given textual context. |
| Approach: | They propose an end-to-end lexical substitution framework based on contextual embedding models that can identify highly-accurate substitute candidates. |
| Outcome: | The proposed framework outperforms state-of-the-art embedding models on LS07 and CoInCo benchmark datasets by at least 2% over existing embeddable models. |
ProLex: A Benchmark for Language Proficiency-oriented Lexical Substitution (2024.findings-acl)
Copied to clipboard
| Challenge: | Lexical Substitution fails to consider substitutes of equal or higher proficiency than the target word. |
| Approach: | They propose a task to find appropriate substitutes for a given word in a context sentence but not those that are of equal or higher proficiency than the target. |
| Outcome: | The proposed model outperforms ChatGPT by an average of 3.2% in F-score and achieves comparable results with GPT-4 on ProLex. |
Contextualized context2vec (D19-55)
Copied to clipboard
| Challenge: | Lexical substitution ranks substitution candidates from the viewpoint of paraphrasability for a target word in a given sentence. |
| Approach: | They propose a method that combines two approaches to contextualize word embeddings for lexical substitution. |
| Outcome: | The proposed method outperforms the current state-of-the-art method and assigns English proficiency levels to all target words and substitution candidates. |
Combination of Contextualized and Non-Contextualized Layers for Lexical Substitution in French (2022.lrec-1)
Copied to clipboard
| Challenge: | Lexical substitution task requires to substitute a target word by candidates in a given context. |
| Approach: | They propose a method to find synonyms for a target word and rank them based on the context of the sentence. |
| Outcome: | The proposed method increases the BERT based system on the OOT measure but decreases on the BEST measure in the SemDis 2014 benchmark. |
Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution (2020.coling-main)
Copied to clipboard
| Challenge: | Lexical substitution is a powerful technology used in various NLP applications . it generates plausible words that can replace a given word in a textual context . |
| Approach: | They propose to use a large-scale comparative study to compare lexical substitution methods . they compare existing and new methods using word sense induction datasets . |
| Outcome: | The proposed methods improve competitive results by incorporating information about the target word into the models. |
BERT-based Lexical Substitution (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to lexical substitution tend to overlook good substitute candidates that are not the synonyms of the target words in the lexicals and fail to take into account the substitution’s influence on the global context of the sentence. |
| Approach: | They propose an end-to-end BERT-based lexical substitution approach which proposes and validates substitute candidates without using annotated data or manually curated resources. |
| Outcome: | The proposed approach performs well in proposing and ranking substitute candidates, achieving the state-of-the-art results in both LS07 and LS14 benchmarks. |
ParaLS: Lexical Substitution via Pretrained Paraphraser (2023.acl-long)
Copied to clipboard
| Challenge: | Lexical substitution (LS) is an extremely powerful technology that can be used as a backbone of various NLP applications such as writing assistance. |
| Approach: | They propose two simple decoding strategies that focus on the variations of the target word during decoding to generate substitutes from a paraphraser. |
| Outcome: | The proposed methods outperform state-of-the-art LS methods based on pre-trained language models on three benchmarks. |
Unsupervised Lexical Substitution with Decontextualised Embeddings (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for lexical substitution using pre-trained language models have some limitations. |
| Approach: | They propose an unsupervised method for lexical substitution using pre-trained language models. |
| Outcome: | The proposed method outperforms baseline models and establishes a state-of-the-art without supervision or fine-tuning. |
Grounding the Lexical Substitution Task in Entailment (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing definitions of lexical substitutes are vague or inconsistent with the gold annotations. |
| Approach: | They propose a new definition which is grounded in the relation of entailment . they empirically validate the definition and create a dataset from existing semantic resources . |
| Outcome: | The proposed method improves the performance of existing lexical substitution systems on the existing benchmarks. |
GeneSis: A Generative Approach to Substitutes in Context (2021.emnlp-main)
Copied to clipboard
| Challenge: | lexical substitution tasks require a system to provide adequate replacements for a word in a given context. |
| Approach: | They propose a generative approach to lexical substitution using a seq2seq model to generate suitable replacements for a word in context. |
| Outcome: | The proposed approach achieves state-of-the-art on different benchmarks and human evaluation of the generated substitutes. |