| Challenge: | Existing benchmarks for lexical substitution (LS) are limited and limited in coverage . despite extensive research on Lexical Substitution in various languages, there is limited evidence for LS in Chinese. |
| Approach: | They propose to use human and machine collaboration to construct a Chinese LS dataset . they combine four unsupervised LS methods to generate candidate substitutes . |
| Outcome: | The proposed method outperforms existing benchmarks on the Chinese lexical substitution task. |
Similar Papers
ParaLS: Lexical Substitution via Pretrained Paraphraser (2023.acl-long)
Copied to clipboard
| Challenge: | Lexical substitution (LS) is an extremely powerful technology that can be used as a backbone of various NLP applications such as writing assistance. |
| Approach: | They propose two simple decoding strategies that focus on the variations of the target word during decoding to generate substitutes from a paraphraser. |
| Outcome: | The proposed methods outperform state-of-the-art LS methods based on pre-trained language models on three benchmarks. |
Swords: A Benchmark for Lexical Substitution with Improved Data Coverage and Quality (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing benchmarks for lexical substitution depend on human recall as the only source of data, authors say . existing benchmarks lack coverage of the appropriate substitutes that would be most helpful to humans . |
| Approach: | They propose a benchmark for lexical substitution to find appropriate substitutes for a target word in context . existing benchmarks depend on human recall as the only source of data, they argue . |
| Outcome: | The new benchmark for lexical substitution uses a context-free thesaurus . it has 3x as many substitutes per target word for the same quality, and substitutes are 1.4x more appropriate . |
Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution (2020.coling-main)
Copied to clipboard
| Challenge: | Lexical substitution is a powerful technology used in various NLP applications . it generates plausible words that can replace a given word in a textual context . |
| Approach: | They propose to use a large-scale comparative study to compare lexical substitution methods . they compare existing and new methods using word sense induction datasets . |
| Outcome: | The proposed methods improve competitive results by incorporating information about the target word into the models. |
Extending the gold standard for a lexical substitution task: is it worth it? (L18-1)
Copied to clipboard
| Challenge: | a lexical substitution task requires systems to identify words that are semantically close to the target and to select among candidates those that best fit the context. |
| Approach: | They propose to use a lexical substitution task to evaluate systems' performance . they use 300 sentences containing a target word and a second dataset based on the same data . |
| Outcome: | The proposed model is based on a set of 300 sentences containing a target word . the proposed model has not been evaluated to our knowledge . |
LexSubCon: Integrating Knowledge from Lexical Resources into Contextual Embeddings for Lexical Substitution (2022.acl-long)
Copied to clipboard
| Challenge: | Lexical substitution is the task of generating meaningful substitutes for a word in a given textual context. |
| Approach: | They propose an end-to-end lexical substitution framework based on contextual embedding models that can identify highly-accurate substitute candidates. |
| Outcome: | The proposed framework outperforms state-of-the-art embedding models on LS07 and CoInCo benchmark datasets by at least 2% over existing embeddable models. |
Unsupervised Lexical Substitution with Decontextualised Embeddings (2022.coling-1)
Copied to clipboard
| Challenge: | Existing methods for lexical substitution using pre-trained language models have some limitations. |
| Approach: | They propose an unsupervised method for lexical substitution using pre-trained language models. |
| Outcome: | The proposed method outperforms baseline models and establishes a state-of-the-art without supervision or fine-tuning. |
BERT-based Lexical Substitution (P19-1)
Copied to clipboard
| Challenge: | Existing approaches to lexical substitution tend to overlook good substitute candidates that are not the synonyms of the target words in the lexicals and fail to take into account the substitution’s influence on the global context of the sentence. |
| Approach: | They propose an end-to-end BERT-based lexical substitution approach which proposes and validates substitute candidates without using annotated data or manually curated resources. |
| Outcome: | The proposed approach performs well in proposing and ranking substitute candidates, achieving the state-of-the-art results in both LS07 and LS14 benchmarks. |
Contextualized context2vec (D19-55)
Copied to clipboard
| Challenge: | Lexical substitution ranks substitution candidates from the viewpoint of paraphrasability for a target word in a given sentence. |
| Approach: | They propose a method that combines two approaches to contextualize word embeddings for lexical substitution. |
| Outcome: | The proposed method outperforms the current state-of-the-art method and assigns English proficiency levels to all target words and substitution candidates. |
GeneSis: A Generative Approach to Substitutes in Context (2021.emnlp-main)
Copied to clipboard
| Challenge: | lexical substitution tasks require a system to provide adequate replacements for a word in a given context. |
| Approach: | They propose a generative approach to lexical substitution using a seq2seq model to generate suitable replacements for a word in context. |
| Outcome: | The proposed approach achieves state-of-the-art on different benchmarks and human evaluation of the generated substitutes. |
ALEXSIS-PT: A New Resource for Portuguese Lexical Simplification (2022.coling-1)
Copied to clipboard
| Challenge: | Lexical simplification (LS) is the task of replacing complex words with simpler alternatives to make texts more accessible to various target populations. |
| Approach: | They propose to use a Brazilian Portuguese multi-candidate dataset to test LS systems. |
| Outcome: | The proposed model outperforms existing models on Brazilian Portuguese and Brazilian newspaper articles. |