| Challenge: | Word Sense Disambiguation (WSD) is a task that is based on a set of pre-trained language models. |
| Approach: | They propose to use Word Sense Disambiguation to test whether systems can handle ambiguous words. |
| Outcome: | The proposed benchmarks show that seven of the most representative state-of-the-art systems make trivial errors on traditional evaluation benchmarks. |
Similar Papers
A Deep Dive into Word Sense Disambiguation with LSTM (C18-1)
Copied to clipboard
| Challenge: | LSTM-based language models have been shown effective in Word Sense Disambiguation (WSD) but neither the training data nor the source code was released. |
| Approach: | They propose to use LSTM-based language models to perform Word Sense Disambiguation (WSD) using openly available datasets and software. |
| Outcome: | The proposed method returned state-of-the-art performance in several benchmarks, but neither the training data nor the source code were released. |
An Evaluation Benchmark for Testing the Word Sense Disambiguation Capabilities of Machine Translation Systems (2020.lrec-1)
Copied to clipboard
| Challenge: | Lexical ambiguity is one of the many challenging linguistic phenomena involved in translation, i.e., translating an ambiguous word with its correct sense. |
| Approach: | They propose to use training data to measure the sense distributions of a machine translation system to measure lexical ambiguity. |
| Outcome: | The proposed benchmark builds upon the multilingual sense inventory of BabelNet, the multilinguistic neural parsing pipeline TurkuNLP, and the OPUS collection of translated texts from the web. |
Improved Word Sense Disambiguation Using Pre-Trained Contextualized Word Representations (D19-1)
Copied to clipboard
| Challenge: | Contextualized word representations are effective in downstream tasks such as question answering, named entity recognition, and sentiment analysis. |
| Approach: | They propose to integrate pre-trained contextualized word representations into a neural network that captures the whole sentence and the word representation in the sentence. |
| Outcome: | The proposed approach outperforms the state-of-the-art approach that makes use of non-contextualized word embeddings on multiple benchmark WSD datasets. |
Breaking Through the 80% Glass Ceiling: Raising the State of the Art in Word Sense Disambiguation by Incorporating Knowledge Graph Information (2020.acl-main)
Copied to clipboard
| Challenge: | Neural architectures are the current state of the art in Word Sense Disambiguation (WSD) however, they make limited use of the vast amount of relational information encoded in Lexical Knowledge Bases (LKBs). |
| Approach: | They propose a neural supervised architecture that embeds Lexical Knowledge Bases and exploits pretrained synset embeddings to predict synsets that are not in the training set. |
| Outcome: | The proposed architecture breaks through the 80% ceiling on the concatenation of all standard all-words English evaluation benchmarks. |
AMuSE-WSD: An All-in-one Multilingual System for Easy Word Sense Disambiguation (2021.emnlp-demo)
Copied to clipboard
| Challenge: | Word Sense Disambiguation (WSD) is a task of associating a word in context with its most appropriate sense from a predefined sense inventory. |
| Approach: | They propose to use a state-of-the-art neural model to integrate WSD into real-world applications. |
| Outcome: | The proposed system offers high-quality sense information in 40 languages through a state-of-the-art neural model for WSD. |
LTRS: Improving Word Sense Disambiguation via Learning to Rank Senses (2025.coling-main)
Copied to clipboard
| Challenge: | Conventional training strategies only consider predefined senses for target words and learn each of them from relatively limited instances, neglecting the influence of similar ones. |
| Approach: | They propose a method to rank senses to improve the task of word Sense Disambiguation (WSD) by ranking an expanded list of sense definitions. |
| Outcome: | The proposed method achieves a SOTA F1 score of 79.6% in Chinese WSD and shows faster convergence than previous methods. |
RoDEval: A Robust Word Sense Disambiguation Evaluation Framework for Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies rely on single-task evaluations and classification-based metrics that overlook the fundamental differences between generative LLMs and traditional classification models. |
| Approach: | They propose to use four new metrics to evaluate LLM-based word sense disambiguation (WSD) . experimental results reveal significant limitations in LLMs' WSD performance . |
| Outcome: | The proposed evaluation framework is open-source at https://github.com/DayDream405/RoDEval. |
How Much Do Encoder Models Know About Word Senses? (2025.acl-long)
Copied to clipboard
| Challenge: | Word Sense Disambiguation (WSD) is a key task in Natural Language Processing (NLP) however, how well these models inherently disambiguate word senses remains uncertain. |
| Approach: | They evaluate several encoder-only PLMs across WordNet and ODE sense inventories to evaluate their ability to separate word senses without any task-specific fine-tuning. |
| Outcome: | The proposed model outperforms output layer on WordNet and ODE sense inventories by 15 percentage points. |
Word Sense Linking: Disambiguating Outside the Sandbox (2024.findings-acl)
Copied to clipboard
| Challenge: | Word Sense Disambiguation (WSD) systems have performed well on several evaluation benchmarks, but it still struggles to find downstream applications. |
| Approach: | They propose a task where systems have to identify which spans to disambiguate and link them to their most suitable meaning. |
| Outcome: | The proposed task performs above the estimated inter-annotator agreement on a set of words . the proposed system is based on 'transformer-based' architectures and iteratively relaxes the assumptions . |
Sense-Annotated Corpora for Word Sense Disambiguation in Multiple Languages and Domains (2020.lrec-1)
Copied to clipboard
| Challenge: | Word Sense Disambiguation (WSD) is a field of NLP where data is usually tied to a specific language. |
| Approach: | They propose to release five large datasets annotated with word-senses in five different languages and 5 datasets in English for a different semantic domain. |
| Outcome: | The study shows that supervised models trained on the data achieve higher performance than those trained on other corpora. |