Challenge: Word Sense Disambiguation (WSD) aims to find the exact sense of an ambiguous word in a particular context.
Approach: They propose to integrate gloss knowledge into supervised neural networks for Word Sense Disambiguation (WSD) this paper proposes to fine-tune a pre-trained BERT model and achieve new state-of-the-art results on WSD task.
Outcome: The proposed model achieves state-of-the-art on the word Sense Disambiguation (WSD) task.

Similar Papers

Incorporating Glosses into Neural Word Sense Disambiguation (P18-1)

Copied to clipboard

Challenge: Existing neural networks for Word Sense Disambiguation rely on labeled data and lexical knowledge.
Approach: They propose a gloss-augmented WSD neural network which integrates context and glosses of the target word into a unified framework.
Outcome: The proposed model outperforms the state-of-the-art systems on several English all-words WSD datasets.
Leveraging Gloss Knowledge in Neural Word Sense Disambiguation by Hierarchical Co-Attention (D18-1)

Copied to clipboard

Challenge: Existing models for Word Sense Disambiguation use labeled data, but lack gloss knowledge.
Approach: They propose a co-attention mechanism to generate co-dependent representations for context and gloss . they propose to incorporate gloss knowledge into neural networks for Word Sense Disambiguation .
Outcome: The proposed model achieves state-of-the-art results on standard English all-words WSD datasets.
Adapting BERT for Word Sense Disambiguation with Gloss Selection Objective and Example Sentences (2020.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have used pre-trained language models for domain adaptation or transfer learning to improve natural language processing performance.
Approach: They propose to fine-tune word sense disambiguation on sequence-pair ranking task and to use existing WordNet examples to augment the model.
Outcome: The proposed model achieves state-of-the-art on the English all-words benchmark datasets.
Improved Word Sense Disambiguation with Enhanced Sense Representations (2021.findings-emnlp)

Copied to clipboard

Challenge: Existing supervised word sense disambiguation systems do not provide enough information about word senses.
Approach: They propose to incorporate synonyms, example phrases or sentences showing usage of word senses and sense gloss of hypernyms into the sense representations.
Outcome: The proposed system achieves an F1 score of 82.0% on the standard benchmark test dataset of the English all-words WSD task.
Connect-the-Dots: Bridging Semantics between Words and Definitions via Aligning Word Sense Inventories (2021.emnlp-main)

Copied to clipboard

Challenge: Existing supervised models struggle to make correct predictions on rare word senses due to limited training data.
Approach: They propose a gloss alignment algorithm that can align definition sentences with the same meaning from different sense inventories to collect rich lexical knowledge.
Outcome: The proposed method outperforms previous methods on both frequent and rare word senses.
Moving Down the Long Tail of Word Sense Disambiguation with Gloss Informed Bi-encoders (2020.acl-main)

Copied to clipboard

Challenge: Existing models for Word Sense Disambiguation are not uniformly distributed on rare or unseen senses.
Approach: They propose a bi-encoder model that embeds the target word with its context and the dictionary definition, or gloss, of each sense.
Outcome: The proposed model outperforms previous state-of-the-art models on English all-words WSD, with a 31.1% error reduction on less frequent senses over prior work.
Improving HowNet-Based Chinese Word Sense Disambiguation with Translations (2022.findings-emnlp)

Copied to clipboard

Challenge: Prior work on unsupervised WSD has leveraged lexical knowledge bases, such as WordNet and BabelNet, but these have proven to be less effective for Chinese.
Approach: They propose a system which combines contextual information from a pretrained neural language model with bilingual information obtained via machine translation and sense translation information from HowNet.
Outcome: The proposed system achieves a state-of-the-art for unsupervised Chinese WSD.
How Much Do Encoder Models Know About Word Senses? (2025.acl-long)

Copied to clipboard

Challenge: Word Sense Disambiguation (WSD) is a key task in Natural Language Processing (NLP) however, how well these models inherently disambiguate word senses remains uncertain.
Approach: They evaluate several encoder-only PLMs across WordNet and ODE sense inventories to evaluate their ability to separate word senses without any task-specific fine-tuning.
Outcome: The proposed model outperforms output layer on WordNet and ODE sense inventories by 15 percentage points.
Semantic Specialization for Knowledge-based Word Sense Disambiguation (2023.eacl-main)

Copied to clipboard

Challenge: Existing methods for knowledge-based Word Sense Disambiguation (WSD) use only lexical knowledge to adapt contextualized embeddings.
Approach: They propose a semantic specialization where contextualized embeddings are adapted to the WSD task using only lexical knowledge.
Outcome: The proposed method outperforms previous studies that adapt contextualized embeddings while controlling deviations from the original embeddables.
Enhancing Modern Supervised Word Sense Disambiguation Models by Semantic Lexical Resources (L18-1)

Copied to clipboard

Challenge: Existing supervised models for Word Sense Disambiguation (WSD) are limited to knowledge-based approaches.
Approach: They propose to use WordNet and WordNet Domains to enhance supervised WSD models by introducing semantic features into the classifiers and using the SLR structure to augment training data.
Outcome: The proposed model improves the state-of-the-art in Word Sense Disambiguation (WSD) The proposed approach is compared with the state of the art in the most popular benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations