An Unsupervised, Geometric and Syntax-aware Quantification of Polysemy (2022.emnlp-main)
Copied to clipboard
| Challenge: | Polysemy is the phenomenon where a single word form possesses two or more related senses. |
| Approach: | They propose an unsupervised framework to quantify polysemy for words in multiple languages . they use syntactic knowledge to infuse the framework with syntaktic knowledge . |
| Outcome: | The proposed framework is based on syntactic knowledge and is compared with existing methods in English, French and Spanish. |
Similar Papers
Unsupervised Word Polysemy Quantification with Multiresolution Grids of Contextual Embeddings (2021.eacl-main)
Copied to clipboard
| Challenge: | a new method to quantify polysemy is based on basic geometry in the contextual embedding space . word sense annotation has always been one of the tasks with the lowest interannotator agreement . |
| Approach: | They propose a method to estimate polysemy based on simple geometry in contextual embedding space. |
| Outcome: | The proposed method is fully unsupervised and data-driven . it can be used to sample sentences with different senses at no extra cost . |
Patterns of Polysemy and Homonymy in Contextualised Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has focused on homonymy, a variety of multiplicity of meanings exemplified by word forms with unrelated meanings. |
| Approach: | They investigate the extent to which contextualised embeddings reflect traditional distinctions of polysemy and homonymy. |
| Outcome: | The proposed model shows that it can distinguish between polysemy and homonymy . it shows that the model fails to replicate the results of the human-annotated dataset . |
Seeing through the mess: evolutionary dynamics of lexical polysemy (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models of lexical polysemy suggest multiple senses emerge for words . lexically, multiple sense of a word is the rule rather than the exception, authors say . |
| Approach: | They propose a mathematical model of the evolution of lexical meaning to investigate polysemy . they find conditions under which a sense of a word diversifies itself into multiple senses . |
| Outcome: | The proposed model predicts that diversification is promoted by low frequency and high discriminability . it also shows that the model is robust to a wide range of language variables . |
PolyLM: Learning about Polysemy through Language Modeling (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing methods to embed word senses have been overtaken by contextualized embeddings . alan ansell and jim koenig present a method which can be applied to downstream tasks . |
| Approach: | They propose a method which formulates learning sense embeddings as a language modeling problem. |
| Outcome: | The proposed method performs better than existing sense embedding methods on WSI tasks . it matches the current state-of-the-art specialized WSi method despite having six times fewer parameters . |
MSD-1030: A Well-built Multi-Sense Evaluation Dataset for Sense Representation Models (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing benchmarks for sense embeddings do not account for polysemy, and there are six issues with evaluations based on these datasets. |
| Approach: | They propose a multi-sense dataset with a high ratio of multi-word pairs to address the polysemy issue in word embeddings. |
| Outcome: | The proposed model performs better than existing models with single-sense word pairs and has a high ratio of multi-sensor word pairs. |
Let’s Play Mono-Poly: BERT Can Reveal Words’ Polysemy Level and Partitionability into Senses (2021.tacl-1)
Copied to clipboard
| Challenge: | Pre-trained language models encode rich information about linguistic structure but their knowledge about lexical polysemy remains unclear. |
| Approach: | They propose a setup for analyzing lexical polysemy knowledge in pre-trained language models and multilingual BERT models by analyzing different sense distributions and controlling for parameters that are highly correlated with polysyntax. |
| Outcome: | The proposed model can be used to analyze lexical polysemy in English, French, Spanish, and Greek and in multilingual BERT. |
SenseRel: A Sense-Level Benchmark for Denotational and Connotational Meaning Relations (2026.acl-long)
Copied to clipboard
Pierluigi Cassotti, Naomi Baes, Stefano De Pascale, Jáder Martins Camboim de Sá, Francesco Periti, Nick Haslam, Dirk Geeraerts, Nina Tahmasebi
| Challenge: | Polysemy enables a single word to convey multiple related meanings . a word's sense is extended to new contexts and concepts, a process called semantic change is gradual . |
| Approach: | They propose a benchmark for modeling semantic relations between word senses . they use a model that distinguishes denotational and connotationally related aspects of meaning . |
| Outcome: | The proposed model is able to distinguish between denotational and connotationalist aspects of meaning . it is compared with models with GPT-4o, Llama 3.1, and DeepSeek . |
A Resource-Free Evaluation Metric for Cross-Lingual Word Embeddings Based on Graph Modularity (P19-1)
Copied to clipboard
| Challenge: | Cross-lingual word embeddings encode the meaning of words from different languages into a shared low-dimensional space. |
| Approach: | They show that modularity can be used to improve unsupervised word embeddings . they show that it is useful for low-resource languages where one often has few bilingual pairs . |
| Outcome: | The proposed model improves unsupervised cross-lingual word embeddings on distant language pairs in low-resource settings. |
Unsupervised Disambiguation of Syncretism in Inflected Lexicons (N18-2)
Copied to clipboard
| Challenge: | Lexical ambiguity makes it difficult to compute useful statistics of a corpus. |
| Approach: | They propose a neural network-based model that fits a prior distribution over feature bundles to a list of unigram type counts and partitions each count among different analyses of that unigrammer. |
| Outcome: | The proposed model is based on a list of unigram type counts and partitions each count among different analyses of that unigrammer. |
Joint Learning of Sense and Word Embeddings (L18-1)
Copied to clipboard
| Challenge: | Existing methods for learning lower-dimensional representations of words using unlabelled data learn a single representation for a word, ignoring the different senses of that word (polysemy). |
| Approach: | They propose a method that jointly learns sense-aware word embeddings using both unlabelled and sense-tagged text corpora. |
| Outcome: | The proposed method outperforms competing methods on word similarity and short-text classification benchmark datasets. |