Homonym normalisation by word sense clustering: a case in Japanese (2020.coling-main)
Copied to clipboard
| Challenge: | homonyms and homophones are a problem in language processing because of their distinct meanings. |
| Approach: | They propose a method that uses contextualised embeddings to cluster tokens into distinct sense groups and use these groups to normalise synonymous instances to a single representative form. |
| Outcome: | The proposed method is able to normalise synonymous instances to a single representative form in Japanese and improves on normalisation and transliteration. |
Similar Papers
Disambiguating Homographs and Homophones Simultaneously: A Regrouping Method for Japanese (2024.lrec-main)
Copied to clipboard
| Challenge: | Using a method that re-groups surface forms into clusters representing synonyms, we examine how accurate such disambiguation can be. |
| Approach: | They propose to regroup homographs and homophones into clusters and use them to disambiguate them. |
| Outcome: | The proposed method is applied post-hoc to trained word embeddings in Japanese. |
Creating dialect sub-corpora by clustering: a case in Japanese for an adaptive method (L18-1)
Copied to clipboard
| Challenge: | a mixed corpus composed of different dialects is sufficiently resourced to cluster them into dialects. |
| Approach: | They propose a pipeline to derive clusters of dialects from a mixed corpus when their standard counterpart is sufficiently resourced. |
| Outcome: | The proposed pipeline can identify dialectal content when its standard counterpart is sufficiently resourced and can then cluster it into four dialects. |
Patterns of Polysemy and Homonymy in Contextualised Language Models (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has focused on homonymy, a variety of multiplicity of meanings exemplified by word forms with unrelated meanings. |
| Approach: | They investigate the extent to which contextualised embeddings reflect traditional distinctions of polysemy and homonymy. |
| Outcome: | The proposed model shows that it can distinguish between polysemy and homonymy . it shows that the model fails to replicate the results of the human-annotated dataset . |
A Closer Look at Clustering Bilingual Comparable Corpora (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods for clustering comparable corpora are not suitable for bilingual corpors. |
| Approach: | They propose new clustering models fully adapted to comparable corpora based on a deep variant of Kmeans . they illustrate their behavior on bilingual collections created from Wikipedia . |
| Outcome: | The proposed models show that they can cluster comparable corpora on bilingual collections . the proposed models are based on a state-of-the-art deep variant of Kmeans . |
Dialect Clustering with Character-Based Metrics: in Search of the Boundary of Language and Dialect (2020.lrec-1)
Copied to clipboard
| Challenge: | 'A language is a dialect with an army and navy' is attributed to sociologist Max Weinrich. |
| Approach: | They propose a universal character-based method for representing sentences so that one can calculate the distance between any two sentence pairs. |
| Outcome: | The proposed method can be used to calculate distance between two sentences by clustering a dialect/sub-language mixed corpus into sub-groups and to partially answer the question of what separates languages from dialects. |
Contextualized Embeddings for Enriching Linguistic Analyses on Politeness (2020.coling-main)
Copied to clipboard
| Challenge: | Current word embeddings in natural language processing do capture context and thus can be leveraged to enrich linguistic analyses. |
| Approach: | They propose a model which leverages pre-trained BERT to cluster contextualized representations of a word based on context in which it appears and labels of items it occurs in. |
| Outcome: | The proposed model can detect interpretable, finer-grained context patterns associated with (im)polite language. |
CluBERT: A Cluster-Based Approach for Learning Sense Distributions in Multiple Languages (2020.acl-main)
Copied to clipboard
| Challenge: | Existing methods to induce word senses from raw sentences lack reliable and high-coverage distributions. |
| Approach: | They propose an automatic and multilingual approach to inducing word senses from a corpus of raw sentences using an annotated corpus. |
| Outcome: | The proposed method outperforms all other methods on English and other languages. |
Building Static Embeddings from Contextual Ones: Is It Useful for Building Distributional Thesauri? (2022.lrec-1)
Copied to clipboard
| Challenge: | contextual language models are dominant in the field of Natural Language Processing, but they are not suitable for all uses. |
| Approach: | They propose a method for building word or type-level embeddings from contextual models . they evaluate a large set of English nouns from the perspective of extracting semantic similarity relations . |
| Outcome: | The proposed method can be used to build word or type embeddings from contextual models . it can be exploited for a wide set of English nouns, showing it can improve distributional thesauri . |
Exploring the Representation of Word Meanings in Context: A Case Study on Homonymy and Synonymy (2021.acl-long)
Copied to clipboard
| Challenge: | Existing models that represent different senses of words in context are not accurate for polysemous words. |
| Approach: | They propose a multilingual dataset that evaluates the ability of models to accurately represent different lexical-semantic relations such as homonymy and synonymy. |
| Outcome: | The proposed models can disambiguate homonyms in context, but fail to represent words with different senses when occurring in similar sentences. |
Analyzing Homonymy Disambiguation Capabilities of Pretrained Language Models (2024.lrec-main)
Copied to clipboard
Lorenzo Proietti, Stefano Perrella, Simone Tedeschi, Giulia Vulpis, Leonardo Lavalle, Andrea Sanchietti, Andrea Ferrari, Roberto Navigli
| Challenge: | Word Sense Disambiguation (WSD) is a key task in Natural Language Processing (NLP) but current pretrained language models lack the granularity to perform disambiguation . |
| Approach: | They propose a large-scale resource that leverages homonymy relations to cluster WordNet senses and train Homonymy Disambiguation systems. |
| Outcome: | The proposed model can distinguish homonyms with up to 95% accuracy even without fine-tuning the underlying PLM. |