Detecting Contact-Induced Semantic Shifts: What Can Embedding-Based Methods Do in Practice? (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on semantic change detection methods has focused on generic research questions and datasets, using them as a training ground for proof-of-concept studies. |
| Approach: | They propose to use type-level embeddings to detect new semantic shifts and token-level embeddeds to isolate regionally specific occurrences. |
| Outcome: | The proposed method is comparable to state-of-the-art on diachrony tasks, but it does not translate to practical value in detecting new semantic shifts. |
Similar Papers
Diachronic word embeddings and semantic shifts: a survey (C18-1)
Copied to clipboard
| Challenge: | Existing methods for tracing time-related semantic shifts with word embedding models lack the cohesion, common terminology and shared practices of more established areas of natural language processing. |
| Approach: | They propose several axes along which these methods can be compared and propose a framework for comparison. |
| Outcome: | The proposed methods are compared with existing methods and outline their main challenges and potential applications. |
Understanding Computational Models of Semantic Change: New Insights from the Speech Community (2023.emnlp-main)
Copied to clipboard
| Challenge: | Using type-level and token-level word embeddings, we obtain semantic change estimates from type-based models and empirical linguistic properties. |
| Approach: | They analyze 40 target words with type-level and token-level word embeddings, empirical linguistic properties, and speaker-provided acceptability ratings and qualitative remarks. |
| Outcome: | The proposed models are able to describe the sociolinguistic issue of contact-induced semantic shifts in Quebec English and are validated by qualitative interviews with 15 speakers from Montreal. |
A Methodology for Building a Diachronic Dataset of Semantic Shifts and its Application to QC-FR-Diac-V1.0, a Free Reference for French (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing algorithms to detect semantic shifts have been criticized for their difficulty in evaluating them. |
| Approach: | They propose a method for building a reference dataset for semantic shift detection . they use a word-sense disambiguation model to associate a date of first appearance to all senses of a term . |
| Outcome: | The proposed method is based on a word-sense disambiguation model . significant changes in sense distributions and stability are detected . the resulting words are inspected by experts using a dedicated interface . |
Leveraging Contextual Embeddings for Detecting Diachronic Semantic Shift (2020.lrec-1)
Copied to clipboard
| Challenge: | Existing methods for word embeddings have been used to model semantic relations with word embeds. |
| Approach: | They propose a method that leverages contextual embeddings for diachronic semantic shift detection by generating time specific word representations from BERT embedds. |
| Outcome: | The proposed method performs comparable to the current state-of-the-art without time consuming domain adaptation on large corpora. |
Analyzing Continuous Semantic Shifts with Diachronic Word Similarity Matrices (2025.coling-main)
Copied to clipboard
| Challenge: | Existing methods to analyze word sense proportions are insufficient for understanding semantic shifts . et al., 2018: semantic shift and its effects. |
| Approach: | They propose a framework for how semantic shifts occur over multiple time periods by using word embeddings. |
| Outcome: | The proposed framework can analyze semantic shifts over multiple time periods using word embeddings. |
Room to Glo: A Systematic Comparison of Semantic Change Detection Approaches with Word Embeddings (D19-1)
Copied to clipboard
| Challenge: | Word embeddings are increasingly used for automatic detection of semantic change, but a robust evaluation and systematic comparison of the choices involved has been lacking. |
| Approach: | They propose a new evaluation framework for semantic change detection using whole time series and a Twitter dataset spanning 5.5 years. |
| Outcome: | The proposed framework shows that using whole time series is preferable over continuously trained embeddings for long time periods and that the reference point matters. |
Using Synchronic Definitions and Semantic Relations to Classify Semantic Change Types (2024.acl-long)
Copied to clipboard
| Challenge: | Existing models for detecting semantic change in corpora have been disregarded due to lack of knowledge of the nature of semantic change and the way it takes place. |
| Approach: | They propose a model that leverages synchronic lexical relations and definitions of word meanings to detect these types of change. |
| Outcome: | The proposed model can detect changes in a digitized version of Blank's dataset and improve human judgments of semantic relatedness and binary Lexical Semantic Change Detection. |
Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detection (2021.eacl-main)
Copied to clipboard
| Challenge: | Lexical semantic change detection is a new and innovative research field. |
| Approach: | They propose to pre-train on large corpora and refine on diachronic target corpors to improve performance. |
| Outcome: | The proposed models improve on large corpora and diachronic target corpors . the proposed models are compared with existing models in a variety of learning scenarios . |
Diachronic Sense Modeling with Deep Contextualized Word Embeddings: An Ecological View (P19-1)
Copied to clipboard
| Challenge: | Existing word embeddings only assign one vector to a word for a time period, thus they face the meaning conflation deficiency. |
| Approach: | They propose a sense representation and tracking framework based on deep contextualized embeddings that can be used to answer what and when the word meaning changes. |
| Outcome: | The proposed framework is effective in representing fine-grained word senses, and brings a significant improvement in word change detection task. |
Substitution-based Semantic Change Detection using Contextual Embeddings (2023.acl-short)
Copied to clipboard
| Challenge: | a simplified approach to measuring semantic change using contextual embeddings is proposed . the static word vectors used for measuring semantic changes are difficult to interpret . |
| Approach: | They propose a simplified approach to measuring semantic change using contextual embeddings . they use the Jensen-Shannon Divergence between the distributions of most probable replacements for masked words in different time periods to measure semantic change. |
| Outcome: | The proposed approach is interpretable, efficient and much more efficient than static embeddings. |