Infinite SCAN: An Infinite Model of Diachronic Semantic Change (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for capturing semantic changes using word embeddings cannot account for existence of each sense and its relative importance. |
| Approach: | They propose a Bayesian model that can estimate the number of senses of words and their changes through time using a dynamic topic model and a logistic stick-breaking process. |
| Outcome: | The proposed model outperforms the baseline model and investigates the semantic changes of several well-known target words using the CCOHA corpus. |
Similar Papers
A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domains (P19-1)
Copied to clipboard
| Challenge: | Existing models for diachronic and synchronic detection of lexical semantic divergences are superficial and lack of comparison. |
| Approach: | They propose to extend benchmark models on a common state-of-the-art evaluation task . they also demonstrate that the same evaluation task and modelling approaches can be utilised for synchronic detection of domain-specific sense divergences in the field of term extraction. |
| Outcome: | The proposed model can be utilised for the detection of domain-specific sense divergences in the field of term extraction. |
Deep Neural Models of Semantic Shift (N18-1)
Copied to clipboard
| Challenge: | Diachronic distributional models track changes in word use over time using a continuous variable and a synthetic task to measure the semantic trajectory of a word. |
| Approach: | They propose a deep neural network diachronic distributional model that represents time as a continuous variable and model a word’s usage as . a synthetic task which measures how well a model captures the semantic trajectory of a . word over time. |
| Outcome: | The proposed model can capture the semantic trajectory of a word over time and can measure the speed of lexical change. |
Diachronic Sense Modeling with Deep Contextualized Word Embeddings: An Ecological View (P19-1)
Copied to clipboard
| Challenge: | Existing word embeddings only assign one vector to a word for a time period, thus they face the meaning conflation deficiency. |
| Approach: | They propose a sense representation and tracking framework based on deep contextualized embeddings that can be used to answer what and when the word meaning changes. |
| Outcome: | The proposed framework is effective in representing fine-grained word senses, and brings a significant improvement in word change detection task. |
Diachronic word embeddings and semantic shifts: a survey (C18-1)
Copied to clipboard
| Challenge: | Existing methods for tracing time-related semantic shifts with word embedding models lack the cohesion, common terminology and shared practices of more established areas of natural language processing. |
| Approach: | They propose several axes along which these methods can be compared and propose a framework for comparison. |
| Outcome: | The proposed methods are compared with existing methods and outline their main challenges and potential applications. |
Sequential Modelling of the Evolution of Word Representations for Semantic Change Detection (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models that detect semantically shifted words do not account for its evolution through time. |
| Approach: | They propose three variants of sequential models for detecting semantically shifted words . they demonstrate that temporal modelling of word representations yields a clear-cut advantage . |
| Outcome: | The proposed models account for the changes in word representations over time. |
Analysing Lexical Semantic Change with Contextualised Word Representations (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on lexical semantic change have focused on detecting and characterising word meaning shifts using distributional semantic models. |
| Approach: | They propose a method that exploits the BERT neural language model to obtain representations of word usages, clusters these representations into usage types, and measures change along time with three proposed metrics. |
| Outcome: | The proposed method captures a variety of synchronic and diachronic linguistic phenomena and is highly reproducible and reproducible. |
Computational modeling of semantic change (2024.eacl-tutorials)
Copied to clipboard
| Challenge: | Languages change constantly over time, influenced by social, technological, cultural and political factors that affect how people express themselves. |
| Approach: | They propose to categorise the types of change, the causes and the mechanisms underlying the different types of changes using large diachronic corpora and evaluation benchmarks. |
| Outcome: | In historical linguistics, tools and methods have been developed to analyse the process . they include categorisations of types of change, causes and mechanisms . but traditional methods, while informative, are often based on small, carefully curated samples. |
A Methodology for Building a Diachronic Dataset of Semantic Shifts and its Application to QC-FR-Diac-V1.0, a Free Reference for French (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing algorithms to detect semantic shifts have been criticized for their difficulty in evaluating them. |
| Approach: | They propose a method for building a reference dataset for semantic shift detection . they use a word-sense disambiguation model to associate a date of first appearance to all senses of a term . |
| Outcome: | The proposed method is based on a word-sense disambiguation model . significant changes in sense distributions and stability are detected . the resulting words are inspected by experts using a dedicated interface . |
Diachronic degradation of language models: Insights from social media (P18-2)
Copied to clipboard
| Challenge: | Existing studies have explored whether and how language models degrade over time, i.e. why they fail to work on contemporary language. |
| Approach: | They investigate the accuracy of pre-trained language models for downstream tasks in machine learning and user profiling. |
| Outcome: | The results show that it is possible to measure diachronic drifts within social media and within the span of a few years. |
Improving Diachronic Word Sense Induction with a Nonparametric Bayesian method (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing models for dichronic word Sense Induction (DWSI) are not fully explored or compared against in the current state of the art. |
| Approach: | They propose two new models for Diachronic Word Sense Induction based on topic modelling techniques. |
| Outcome: | The proposed models outperform the state-of-the-art models on a time-stamped dataset from the biomedical domain. |