Challenge: Existing models for detecting semantic change in corpora have been disregarded due to lack of knowledge of the nature of semantic change and the way it takes place.
Approach: They propose a model that leverages synchronic lexical relations and definitions of word meanings to detect these types of change.
Outcome: The proposed model can detect changes in a digitized version of Blank's dataset and improve human judgments of semantic relatedness and binary Lexical Semantic Change Detection.

Similar Papers

Analysing Lexical Semantic Change with Contextualised Word Representations (2020.acl-main)

Copied to clipboard

Challenge: Existing studies on lexical semantic change have focused on detecting and characterising word meaning shifts using distributional semantic models.
Approach: They propose a method that exploits the BERT neural language model to obtain representations of word usages, clusters these representations into usage types, and measures change along time with three proposed metrics.
Outcome: The proposed method captures a variety of synchronic and diachronic linguistic phenomena and is highly reproducible and reproducible.
Definition generation for lexical semantic change detection (2024.findings-acl)

Copied to clipboard

Challenge: a number of studies have attempted to bridge the gap between lexical semantic change detection and sense-based LSCD methods.
Approach: They propose a sense distribution based LSCD method which uses contextualized word definitions as 'senses' they argue that the method preserves interpretability and allows to inspect the reasons behind a specific shift in terms of discrete definitions-as-sense.
Outcome: The proposed method outperforms previous sense-based methods on five datasets and three languages and preserves interpretability and allows to inspect the reasons behind a specific shift in terms of discrete definitions-as-senses.
Analyzing Semantic Change through Lexical Replacements (2024.acl-long)

Copied to clipboard

Challenge: Modern language models can contextualize words based on their surrounding contexts, but semantic change can compromise this capability.
Approach: They propose a replacement schema where a target word is replaced with lexical replacements of varying relatedness . they leverage the replacement schema as a basis for a novel interpretable model for semantic change .
Outcome: The proposed model is the first to evaluate LLaMa for semantic change detection . it shows that lexical replacements can detect unexpected contexts .
Computational modeling of semantic change (2024.eacl-tutorials)

Copied to clipboard

Challenge: Languages change constantly over time, influenced by social, technological, cultural and political factors that affect how people express themselves.
Approach: They propose to categorise the types of change, the causes and the mechanisms underlying the different types of changes using large diachronic corpora and evaluation benchmarks.
Outcome: In historical linguistics, tools and methods have been developed to analyse the process . they include categorisations of types of change, causes and mechanisms . but traditional methods, while informative, are often based on small, carefully curated samples.
Sequential Modelling of the Evolution of Word Representations for Semantic Change Detection (2020.emnlp-main)

Copied to clipboard

Challenge: Existing models that detect semantically shifted words do not account for its evolution through time.
Approach: They propose three variants of sequential models for detecting semantically shifted words . they demonstrate that temporal modelling of word representations yields a clear-cut advantage .
Outcome: The proposed models account for the changes in word representations over time.
Lexical Semantic Change Discovery (2021.acl-long)

Copied to clipboard

Challenge: Existing approaches to Lexical Semantic Change Detection are limited.
Approach: They propose a shift from change detection to change discovery by fine-tuning a type-based and a token-based approach on recently published German data.
Outcome: The proposed models can be applied to discover new words undergoing meaning change from the full corpus vocabulary.
Understanding Computational Models of Semantic Change: New Insights from the Speech Community (2023.emnlp-main)

Copied to clipboard

Challenge: Using type-level and token-level word embeddings, we obtain semantic change estimates from type-based models and empirical linguistic properties.
Approach: They analyze 40 target words with type-level and token-level word embeddings, empirical linguistic properties, and speaker-provided acceptability ratings and qualitative remarks.
Outcome: The proposed models are able to describe the sociolinguistic issue of contact-induced semantic shifts in Quebec English and are validated by qualitative interviews with 15 speakers from Montreal.
Detecting Contact-Induced Semantic Shifts: What Can Embedding-Based Methods Do in Practice? (2021.emnlp-main)

Copied to clipboard

Challenge: Existing work on semantic change detection methods has focused on generic research questions and datasets, using them as a training ground for proof-of-concept studies.
Approach: They propose to use type-level embeddings to detect new semantic shifts and token-level embeddeds to isolate regionally specific occurrences.
Outcome: The proposed method is comparable to state-of-the-art on diachrony tasks, but it does not translate to practical value in detecting new semantic shifts.
Effects of Pre- and Post-Processing on type-based Embeddings in Lexical Semantic Change Detection (2021.eacl-main)

Copied to clipboard

Challenge: Lexical semantic change detection is a new and innovative research field.
Approach: They propose to pre-train on large corpora and refine on diachronic target corpors to improve performance.
Outcome: The proposed models improve on large corpora and diachronic target corpors . the proposed models are compared with existing models in a variety of learning scenarios .
A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domains (P19-1)

Copied to clipboard

Challenge: Existing models for diachronic and synchronic detection of lexical semantic divergences are superficial and lack of comparison.
Approach: They propose to extend benchmark models on a common state-of-the-art evaluation task . they also demonstrate that the same evaluation task and modelling approaches can be utilised for synchronic detection of domain-specific sense divergences in the field of term extraction.
Outcome: The proposed model can be utilised for the detection of domain-specific sense divergences in the field of term extraction.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations