ConShift: Sense-based Language Variation Analysis using Flexible Alignment (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for semantic variation analysis are limited due to the limited evaluation datasets available for word-level and sense-level variants. |
| Approach: | They propose a family of alignment-based algorithms that enable semantic variation analysis at the sense-level. |
| Outcome: | The proposed algorithms can detect multiple sense-level language variations while providing explanations through visualization of related concepts. |
Similar Papers
A Multilingual Evaluation Dataset for Monolingual Word Sense Alignment (2020.lrec-1)
Copied to clipboard
Sina Ahmadi, John Philip McCrae, Sanni Nimb, Fahad Khan, Monica Monachini, Bolette Pedersen, Thierry Declerck, Tanja Wissik, Andrea Bellandi, Irene Pisani, Thomas Troelsgård, Sussi Olsen, Simon Krek, Veronika Lipp, Tamás Váradi, László Simon, András Gyorffy, Carole Tiberius, Tanneke Schoonheim, Yifat Ben Moshe, Maya Rudich, Raya Abu Ahmad, Dorielle Lonke, Kira Kovalenko, Margit Langemets, Jelena Kallas, Oksana Dereza, Theodorus Fransen, David Cillessen, David Lindemann, Mikel Alonso, Ana Salgado, José Luis Sancho, Rafael-J. Ureña-Ruiz, Jordi Porta Zamorano, Kiril Simov, Petya Osenova, Zara Kancheva, Ivaylo Radev, Ranka Stanković, Andrej Perdih, Dejan Gabrovsek
| Challenge: | a new dataset aims to align monolingual dictionaries with a single sense level for 15 languages . this dataset covers a wide range of languages and resources . |
| Approach: | They propose to manually align monolingual dictionaries with possible semantic relationships . they use 15 languages to create a new baseline for the task of monolingual word sense alignment . |
| Outcome: | The proposed dataset covers 15 languages and covers the more challenging task of linking general-purpose language. |
Understanding Cross-Lingual Alignment—A Survey (2024.findings-acl)
Copied to clipboard
| Challenge: | Cross-lingual alignment is the meaningful similarity of representations across languages in multilingual language models. |
| Approach: | They propose a taxonomy of methods to improve cross-lingual alignment . they argue that an effective trade-off between language-neutral and language-specific information is key . |
| Outcome: | The proposed methods can be applied to encoder models and encoder-decoder-only models . they show that language-neutral and language-specific information is key . |
Word-level Prefix/Suffix Sense Detection: A Case Study on Negation Sense with Few-shot Learning (2023.findings-acl)
Copied to clipboard
| Challenge: | Morphological analysis is an important research issue in natural language processing . prefixes/suffixes are sometimes ambiguous, causing difficulty in detecting negation sense . |
| Approach: | They propose a context-free morphological analysis task that deals with negation sense . they propose morphology task that uses input-augmentation prompts to train a model . |
| Outcome: | The proposed approach is effective in detecting negation senses in a corpus of prefixes/suffixes . Empirical studies show that the proposed approach works in context-free mode . |
Hierarchical Mapping for Crosslingual Word Embedding Alignment (2020.tacl-1)
Copied to clipboard
| Challenge: | Existing strategies that map word embeddings into a crosslingual space are biased towards the choice of the pivot language. |
| Approach: | They propose to map any two languages into a different middle space by learning mappings across languages in a hierarchical way. |
| Outcome: | The proposed strategy significantly improves vocabulary induction scores in all existing benchmarks and in a new non-English–centered benchmark. |
Accurate and Efficient Statistical Testing for Word Semantic Breadth (2026.acl-long)
Copied to clipboard
| Challenge: | Existing studies on semantic breadth and spread of words have focused on semantic relatedness, but contextualized token embeddings can be misleading. |
| Approach: | They propose a Householder-aligned permutation test to isolate dispersion differences from directional differences. |
| Outcome: | The proposed method reduces Type-I error by 32.5% while preserving sensitivity to genuine breadth differences. |
Diachronic Sense Modeling with Deep Contextualized Word Embeddings: An Ecological View (P19-1)
Copied to clipboard
| Challenge: | Existing word embeddings only assign one vector to a word for a time period, thus they face the meaning conflation deficiency. |
| Approach: | They propose a sense representation and tracking framework based on deep contextualized embeddings that can be used to answer what and when the word meaning changes. |
| Outcome: | The proposed framework is effective in representing fine-grained word senses, and brings a significant improvement in word change detection task. |
Variance Matters: Detecting Semantic Differences without Corpus/Word Alignment (2023.emnlp-main)
Copied to clipboard
| Challenge: | a new method for finding semantic differences in words appears in two corpora, but it requires a variance of word vectors . a word covers more meanings in a corpus, and its mean word vector becomes shorter . |
| Approach: | They propose a method to measure the coverage of meanings of a word in a corpus through the norm of its mean word vector. |
| Outcome: | The proposed methods rival the best-performing system in the SemEval-2020 Task 1 . they are robust for the skew in corpus sizes and capable of detecting infrequent words . |
Language Directions in Multilingual LLMs: A Layer-wise Diagnostic Study of Token Alignment and Pretraining Imprint (2026.acl-srw)
Copied to clipboard
| Challenge: | Using a unified probing framework, we analyze six multilingual LLMs across five languages. |
| Approach: | They analyze multilingual representations across five languages and analyze their behavior . they find that accuracy rises by +73.5 to +80.7 points from L0 to L1 on average . |
| Outcome: | The proposed framework enables a consistent and substantial early jump in accuracy across models . the token–language alignment measures where vocabulary sharing peaks . |
Detecting Contact-Induced Semantic Shifts: What Can Embedding-Based Methods Do in Practice? (2021.emnlp-main)
Copied to clipboard
| Challenge: | Existing work on semantic change detection methods has focused on generic research questions and datasets, using them as a training ground for proof-of-concept studies. |
| Approach: | They propose to use type-level embeddings to detect new semantic shifts and token-level embeddeds to isolate regionally specific occurrences. |
| Outcome: | The proposed method is comparable to state-of-the-art on diachrony tasks, but it does not translate to practical value in detecting new semantic shifts. |
A Wind of Change: Detecting and Evaluating Lexical Semantic Change across Times and Domains (P19-1)
Copied to clipboard
| Challenge: | Existing models for diachronic and synchronic detection of lexical semantic divergences are superficial and lack of comparison. |
| Approach: | They propose to extend benchmark models on a common state-of-the-art evaluation task . they also demonstrate that the same evaluation task and modelling approaches can be utilised for synchronic detection of domain-specific sense divergences in the field of term extraction. |
| Outcome: | The proposed model can be utilised for the detection of domain-specific sense divergences in the field of term extraction. |